Jul 22 02:35:10.744908 ip-10-0-130-119 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 02:35:10.744919 ip-10-0-130-119 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 02:35:10.744927 ip-10-0-130-119 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 02:35:10.745172 ip-10-0-130-119 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 02:35:22.063377 ip-10-0-130-119 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 02:35:22.063394 ip-10-0-130-119 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 88eaf728a7204440988dfb6cd351792c --
Jul 22 02:37:11.439443 ip-10-0-130-119 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 02:37:11.767795 ip-10-0-130-119 kubenswrapper[2523]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:11.767795 ip-10-0-130-119 kubenswrapper[2523]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 02:37:11.767795 ip-10-0-130-119 kubenswrapper[2523]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:11.767795 ip-10-0-130-119 kubenswrapper[2523]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 02:37:11.767795 ip-10-0-130-119 kubenswrapper[2523]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 02:37:11.769247 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.769156    2523 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 02:37:11.775822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775791    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.775822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775817    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.775822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775821    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.775822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775825    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.775822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775829    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775834    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775838    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775843    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775846    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775849    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775852    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775855    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775858    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775860    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775863    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775866    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775869    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775872    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775874    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775877    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775879    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775882    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775884    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775887    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.776047 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775889    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775891    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775894    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775896    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775900    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775902    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775908    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775911    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775913    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775915    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775918    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775920    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775922    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775925    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775928    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775931    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775933    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775936    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775938    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.776535 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775940    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775943    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775945    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775947    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775950    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775952    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775955    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775957    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775960    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775963    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775965    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775967    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775970    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775974    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775977    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775980    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775983    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775985    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775988    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.776979 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775990    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775994    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775997    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.775999    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776001    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776004    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776007    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776009    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776013    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776016    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776019    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776022    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776024    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776027    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776029    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776032    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776035    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776037    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776040    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776042    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.777443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776044    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776047    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776050    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776053    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776056    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776058    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776061    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776064    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776066    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776068    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776071    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776073    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776076    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776078    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776081    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776083    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776086    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776825    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776831    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776834    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.777938 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776838    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776840    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776843    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776845    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776848    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776851    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776853    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776856    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776858    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776861    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776863    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776866    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776868    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776871    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776875    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776877    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776880    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776884    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776888    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.778450 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776892    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776894    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776897    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776900    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776904    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776907    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776910    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776912    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776915    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776917    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776920    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776923    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776925    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776930    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776933    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776936    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776939    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776941    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776944    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.778944 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776947    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776950    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776953    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776956    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776958    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776960    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776963    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776965    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776968    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776971    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776973    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776975    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776978    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776980    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776983    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776985    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776988    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776990    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776993    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.779406 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776996    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.776998    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777000    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777003    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777005    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777007    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777010    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777013    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777016    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777019    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777023    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777026    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777028    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777030    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777033    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777035    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777038    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777042    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777045    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777047    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.779862 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777050    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777052    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777055    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777058    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777061    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777064    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777066    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777068    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777071    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777073    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777076    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777078    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777080    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777083    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777085    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777088    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777090    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777093    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777095    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777521    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.780352 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777527    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777531    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777535    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777539    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777543    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777546    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777549    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777553    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777556    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777559    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777562    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777564    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777567    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777569    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777573    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777579    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777583    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777638    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777642    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.780822 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777645    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777648    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777650    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777653    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777655    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777658    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777661    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777664    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777666    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777669    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777671    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777673    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777676    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777679    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777681    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777684    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777687    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777689    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777692    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777694    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.781409 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777697    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777699    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777701    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777704    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777706    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777709    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777711    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777714    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777716    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777720    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777723    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777725    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777728    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777730    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777732    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777735    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777737    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777739    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777742    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777744    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.781877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777746    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777748    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777751    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777753    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777756    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777758    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777760    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777763    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777766    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777768    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777770    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777773    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777775    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777777    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777779    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777781    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777784    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777786    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777788    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777793    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.782415 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777796    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777798    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777805    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777808    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777810    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777813    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777815    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777818    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777820    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777822    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777824    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777827    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777829    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777834    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777836    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777838    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777841    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777843    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.777845    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777930    2523 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 02:37:11.782906 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777938    2523 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777945    2523 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777950    2523 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777955    2523 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777958    2523 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777962    2523 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777967    2523 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777970    2523 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777973    2523 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777976    2523 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777979    2523 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777982    2523 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777988    2523 flags.go:64] FLAG: --cgroup-root=""
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777991    2523 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777994    2523 flags.go:64] FLAG: --client-ca-file=""
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.777997    2523 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778001    2523 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778005    2523 flags.go:64] FLAG: --cluster-domain=""
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778007    2523 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778010    2523 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778013    2523 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778016    2523 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778019    2523 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 02:37:11.783392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778022    2523 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778026    2523 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778029    2523 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778033    2523 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778035    2523 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778038    2523 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778041    2523 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778044    2523 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778048    2523 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778057    2523 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778059    2523 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778062    2523 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778065    2523 flags.go:64] FLAG: --enable-server="true"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778067    2523 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778073    2523 flags.go:64] FLAG: --event-burst="100"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778075    2523 flags.go:64] FLAG: --event-qps="50"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778078    2523 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778081    2523 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778084    2523 flags.go:64] FLAG: --eviction-hard=""
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778088    2523 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778091    2523 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778099    2523 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778102    2523 flags.go:64] FLAG: --eviction-soft=""
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778105    2523 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778107    2523 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 02:37:11.783959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778111    2523 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778113    2523 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778116    2523 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778119    2523 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778121    2523 flags.go:64] FLAG: --feature-gates=""
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778125    2523 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778128    2523 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778131    2523 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778133    2523 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778151    2523 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778154    2523 flags.go:64] FLAG: --help="false"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778157    2523 flags.go:64] FLAG: --hostname-override="ip-10-0-130-119.ec2.internal"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778160    2523 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778163    2523 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778167    2523 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778170    2523 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778173    2523 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778176    2523 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778179    2523 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778182    2523 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778184    2523 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778187    2523 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778190    2523 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778192    2523 flags.go:64] FLAG: --kube-reserved=""
Jul 22 02:37:11.784601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778195    2523 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778197    2523 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778200    2523 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778203    2523 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778207    2523 flags.go:64] FLAG: --lock-file=""
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778210    2523 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778212    2523 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778215    2523 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778220    2523 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778223    2523 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778227    2523 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778229    2523 flags.go:64] FLAG: --logging-format="text"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778232    2523 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778235    2523 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778238    2523 flags.go:64] FLAG: --manifest-url=""
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778240    2523 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778245    2523 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778248    2523 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778252    2523 flags.go:64] FLAG: --max-pods="110"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778255    2523 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778258    2523 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778260    2523 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778263    2523 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778266    2523 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778269    2523 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 02:37:11.785206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778272    2523 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778279    2523 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778282    2523 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778285    2523 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778288    2523 flags.go:64] FLAG: --pod-cidr=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778291    2523 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778297    2523 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778300    2523 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778303    2523 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778306    2523 flags.go:64] FLAG: --port="10250"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778309    2523 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778314    2523 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005bda7b3096071f8"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778317    2523 flags.go:64] FLAG: --qos-reserved=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778319    2523 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778322    2523 flags.go:64] FLAG: --register-node="true"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778325    2523 flags.go:64] FLAG: --register-with-taints=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778328    2523 flags.go:64] FLAG: --registry-burst="10"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778331    2523 flags.go:64] FLAG: --registry-qps="5"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778334    2523 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778337    2523 flags.go:64] FLAG: --reserved-memory=""
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778340    2523 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778343    2523 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778346    2523 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778349    2523 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778351    2523 flags.go:64] FLAG: --runonce="false"
Jul 22 02:37:11.785800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778354    2523 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778357    2523 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778360    2523 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778363    2523 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778365    2523 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778368    2523 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778371    2523 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778374    2523 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778377    2523 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778380    2523 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778382    2523 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778385    2523 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778388    2523 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778391    2523 flags.go:64] FLAG: --system-cgroups=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778393    2523 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778398    2523 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778401    2523 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778404    2523 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778408    2523 flags.go:64] FLAG: --tls-min-version=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778411    2523 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778413    2523 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778416    2523 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778419    2523 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778422    2523 flags.go:64] FLAG: --v="2"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778425    2523 flags.go:64] FLAG: --version="false"
Jul 22 02:37:11.786416 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778430    2523 flags.go:64] FLAG: --vmodule=""
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778433    2523 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.778436    2523 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778566    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778570    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778573    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778576    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778581    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778583    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778586    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778588    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778591    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778594    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778596    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778599    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778602    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778605    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778607    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778610    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778613    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.787050 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778615    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778618    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778620    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778622    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778633    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778638    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778640    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778643    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778645    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778648    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778650    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778653    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778655    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778659    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778662    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778665    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778668    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778670    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778672    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778676    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.787546 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778678    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778681    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778683    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778686    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778688    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778691    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778693    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778696    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778698    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778700    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778703    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778705    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778708    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778710    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778713    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778715    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778718    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778722    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778726    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.788022 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778730    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778733    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778735    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778738    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778740    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778743    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778746    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778748    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778751    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778753    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778755    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778758    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778762    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778764    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778766    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778769    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778771    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778773    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778776    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778778    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.788491 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778781    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778783    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778786    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778788    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778790    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778793    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778797    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778800    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778803    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778806    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778810    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778812    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778816    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778819    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778821    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778824    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778826    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778829    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778831    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.788959 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778833    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778836    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778838    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.778841    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.779372    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.786323    2523 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.786349    2523 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.787065    2523 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.787078    2523 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787160    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787165    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787168    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787171    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787175    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.789423 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787178    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787181    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787184    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787186    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787189    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787191    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787194    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787196    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787199    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787202    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787204    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787207    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787209    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787212    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787214    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787217    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787219    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787222    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787225    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787227    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.789759 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787229    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787232    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787234    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787237    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787246    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787249    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787251    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787255    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787259    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787262    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787265    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787268    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787271    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787274    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787277    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787279    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787282    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787285    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787287    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787290    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.790254 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787292    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787296    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787299    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787303    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787305    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787308    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787311    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787313    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787317    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787320    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787322    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787325    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787327    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787329    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787332    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787334    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787337    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787346    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787348    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.790742 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787351    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787353    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787355    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787358    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787360    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787363    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787365    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787367    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787370    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787372    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787374    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787377    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787379    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787381    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787384    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787387    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787389    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787392    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787394    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.791222 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787396    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787399    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787402    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787404    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787406    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787409    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787411    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787413    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787415    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787418    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787420    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787423    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787435    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787437    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787440    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.791661 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787442    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.787448    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787595    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787600    2523 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787604    2523 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787606    2523 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787610    2523 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787612    2523 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787615    2523 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787617    2523 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787620    2523 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787622    2523 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787625    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787627    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787630    2523 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 02:37:11.792009 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787632    2523 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787634    2523 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787637    2523 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787639    2523 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787641    2523 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787644    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787646    2523 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787649    2523 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787651    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787653    2523 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787656    2523 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787658    2523 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787660    2523 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787663    2523 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787667    2523 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787678    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787681    2523 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787683    2523 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787686    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787688    2523 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 02:37:11.792490 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787691    2523 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787693    2523 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787696    2523 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787699    2523 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787703    2523 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787705    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787708    2523 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787710    2523 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787712    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787715    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787717    2523 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787719    2523 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787722    2523 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787724    2523 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787726    2523 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787729    2523 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787731    2523 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787733    2523 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787736    2523 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787738    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 02:37:11.792961 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787740    2523 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787743    2523 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787745    2523 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787747    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787749    2523 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787753    2523 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787756    2523 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787759    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787767    2523 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787769    2523 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787772    2523 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787774    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787776    2523 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787779    2523 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787781    2523 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787784    2523 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787786    2523 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787788    2523 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787790    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 02:37:11.793459 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787793    2523 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787795    2523 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787797    2523 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787800    2523 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787802    2523 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787804    2523 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787806    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787809    2523 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787811    2523 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787813    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787815    2523 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787818    2523 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787820    2523 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787822    2523 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787824    2523 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787827    2523 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787829    2523 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787832    2523 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787837    2523 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787839    2523 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 02:37:11.793939 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787841    2523 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787844    2523 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787851    2523 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787854    2523 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787856    2523 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787858    2523 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:11.787861    2523 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.787865    2523 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.788020    2523 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.790159    2523 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.791397    2523 server.go:1019] "Starting client certificate rotation"
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.791514    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.791567    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 02:37:11.794422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.793576    2523 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:37:11.797629 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.797600    2523 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 02:37:11.810755 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.810724    2523 log.go:25] "Validated CRI v1 runtime API"
Jul 22 02:37:11.812971 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.812953    2523 log.go:25] "Validated CRI v1 image API"
Jul 22 02:37:11.813891 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.813871    2523 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 02:37:11.817021 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.816997    2523 fs.go:135] Filesystem UUIDs: map[181e29a0-4aa7-47a5-9f55-d17ed23ba9d0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a9c1166a-7aec-40d6-93e4-49d3e3cc31a6:/dev/nvme0n1p4]
Jul 22 02:37:11.817166 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.817019    2523 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 02:37:11.820126 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.820104    2523 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:37:11.822444 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.822325    2523 manager.go:216] Machine: {Timestamp:2026-07-22 02:37:11.821079046 +0000 UTC m=+0.282469792 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204192 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24ea2278964fbba9b4379c19305034 SystemUUID:ec24ea22-7896-4fbb-a9b4-379c19305034 BootID:88eaf728-a720-4440-988d-fb6cd351792c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:54:3c:6e:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:54:3c:6e:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:20:19:fc:3a:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 02:37:11.822444 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.822434    2523 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 02:37:11.822582 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.822524    2523 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 02:37:11.825326 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.825287    2523 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 02:37:11.825504 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.825328    2523 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 02:37:11.826279 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.826266    2523 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 02:37:11.826332 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.826284    2523 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 02:37:11.826332 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.826296    2523 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:37:11.826889 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.826876    2523 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 02:37:11.828217 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.828204    2523 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 02:37:11.832077 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832056    2523 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:37:11.832262 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832250    2523 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 02:37:11.832320 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832292    2523 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 02:37:11.832320 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832308    2523 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 02:37:11.832418 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832330    2523 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 02:37:11.832418 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832343    2523 kubelet.go:398] "Adding apiserver pod source"
Jul 22 02:37:11.832418 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832356    2523 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 02:37:11.832902 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832887    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:37:11.832974 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.832912    2523 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 02:37:11.834863 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.834843    2523 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 02:37:11.836743 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.836726    2523 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 02:37:11.836834 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.836764    2523 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 02:37:11.838069 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838054    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838074    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838082    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838089    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838101    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838109    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838120    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838128    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 02:37:11.838159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838158    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 02:37:11.838428 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838167    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 02:37:11.838428 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838180    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 02:37:11.838428 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.838188    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 02:37:11.839478 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.839466    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 02:37:11.839546 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.839482    2523 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 02:37:11.843552 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.843524    2523 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 02:37:11.843552 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.843518    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 02:37:11.843706 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.843526    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 02:37:11.843706 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.843598    2523 server.go:1268] "Started kubelet"
Jul 22 02:37:11.843818 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.843723    2523 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 02:37:11.843863 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.843822    2523 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 02:37:11.843904 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.843845    2523 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 02:37:11.844510 ip-10-0-130-119 systemd[1]: Started Kubernetes Kubelet.
Jul 22 02:37:11.845703 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.845680    2523 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 02:37:11.846128 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.846114    2523 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 02:37:11.850280 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.850227    2523 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 02:37:11.851066 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.850302    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c47c209bff1c20  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-22 02:37:11.843544096 +0000 UTC m=+0.304934825,LastTimestamp:2026-07-22 02:37:11.843544096 +0000 UTC m=+0.304934825,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}"
Jul 22 02:37:11.852226 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.852201    2523 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 02:37:11.852312 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.852203    2523 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 02:37:11.852356 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.852341    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:11.853036 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853018    2523 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 02:37:11.853036 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853039    2523 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 02:37:11.853353 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853124    2523 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 02:37:11.853353 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853133    2523 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 02:37:11.853353 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853160    2523 factory.go:55] Registering systemd factory
Jul 22 02:37:11.853353 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853185    2523 factory.go:223] Registration of the systemd container factory successfully
Jul 22 02:37:11.853858 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853842    2523 factory.go:153] Registering CRI-O factory
Jul 22 02:37:11.853858 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853860    2523 factory.go:223] Registration of the crio container factory successfully
Jul 22 02:37:11.853985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853910    2523 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 02:37:11.853985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853949    2523 factory.go:103] Registering Raw factory
Jul 22 02:37:11.853985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.853966    2523 manager.go:1196] Started watching for new ooms in manager
Jul 22 02:37:11.854117 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.854080    2523 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 02:37:11.854423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.854410    2523 manager.go:349] Starting recovery of all containers
Jul 22 02:37:11.858637 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.858586    2523 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 02:37:11.858826 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.858805    2523 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 02:37:11.865228 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.865038    2523 manager.go:354] Recovery completed
Jul 22 02:37:11.870674 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.870653    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:11.873014 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.872987    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:11.873092 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873030    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:11.873092 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873041    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:11.873278 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873263    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42l2v"
Jul 22 02:37:11.873747 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873732    2523 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 02:37:11.873747 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873746    2523 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 02:37:11.873862 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873751    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:11.873862 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.873766    2523 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 02:37:11.874568 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.874550    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:11.874681 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.874579    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:11.874681 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.874591    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:11.874796 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.874725    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c47c209dc0d1e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-119.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-22 02:37:11.873016288 +0000 UTC m=+0.334407019,LastTimestamp:2026-07-22 02:37:11.873016288 +0000 UTC m=+0.334407019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}"
Jul 22 02:37:11.875993 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.875980    2523 policy_none.go:49] "None policy: Start"
Jul 22 02:37:11.876063 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.875998    2523 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 02:37:11.876063 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.876009    2523 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 02:37:11.878015 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.878004    2523 policy_none.go:47] "Start"
Jul 22 02:37:11.882781 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.882761    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-42l2v"
Jul 22 02:37:11.885436 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.885357    2523 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-119.ec2.internal.18c47c209dc11b8a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-119.ec2.internal,UID:ip-10-0-130-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-119.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-119.ec2.internal,},FirstTimestamp:2026-07-22 02:37:11.873035146 +0000 UTC m=+0.334425874,LastTimestamp:2026-07-22 02:37:11.873035146 +0000 UTC m=+0.334425874,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-119.ec2.internal,}"
Jul 22 02:37:11.914897 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.914870    2523 manager.go:337] "Starting Device Plugin manager"
Jul 22 02:37:11.915044 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.914921    2523 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 02:37:11.915044 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.914932    2523 server.go:87] "Starting device plugin registration server"
Jul 22 02:37:11.915247 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.915235    2523 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 02:37:11.915301 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.915250    2523 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 02:37:11.915352 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.915334    2523 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 02:37:11.915437 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.915414    2523 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 02:37:11.915437 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.915427    2523 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 02:37:11.916070 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.916050    2523 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 02:37:11.916184 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.916106    2523 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:11.948640 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.948595    2523 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 02:37:11.955967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.949899    2523 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 02:37:11.955967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.949938    2523 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 02:37:11.955967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.949964    2523 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 02:37:11.955967 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:11.950000    2523 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 02:37:11.955967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:11.952821    2523 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:12.015438 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.015405    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.016508 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.016493    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.016573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.016524    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.016573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.016537    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.016573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.016568    2523 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.028805 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.028729    2523 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.028805 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.028759    2523 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-119.ec2.internal\": node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.050746 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.050702    2523 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"]
Jul 22 02:37:12.050932 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.050820    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.052511 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.052494    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.052596 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.052526    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.052596 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.052540    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.054930 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.054917    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.055031 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055017    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.055064 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055048    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.055382 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.055369    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.055789 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055773    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.055789 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055780    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.055894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055802    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.055894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055802    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.055894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055813    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.055894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.055821    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.058230 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.058213    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.058279 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.058251    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.059216 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.059194    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.059302 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.059236    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.059302 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.059252    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.079878 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.079851    2523 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-119.ec2.internal\" not found" node="ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.084067 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.084049    2523 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-119.ec2.internal\" not found" node="ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.155363 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.155324    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.155363 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.155360    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.155555 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.155382    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0229793d07a73dce520e9f7cfb97506-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"d0229793d07a73dce520e9f7cfb97506\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.155555 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.155412    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.255803 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.255758    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.255954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255832    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.255954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255871    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.255954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255895    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0229793d07a73dce520e9f7cfb97506-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"d0229793d07a73dce520e9f7cfb97506\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.255954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255934    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.255954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255944    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/887395d92c7bd4af2b6585b10bd30b12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal\" (UID: \"887395d92c7bd4af2b6585b10bd30b12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.256130 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.255944    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0229793d07a73dce520e9f7cfb97506-config\") pod \"kube-apiserver-proxy-ip-10-0-130-119.ec2.internal\" (UID: \"d0229793d07a73dce520e9f7cfb97506\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.356594 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.356505    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.383719 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.383677    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.387243 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.387212    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:12.456954 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.456908    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.557444 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.557411    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.658074 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.657999    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.758521 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.758481    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.791676 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.791639    2523 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 02:37:12.792290 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.791816    2523 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 02:37:12.813442 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.813410    2523 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:12.858818 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.858783    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:12.887777 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.887712    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 02:32:12 +0000 UTC" deadline="2028-01-28 23:42:24.250006181 +0000 UTC"
Jul 22 02:37:12.887777 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.887767    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13341h5m11.362242444s"
Jul 22 02:37:12.905911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.905884    2523 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 02:37:12.908636 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.908576    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 02:37:12.908636 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.908613    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 02:37:12.908636 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:12.908629    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeHasSufficientPID"
Jul 22 02:37:12.959810 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:12.959769    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:13.029830 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:13.029775    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod887395d92c7bd4af2b6585b10bd30b12.slice/crio-6544fbdc081c6bac29b0618ebcdd629e92b218909777c6bef5f1721703932e92 WatchSource:0}: Error finding container 6544fbdc081c6bac29b0618ebcdd629e92b218909777c6bef5f1721703932e92: Status 404 returned error can't find the container with id 6544fbdc081c6bac29b0618ebcdd629e92b218909777c6bef5f1721703932e92
Jul 22 02:37:13.033351 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:13.033323    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0229793d07a73dce520e9f7cfb97506.slice/crio-2ef3f07596ebb3748f824e798f7dfb68b33ae8f4a31d4de814ce32c57db8041b WatchSource:0}: Error finding container 2ef3f07596ebb3748f824e798f7dfb68b33ae8f4a31d4de814ce32c57db8041b: Status 404 returned error can't find the container with id 2ef3f07596ebb3748f824e798f7dfb68b33ae8f4a31d4de814ce32c57db8041b
Jul 22 02:37:13.037219 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.037201    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:37:13.060504 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:13.060468    2523 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-119.ec2.internal\" not found"
Jul 22 02:37:13.148901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.148867    2523 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:13.152991 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.152972    2523 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:13.167024 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.166959    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:37:13.167843 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.167827    2523 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal"
Jul 22 02:37:13.168681 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.168665    2523 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:13.174321 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.174296    2523 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 02:37:13.834013 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.833696    2523 apiserver.go:52] "Watching apiserver"
Jul 22 02:37:13.839570 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.839539    2523 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 02:37:13.840034 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.840005    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fxj8k","kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs","openshift-cluster-node-tuning-operator/tuned-plln2","openshift-dns/node-resolver-h4zgv","openshift-image-registry/node-ca-skdmt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal","openshift-multus/multus-2fvgl","kube-system/konnectivity-agent-fb9fv","openshift-multus/multus-additional-cni-plugins-9rsk2","openshift-multus/network-metrics-daemon-jkdzf","openshift-network-diagnostics/network-check-target-bzph8","openshift-network-operator/iptables-alerter-lqxt8","openshift-ovn-kubernetes/ovnkube-node-xcmfl"]
Jul 22 02:37:13.842961 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.842932    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.845283    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.845548    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.845655    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.845695    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.845951    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-66px7\""
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.846008    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 02:37:13.846110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.846027    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.848635 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.847242    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.848635 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.847570    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 02:37:13.848635 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.847695    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f7xr2\""
Jul 22 02:37:13.848635 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.847852    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.848635 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.848063    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.850141 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.850123    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852152    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852163    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2t5f\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852500    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852514    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852619    2523 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852686    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-24wk5\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.852887    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.853119    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.854204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.853325    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.855959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.855309    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.855959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.855444    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k9wxb\""
Jul 22 02:37:13.855959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.855312    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.855959 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.855777    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.857813 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.857289    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.857813 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.857411    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.857813 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.857464    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9ld7b\""
Jul 22 02:37:13.857813 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.857699    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 02:37:13.858065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.857826    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.859839 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.859812    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 02:37:13.860466 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.860443    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 02:37:13.860848 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.860830    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.863155 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.863131    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 02:37:13.863395 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.863378    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 02:37:13.863483 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.863393    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgk9z\""
Jul 22 02:37:13.863483 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.863436    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f2cpd\""
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.864381    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.864568    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.864599    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.864701    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.864799    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.865367    2523 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866480    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.866595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866584    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-device-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866629    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-host\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866667    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hml5q\" (UniqueName: \"kubernetes.io/projected/54edb804-d925-4d24-b532-2e0c2feca0bb-kube-api-access-hml5q\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866758    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-konnectivity-ca\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866789    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-kubernetes\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866818    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866849    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysconfig\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866881    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866931    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866963    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.866994    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-run\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867029    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-agent-certs\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867063    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867093    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867120    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf0b081-b5c8-49fe-8526-462cbe0745e7-tmp-dir\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867178    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-modprobe-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.867322 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867209    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-tmp\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867260    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbrvc\" (UniqueName: \"kubernetes.io/projected/b0e2839f-e46f-402e-a565-f32ce9451e5d-kube-api-access-gbrvc\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867295    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pww68\" (UniqueName: \"kubernetes.io/projected/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kube-api-access-pww68\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867328    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-conf\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867364    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-systemd\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867393    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-lib-modules\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867428    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-cnibin\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867460    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867493    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54edb804-d925-4d24-b532-2e0c2feca0bb-serviceca\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867521    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtl4t\" (UniqueName: \"kubernetes.io/projected/ddf0b081-b5c8-49fe-8526-462cbe0745e7-kube-api-access-vtl4t\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867552    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-system-cni-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867935    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd03602-6816-48ab-a539-8d318057dc1e-iptables-alerter-script\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.867969    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd03602-6816-48ab-a539-8d318057dc1e-host-slash\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868001    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868032    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddf0b081-b5c8-49fe-8526-462cbe0745e7-hosts-file\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868059    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-var-lib-kubelet\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868131 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868097    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-tuned\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868129    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz47x\" (UniqueName: \"kubernetes.io/projected/ddd03602-6816-48ab-a539-8d318057dc1e-kube-api-access-bz47x\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868160    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868189    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-sys\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868240    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvn2g\" (UniqueName: \"kubernetes.io/projected/ecf61016-171b-4475-b33b-2ff954b2dbfc-kube-api-access-cvn2g\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868274    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54edb804-d925-4d24-b532-2e0c2feca0bb-host\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.868990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.868305    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-os-release\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.869329 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.869077    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 02:37:13.869329 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.869317    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x87t8\""
Jul 22 02:37:13.875259 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.875229    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:13.875522 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:13.875496    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:13.877863 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.877839    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:13.877954 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:13.877916    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:13.880886 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.880863    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:13.880992 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:13.880930    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:13.890471 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.890439    2523 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtnwg"
Jul 22 02:37:13.905812 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.905780    2523 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gtnwg"
Jul 22 02:37:13.955278 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.955241    2523 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 02:37:13.956065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.955996    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" event={"ID":"d0229793d07a73dce520e9f7cfb97506","Type":"ContainerStarted","Data":"2ef3f07596ebb3748f824e798f7dfb68b33ae8f4a31d4de814ce32c57db8041b"}
Jul 22 02:37:13.957288 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.957259    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"887395d92c7bd4af2b6585b10bd30b12","Type":"ContainerStarted","Data":"6544fbdc081c6bac29b0618ebcdd629e92b218909777c6bef5f1721703932e92"}
Jul 22 02:37:13.969487 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969439    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54edb804-d925-4d24-b532-2e0c2feca0bb-serviceca\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969495    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-slash\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969526    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-netns\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969555    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-ovn\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969583    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-hostroot\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969602    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd03602-6816-48ab-a539-8d318057dc1e-host-slash\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969618    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969640    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-bin\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.969679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969664    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-sys\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969685    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd03602-6816-48ab-a539-8d318057dc1e-host-slash\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969709    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovn-node-metrics-cert\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969751    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-kubelet\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969803    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvn2g\" (UniqueName: \"kubernetes.io/projected/ecf61016-171b-4475-b33b-2ff954b2dbfc-kube-api-access-cvn2g\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969829    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54edb804-d925-4d24-b532-2e0c2feca0bb-host\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969856    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-multus-daemon-config\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969866    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-socket-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969881    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-os-release\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969914    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-sys\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969916    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-device-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969944    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54edb804-d925-4d24-b532-2e0c2feca0bb-host\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.969943    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-etc-kubernetes\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970031    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-os-release\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970057    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970078    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970086    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54edb804-d925-4d24-b532-2e0c2feca0bb-serviceca\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970100    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-run\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970117    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-agent-certs\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970136    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970175    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-run\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970276    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-device-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970458    2523 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970587    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-cnibin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970628    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-systemd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970663    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970692    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970727    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf0b081-b5c8-49fe-8526-462cbe0745e7-tmp-dir\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970739    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970750    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-modprobe-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970798    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-tmp\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.970860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970801    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-etc-selinux\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970837    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-modprobe-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970840    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbrvc\" (UniqueName: \"kubernetes.io/projected/b0e2839f-e46f-402e-a565-f32ce9451e5d-kube-api-access-gbrvc\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970729    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-binary-copy\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970870    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-conf\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970967    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-conf\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970986    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.970995    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddf0b081-b5c8-49fe-8526-462cbe0745e7-tmp-dir\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971026    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-lib-modules\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971054    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971076    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhgc7\" (UniqueName: \"kubernetes.io/projected/4362c21e-df7b-4f10-a453-888270548674-kube-api-access-lhgc7\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971102    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-netd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971120    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-lib-modules\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971123    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-netns\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971170    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-cnibin\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971198    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971249    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-cnibin\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.971595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971290    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-multus-certs\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971321    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-var-lib-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971333    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971355    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtl4t\" (UniqueName: \"kubernetes.io/projected/ddf0b081-b5c8-49fe-8526-462cbe0745e7-kube-api-access-vtl4t\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971380    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-system-cni-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971418    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd03602-6816-48ab-a539-8d318057dc1e-iptables-alerter-script\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971442    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddf0b081-b5c8-49fe-8526-462cbe0745e7-hosts-file\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971444    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecf61016-171b-4475-b33b-2ff954b2dbfc-system-cni-dir\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971473    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-var-lib-kubelet\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971505    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-tuned\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971519    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-var-lib-kubelet\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971531    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-log-socket\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971564    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz47x\" (UniqueName: \"kubernetes.io/projected/ddd03602-6816-48ab-a539-8d318057dc1e-kube-api-access-bz47x\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971567    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ddf0b081-b5c8-49fe-8526-462cbe0745e7-hosts-file\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971592    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971618    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971679    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-registration-dir\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.972547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971717    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-etc-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971746    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971774    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-bin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971799    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5tpw\" (UniqueName: \"kubernetes.io/projected/b84478fc-d17c-488f-a247-a5481e281a26-kube-api-access-r5tpw\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971825    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971854    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971923    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-os-release\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.971972    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972034    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-host\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972067    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ddd03602-6816-48ab-a539-8d318057dc1e-iptables-alerter-script\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972081    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hml5q\" (UniqueName: \"kubernetes.io/projected/54edb804-d925-4d24-b532-2e0c2feca0bb-kube-api-access-hml5q\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972116    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-konnectivity-ca\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972168    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-host\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972233    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-env-overrides\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972281    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvhr\" (UniqueName: \"kubernetes.io/projected/c2721fa4-1f2a-4f54-9799-61163c9e7148-kube-api-access-cvvhr\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972312    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972341    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-conf-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973331 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972390    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-kubernetes\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972420    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972448    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysconfig\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972470    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972487    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-dbus\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972503    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-node-log\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972555    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-system-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972571    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-socket-dir-parent\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972589    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-systemd-units\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972605    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-script-lib\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972619    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-k8s-cni-cncf-io\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972635    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-multus\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972654    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pww68\" (UniqueName: \"kubernetes.io/projected/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kube-api-access-pww68\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972671    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-systemd\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972701    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-kubelet-config\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972701    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-konnectivity-ca\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972721    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-kubelet\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.973920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972737    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-config\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972744    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecf61016-171b-4475-b33b-2ff954b2dbfc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972824    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysconfig\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972851    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-sysctl-d\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972892    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-sys-fs\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.972910    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-cni-binary-copy\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.973063    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-kubernetes\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.973113    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-systemd\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.974479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.974292    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1e0f73e9-0f3b-4e9a-b734-786d7a6cadab-agent-certs\") pod \"konnectivity-agent-fb9fv\" (UID: \"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab\") " pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:13.975833 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.975810    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-tmp\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.978780 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.978752    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0e2839f-e46f-402e-a565-f32ce9451e5d-etc-tuned\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.981178 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.981149    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbrvc\" (UniqueName: \"kubernetes.io/projected/b0e2839f-e46f-402e-a565-f32ce9451e5d-kube-api-access-gbrvc\") pod \"tuned-plln2\" (UID: \"b0e2839f-e46f-402e-a565-f32ce9451e5d\") " pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:13.981273 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.981186    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvn2g\" (UniqueName: \"kubernetes.io/projected/ecf61016-171b-4475-b33b-2ff954b2dbfc-kube-api-access-cvn2g\") pod \"multus-additional-cni-plugins-9rsk2\" (UID: \"ecf61016-171b-4475-b33b-2ff954b2dbfc\") " pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:13.981712 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.981690    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtl4t\" (UniqueName: \"kubernetes.io/projected/ddf0b081-b5c8-49fe-8526-462cbe0745e7-kube-api-access-vtl4t\") pod \"node-resolver-h4zgv\" (UID: \"ddf0b081-b5c8-49fe-8526-462cbe0745e7\") " pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:13.982587 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.982561    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pww68\" (UniqueName: \"kubernetes.io/projected/5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5-kube-api-access-pww68\") pod \"aws-ebs-csi-driver-node-cl6xs\" (UID: \"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:13.982718 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.982697    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hml5q\" (UniqueName: \"kubernetes.io/projected/54edb804-d925-4d24-b532-2e0c2feca0bb-kube-api-access-hml5q\") pod \"node-ca-skdmt\" (UID: \"54edb804-d925-4d24-b532-2e0c2feca0bb\") " pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:13.983728 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:13.983703    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz47x\" (UniqueName: \"kubernetes.io/projected/ddd03602-6816-48ab-a539-8d318057dc1e-kube-api-access-bz47x\") pod \"iptables-alerter-lqxt8\" (UID: \"ddd03602-6816-48ab-a539-8d318057dc1e\") " pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:14.041918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.041865    2523 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 02:37:14.073330 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073281    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.073330 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073336    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-cnibin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073364    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-systemd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073432    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-systemd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073445    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-cnibin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.073450    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073472    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073498    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhgc7\" (UniqueName: \"kubernetes.io/projected/4362c21e-df7b-4f10-a453-888270548674-kube-api-access-lhgc7\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073516    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-netd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.073607    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:14.573517383 +0000 UTC m=+3.034908125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.073622    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:14.073643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073643    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-netns\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.073673    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:14.573658151 +0000 UTC m=+3.035048869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073695    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-netns\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073693    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-multus-certs\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073728    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-var-lib-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073740    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-netd\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073729    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-multus-certs\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073768    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-log-socket\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073772    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-var-lib-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073798    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073820    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-etc-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073817    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-log-socket\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073844    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073874    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-bin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073878    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-etc-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073883    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.074147 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073892    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5tpw\" (UniqueName: \"kubernetes.io/projected/b84478fc-d17c-488f-a247-a5481e281a26-kube-api-access-r5tpw\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073914    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073927    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-bin\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073933    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073959    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-os-release\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073993    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-env-overrides\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.073994    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-openvswitch\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074019    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074038    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvhr\" (UniqueName: \"kubernetes.io/projected/c2721fa4-1f2a-4f54-9799-61163c9e7148-kube-api-access-cvvhr\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074061    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-os-release\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074064    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074103    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-conf-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074128    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-dbus\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074134    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074188    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-conf-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074222    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-node-log\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074241    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-system-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074263    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-socket-dir-parent\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.075125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074292    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-systemd-units\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074316    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-script-lib\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074332    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-node-log\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074342    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-system-cni-dir\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074342    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-dbus\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074342    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-k8s-cni-cncf-io\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074367    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-multus-socket-dir-parent\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074380    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-systemd-units\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074393    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-multus\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074427    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-kubelet-config\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074430    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-run-k8s-cni-cncf-io\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074430    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-cni-multus\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074455    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-kubelet\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074477    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-kubelet-config\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074480    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-config\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074504    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-kubelet\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074505    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-cni-binary-copy\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074534    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-slash\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.076093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074557    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-netns\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074566    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-env-overrides\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074585    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-ovn\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074609    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-hostroot\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074625    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-slash\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074638    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-bin\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074664    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovn-node-metrics-cert\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074670    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-run-ovn\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074675    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-run-netns\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074689    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-kubelet\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074717    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-multus-daemon-config\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074715    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2721fa4-1f2a-4f54-9799-61163c9e7148-host-cni-bin\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074744    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-etc-kubernetes\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074782    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-etc-kubernetes\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074850    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-hostroot\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.074889    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b84478fc-d17c-488f-a247-a5481e281a26-host-var-lib-kubelet\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.075069    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-config\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.075069    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-cni-binary-copy\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.075292    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b84478fc-d17c-488f-a247-a5481e281a26-multus-daemon-config\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.077917 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.075392    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovnkube-script-lib\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.077917 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.077609    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2721fa4-1f2a-4f54-9799-61163c9e7148-ovn-node-metrics-cert\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.082140 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.080691    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:14.082140 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.080717    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:14.082140 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.080736    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:14.082140 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.080817    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:14.580798454 +0000 UTC m=+3.042189202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:14.083796 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.083765    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhgc7\" (UniqueName: \"kubernetes.io/projected/4362c21e-df7b-4f10-a453-888270548674-kube-api-access-lhgc7\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:14.084752 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.084687    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvhr\" (UniqueName: \"kubernetes.io/projected/c2721fa4-1f2a-4f54-9799-61163c9e7148-kube-api-access-cvvhr\") pod \"ovnkube-node-xcmfl\" (UID: \"c2721fa4-1f2a-4f54-9799-61163c9e7148\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.084856 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.084777    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5tpw\" (UniqueName: \"kubernetes.io/projected/b84478fc-d17c-488f-a247-a5481e281a26-kube-api-access-r5tpw\") pod \"multus-2fvgl\" (UID: \"b84478fc-d17c-488f-a247-a5481e281a26\") " pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.162593 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.162549    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9rsk2"
Jul 22 02:37:14.174066 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.174032    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lqxt8"
Jul 22 02:37:14.193479 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.193442    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs"
Jul 22 02:37:14.198936 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.198903    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-plln2"
Jul 22 02:37:14.207240 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.207207    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h4zgv"
Jul 22 02:37:14.216351 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.216320    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-skdmt"
Jul 22 02:37:14.227426 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.227394    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:14.235868 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.235838    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:14.243238 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.243213    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fvgl"
Jul 22 02:37:14.579206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.579151    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:14.579206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.579215    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:14.579433 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.579343    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:14.579433 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.579343    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:14.579433 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.579411    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:15.579392143 +0000 UTC m=+4.040782862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:14.579433 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.579432    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:15.579421804 +0000 UTC m=+4.040812521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:14.679859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.679763    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:14.680026 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.679944    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:14.680026 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.679967    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:14.680026 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.679979    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:14.680227 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.680054    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:15.680033218 +0000 UTC m=+4.141423936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:14.909862 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.909811    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:32:14 +0000 UTC" deadline="2028-01-07 11:04:21.042354842 +0000 UTC"
Jul 22 02:37:14.909862 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.909856    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12824h27m6.13250399s"
Jul 22 02:37:14.951298 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:14.951205    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:14.951483 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:14.951344    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:15.226429 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:15.226380    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e2839f_e46f_402e_a565_f32ce9451e5d.slice/crio-db6c724efb0e4f25a5fa5f129e40400bddf577d87d4e0a2417afb7f390f1d8e2 WatchSource:0}: Error finding container db6c724efb0e4f25a5fa5f129e40400bddf577d87d4e0a2417afb7f390f1d8e2: Status 404 returned error can't find the container with id db6c724efb0e4f25a5fa5f129e40400bddf577d87d4e0a2417afb7f390f1d8e2
Jul 22 02:37:15.230594 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:15.229726    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54edb804_d925_4d24_b532_2e0c2feca0bb.slice/crio-69e34f71858ed9e324d7e275213c5c0cb5f4d9dd65534a7aa25f3e5a36948990 WatchSource:0}: Error finding container 69e34f71858ed9e324d7e275213c5c0cb5f4d9dd65534a7aa25f3e5a36948990: Status 404 returned error can't find the container with id 69e34f71858ed9e324d7e275213c5c0cb5f4d9dd65534a7aa25f3e5a36948990
Jul 22 02:37:15.232851 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:15.232378    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf0b081_b5c8_49fe_8526_462cbe0745e7.slice/crio-5baf52b8b503ef4ab79e8fa74d6429567968e9767c8a0c8f976cf0ce94ad15df WatchSource:0}: Error finding container 5baf52b8b503ef4ab79e8fa74d6429567968e9767c8a0c8f976cf0ce94ad15df: Status 404 returned error can't find the container with id 5baf52b8b503ef4ab79e8fa74d6429567968e9767c8a0c8f976cf0ce94ad15df
Jul 22 02:37:15.235725 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:15.235672    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf61016_171b_4475_b33b_2ff954b2dbfc.slice/crio-c5047513c1b32aa357b935bc3c6cbb93bc82e4e588e214184cbcb2f090ecbac7 WatchSource:0}: Error finding container c5047513c1b32aa357b935bc3c6cbb93bc82e4e588e214184cbcb2f090ecbac7: Status 404 returned error can't find the container with id c5047513c1b32aa357b935bc3c6cbb93bc82e4e588e214184cbcb2f090ecbac7
Jul 22 02:37:15.245417 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:15.245067    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0f73e9_0f3b_4e9a_b734_786d7a6cadab.slice/crio-bfac19a2358662539ab09ee48ea00fc25d8f5cf1245239d0cc6136db6a5c00ff WatchSource:0}: Error finding container bfac19a2358662539ab09ee48ea00fc25d8f5cf1245239d0cc6136db6a5c00ff: Status 404 returned error can't find the container with id bfac19a2358662539ab09ee48ea00fc25d8f5cf1245239d0cc6136db6a5c00ff
Jul 22 02:37:15.589581 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.589335    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:15.589839 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.589613    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:15.589839 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.589504    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:15.589839 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.589720    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:15.589839 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.589743    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:17.589716712 +0000 UTC m=+6.051107439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:15.589839 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.589777    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:17.589760648 +0000 UTC m=+6.051151365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:15.690574 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.690529    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:15.690736 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.690699    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:15.690736 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.690716    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:15.690736 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.690726    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:15.690850 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.690784    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:17.690766259 +0000 UTC m=+6.152156976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:15.910154 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.910011    2523 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 02:32:14 +0000 UTC" deadline="2028-01-07 09:12:00.918058856 +0000 UTC"
Jul 22 02:37:15.910154 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.910067    2523 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12822h34m45.007996389s"
Jul 22 02:37:15.953005 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.952451    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:15.953005 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.952598    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:15.953496 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.953346    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:15.953496 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:15.953455    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:15.965738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.965687    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs" event={"ID":"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5","Type":"ContainerStarted","Data":"0b5c1b9569fded605b64f48ff17fd055c3b04e0ce7171a83c4a7086aabb12fc6"}
Jul 22 02:37:15.971247 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.970811    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lqxt8" event={"ID":"ddd03602-6816-48ab-a539-8d318057dc1e","Type":"ContainerStarted","Data":"d87948785942a7cd4bf705f2911b2265b5d48a00e30fb2196e216c95ccdea8ca"}
Jul 22 02:37:15.972949 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.972909    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerStarted","Data":"c5047513c1b32aa357b935bc3c6cbb93bc82e4e588e214184cbcb2f090ecbac7"}
Jul 22 02:37:15.975046 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.975006    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4zgv" event={"ID":"ddf0b081-b5c8-49fe-8526-462cbe0745e7","Type":"ContainerStarted","Data":"5baf52b8b503ef4ab79e8fa74d6429567968e9767c8a0c8f976cf0ce94ad15df"}
Jul 22 02:37:15.976875 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.976794    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-plln2" event={"ID":"b0e2839f-e46f-402e-a565-f32ce9451e5d","Type":"ContainerStarted","Data":"db6c724efb0e4f25a5fa5f129e40400bddf577d87d4e0a2417afb7f390f1d8e2"}
Jul 22 02:37:15.981627 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.980379    2523 generic.go:356] "Generic (PLEG): container finished" podID="887395d92c7bd4af2b6585b10bd30b12" containerID="a9c038046f5e17ad6c28e7e3e90cf187b8e7432f424273cf69427cb75d372ac8" exitCode=0
Jul 22 02:37:15.981627 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.980475    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"887395d92c7bd4af2b6585b10bd30b12","Type":"ContainerDied","Data":"a9c038046f5e17ad6c28e7e3e90cf187b8e7432f424273cf69427cb75d372ac8"}
Jul 22 02:37:15.990415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.990363    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"50137f1f6e27920ae470065552140074f4e02e30e2863aae040da3d9229c6ca9"}
Jul 22 02:37:15.995667 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.995629    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fvgl" event={"ID":"b84478fc-d17c-488f-a247-a5481e281a26","Type":"ContainerStarted","Data":"a421a24fb4a9cddb8890050932da0c1e6bd105257f45fe4fbd7b395dd5035fa3"}
Jul 22 02:37:15.998116 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:15.998021    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skdmt" event={"ID":"54edb804-d925-4d24-b532-2e0c2feca0bb","Type":"ContainerStarted","Data":"69e34f71858ed9e324d7e275213c5c0cb5f4d9dd65534a7aa25f3e5a36948990"}
Jul 22 02:37:16.004503 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:16.004396    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" event={"ID":"d0229793d07a73dce520e9f7cfb97506","Type":"ContainerStarted","Data":"56906b2eeff588cefe705d9a75dcd2700927f124337b5ed58edbce5a4b793f02"}
Jul 22 02:37:16.011585 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:16.011501    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fb9fv" event={"ID":"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab","Type":"ContainerStarted","Data":"bfac19a2358662539ab09ee48ea00fc25d8f5cf1245239d0cc6136db6a5c00ff"}
Jul 22 02:37:16.025259 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:16.025162    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-119.ec2.internal" podStartSLOduration=3.025134124 podStartE2EDuration="3.025134124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:16.024622672 +0000 UTC m=+4.486013413" watchObservedRunningTime="2026-07-22 02:37:16.025134124 +0000 UTC m=+4.486524844"
Jul 22 02:37:16.951032 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:16.950988    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:16.951569 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:16.951128    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:17.032229 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.031997    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" event={"ID":"887395d92c7bd4af2b6585b10bd30b12","Type":"ContainerStarted","Data":"3fbb247de6f2c472ee6a39d0616d667ef675bfabb1910d07dabcbb549084ff4d"}
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.607631    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.607702    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.607895    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.607967    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.607945385 +0000 UTC m=+10.069336103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.608430    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:17.608539 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.608489    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.608471047 +0000 UTC m=+10.069861763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:17.708581 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.708539    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:17.708764 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.708716    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:17.708764 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.708738    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:17.708764 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.708752    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:17.708938 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.708823    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:21.708803109 +0000 UTC m=+10.170193828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:17.951672 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.951273    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:17.951672 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.951417    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:17.951672 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:17.951460    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:17.951672 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:17.951582    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:18.950458 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:18.950422    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:18.950663 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:18.950579    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:19.953254 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:19.953220    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:19.953756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:19.953359    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:19.953756 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:19.953659    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:19.953756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:19.953721    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:20.951124 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:20.951089    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:20.951340 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:20.951246    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:21.641284    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:21.641350    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.641462    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.641520    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.641530    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:29.64151503 +0000 UTC m=+18.102905750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:21.641608 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.641575    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:29.641559129 +0000 UTC m=+18.102949845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:21.742234 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:21.742178    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:21.742449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.742349    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:21.742449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.742368    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:21.742449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.742381    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:21.742449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.742430    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:29.742416216 +0000 UTC m=+18.203806945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:21.951305 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:21.951224    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:21.951431 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:21.951224    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:21.951431 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.951328    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:21.951431 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:21.951398    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:22.951545 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:22.950965    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:22.951545 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:22.951117    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:23.950432 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:23.950395    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:23.950617 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:23.950546    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:23.950985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:23.950959    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:23.951088 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:23.951064    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:24.951294 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:24.951254    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:24.951675 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:24.951394    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:25.950855 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:25.950813    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:25.951033 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:25.950870    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:25.951033 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:25.950957    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:25.951119 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:25.951087    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:26.950985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:26.950947    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:26.951463 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:26.951099    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:27.950923 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:27.950885    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:27.950923 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:27.950925    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:27.951474 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:27.951015    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:27.951474 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:27.951132    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:28.950524 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:28.950484    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:28.950733 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:28.950609    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:29.704298 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:29.704259    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:29.704298 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:29.704306    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:29.704756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.704406    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:29.704756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.704427    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:29.704756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.704460    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:45.704445116 +0000 UTC m=+34.165835830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:29.704756 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.704500    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:37:45.70448013 +0000 UTC m=+34.165870853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:29.804721 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:29.804680    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:29.804917 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.804846    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:29.804917 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.804872    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:29.804917 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.804884    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:29.805041 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.804940    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:37:45.804924749 +0000 UTC m=+34.266315464 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:29.951220 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:29.951115    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:29.951220 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:29.951185    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:29.951445 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.951255    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:29.951445 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:29.951388    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:30.951188 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:30.951136    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:30.951655 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:30.951264    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:31.951259 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:31.951217    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:31.951652 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:31.951391    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:31.951652 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:31.951428    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:31.951652 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:31.951506    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:32.951251 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:32.951214    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:32.951421 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:32.951333    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:33.951020 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:33.950997    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:33.951168 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:33.951092    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:33.951168 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:33.951118    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:33.951277 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:33.951175    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:34.951369 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:34.951024    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:34.952055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:34.951528    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:35.079391 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079310    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:37:35.079711 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079681    2523 generic.go:356] "Generic (PLEG): container finished" podID="c2721fa4-1f2a-4f54-9799-61163c9e7148" containerID="1906dd49a36a54210f94fe1aef289c0a8704a5cb4109efcf1c651523a5c0312e" exitCode=1
Jul 22 02:37:35.079800 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079759    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"350a98f4d336675e873d607693aca5085007ae569cb2346212ec614cd34d2281"}
Jul 22 02:37:35.079861 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079848    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"e26f25c15de80b8a9c1a30a61ab8dcf6d2e41d10585e86f9c720d45ba2cb12b4"}
Jul 22 02:37:35.079900 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079885    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"2bcee796468fca482b04689e2ba9ff3f28b2641e75e96c5f49235135d3c23e52"}
Jul 22 02:37:35.079934 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079925    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"2525844ed66dff4a5ea03322b8b4b1e0fae4d416ea439ae75692f2de1b00e5d1"}
Jul 22 02:37:35.079973 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.079963    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerDied","Data":"1906dd49a36a54210f94fe1aef289c0a8704a5cb4109efcf1c651523a5c0312e"}
Jul 22 02:37:35.080021 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.080009    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"e1596b92d21b91ed3ffab5efe6c8fd880439450d57cd87bf0e80594d2120310b"}
Jul 22 02:37:35.081513 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.081485    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fvgl" event={"ID":"b84478fc-d17c-488f-a247-a5481e281a26","Type":"ContainerStarted","Data":"cdeea650fb7f18131f11a410e2572cd06a96a511afc5f1f891d31bb654022c2f"}
Jul 22 02:37:35.083340 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.083314    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-skdmt" event={"ID":"54edb804-d925-4d24-b532-2e0c2feca0bb","Type":"ContainerStarted","Data":"e9a1725f40c36a1758a419237c1c99549f4446017a6bd1c38b4388faf996ffa1"}
Jul 22 02:37:35.084904 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.084879    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fb9fv" event={"ID":"1e0f73e9-0f3b-4e9a-b734-786d7a6cadab","Type":"ContainerStarted","Data":"f5f950c7c19c453665bd4c664ef165f44224f8588914de2204b1275d0f33e16b"}
Jul 22 02:37:35.086510 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.086484    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs" event={"ID":"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5","Type":"ContainerStarted","Data":"350f04012faca87cdfe9e7ba5549e44add9c0b61136a31b0b651824bae37299e"}
Jul 22 02:37:35.088189 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.088165    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="3b9ecb58883a21f65138372c6a5ed521ba40c7c739c4eb3d948afa8468d9c464" exitCode=0
Jul 22 02:37:35.088299 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.088253    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"3b9ecb58883a21f65138372c6a5ed521ba40c7c739c4eb3d948afa8468d9c464"}
Jul 22 02:37:35.090009 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.089982    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h4zgv" event={"ID":"ddf0b081-b5c8-49fe-8526-462cbe0745e7","Type":"ContainerStarted","Data":"b1fff3d226d72d93a0213727f49f1c242d8a381d3f5df1842d044f5dbed12ebb"}
Jul 22 02:37:35.091745 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.091725    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-plln2" event={"ID":"b0e2839f-e46f-402e-a565-f32ce9451e5d","Type":"ContainerStarted","Data":"deab4d9f795ad50165d28978ae13923877b0029267dc68fb8e8540a4d2b8fb00"}
Jul 22 02:37:35.105420 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.105372    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-119.ec2.internal" podStartSLOduration=22.105356416 podStartE2EDuration="22.105356416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:17.055631294 +0000 UTC m=+5.517022033" watchObservedRunningTime="2026-07-22 02:37:35.105356416 +0000 UTC m=+23.566747153"
Jul 22 02:37:35.105591 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.105446    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2fvgl" podStartSLOduration=4.34615814 podStartE2EDuration="23.105440748s" totalImagesPullingTime="18.759282608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:35.104742805 +0000 UTC m=+23.566133543" watchObservedRunningTime="2026-07-22 02:37:35.105440748 +0000 UTC m=+23.566831485"
Jul 22 02:37:35.129616 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.129565    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-plln2" podStartSLOduration=4.410938269 podStartE2EDuration="23.129547951s" totalImagesPullingTime="18.718609682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:35.129518511 +0000 UTC m=+23.590909247" watchObservedRunningTime="2026-07-22 02:37:35.129547951 +0000 UTC m=+23.590938687"
Jul 22 02:37:35.151694 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.151649    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fb9fv" podStartSLOduration=4.470781727 podStartE2EDuration="23.151633149s" totalImagesPullingTime="18.680851422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:35.151314382 +0000 UTC m=+23.612705129" watchObservedRunningTime="2026-07-22 02:37:35.151633149 +0000 UTC m=+23.613023881"
Jul 22 02:37:35.204759 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.204700    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h4zgv" podStartSLOduration=4.486666693 podStartE2EDuration="23.204683938s" totalImagesPullingTime="18.718017245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:35.204634747 +0000 UTC m=+23.666025475" watchObservedRunningTime="2026-07-22 02:37:35.204683938 +0000 UTC m=+23.666074670"
Jul 22 02:37:35.502855 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.502830    2523 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 02:37:35.930654 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.930551    2523 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T02:37:35.502850291Z","UUID":"a6e722c9-3c70-4681-aa06-9e3039a88847","Handler":null,"Name":"","Endpoint":""}
Jul 22 02:37:35.931948 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.931930    2523 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 02:37:35.932071 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.931972    2523 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 02:37:35.950615 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.950576    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:35.950783 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:35.950578    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:35.950783 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:35.950689    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:35.950783 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:35.950762    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:36.097431 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:36.097163    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs" event={"ID":"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5","Type":"ContainerStarted","Data":"125ff19f0c9d390f88bbde937f898e9d22ee7986896ea63dfd9192823dfddcca"}
Jul 22 02:37:36.099802 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:36.099773    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lqxt8" event={"ID":"ddd03602-6816-48ab-a539-8d318057dc1e","Type":"ContainerStarted","Data":"23bdf623f4623ddc2bde0ee9d0c0dc98434496baebf2458140594a4a9a0e7651"}
Jul 22 02:37:36.116293 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:36.116241    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lqxt8" podStartSLOduration=5.403907658 podStartE2EDuration="24.116224337s" totalImagesPullingTime="18.712316679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:36.115924792 +0000 UTC m=+24.577315535" watchObservedRunningTime="2026-07-22 02:37:36.116224337 +0000 UTC m=+24.577615073"
Jul 22 02:37:36.116666 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:36.116630    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-skdmt" podStartSLOduration=5.401495896 podStartE2EDuration="24.116620689s" totalImagesPullingTime="18.715124793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:35.250616848 +0000 UTC m=+23.712007585" watchObservedRunningTime="2026-07-22 02:37:36.116620689 +0000 UTC m=+24.578011425"
Jul 22 02:37:36.950511 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:36.950318    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:36.950658 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:36.950613    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:37.104964 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:37.104936    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:37:37.105422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:37.105394    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"1fd9f9bcbc3ed21095678ae7bd6315fe6d7c1b48f90f6246114c6e6a83cd4452"}
Jul 22 02:37:37.107874 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:37.107841    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs" event={"ID":"5f8d70ce-29aa-4b7c-a92d-2b4cda720bc5","Type":"ContainerStarted","Data":"86c892d4f716842a90581b3154fc12b834e81ea92dcd39ed23c648781c1ee6c2"}
Jul 22 02:37:37.950849 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:37.950810    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:37.951005 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:37.950947    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:37.951069 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:37.950997    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:37.951128 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:37.951106    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:38.951130 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:38.951092    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:38.951720 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:38.951242    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:39.878117 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:39.877945    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:39.878578 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:39.878552    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:39.894567 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:39.894518    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cl6xs" podStartSLOduration=7.18516577 podStartE2EDuration="27.894502724s" totalImagesPullingTime="20.709336954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:37.133880337 +0000 UTC m=+25.595271075" watchObservedRunningTime="2026-07-22 02:37:39.894502724 +0000 UTC m=+28.355893456"
Jul 22 02:37:39.950953 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:39.950915    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:39.951190 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:39.950918    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:39.951190 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:39.951027    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:39.951190 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:39.951119    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:40.118127 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.118039    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="2448828b84d16bb62f459873ca9dc9238eede296bb1836e74d9d573a2446d7bd" exitCode=0
Jul 22 02:37:40.118315 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.118127    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"2448828b84d16bb62f459873ca9dc9238eede296bb1836e74d9d573a2446d7bd"}
Jul 22 02:37:40.123969 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.123949    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:37:40.124457 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.124429    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"19269a82da6c57baa701708540db134bccd795004cfde1d5cb3109c65d5be448"}
Jul 22 02:37:40.124728 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.124706    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:40.124933 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.124914    2523 scope.go:117] "RemoveContainer" containerID="1906dd49a36a54210f94fe1aef289c0a8704a5cb4109efcf1c651523a5c0312e"
Jul 22 02:37:40.125056 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.125040    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fb9fv"
Jul 22 02:37:40.950929 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:40.950893    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:40.951125 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:40.951009    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:41.131200 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.131168    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:37:41.131648 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.131626    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" event={"ID":"c2721fa4-1f2a-4f54-9799-61163c9e7148","Type":"ContainerStarted","Data":"4e7fe7f1c7e96fb9e3d2f90a4f96fa33a4e225e3ee18cf519b518d2e69aca773"}
Jul 22 02:37:41.131851 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.131825    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:41.131938 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.131890    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:41.131938 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.131935    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:41.148293 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.148267    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:41.148510 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.148492    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:37:41.183085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.183034    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl" podStartSLOduration=10.160251746 podStartE2EDuration="29.183019688s" totalImagesPullingTime="19.022767942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:41.172947119 +0000 UTC m=+29.634337914" watchObservedRunningTime="2026-07-22 02:37:41.183019688 +0000 UTC m=+29.644410424"
Jul 22 02:37:41.475825 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.475789    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxj8k"]
Jul 22 02:37:41.476045 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.475919    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:41.476045 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:41.476014    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:41.478606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.478570    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkdzf"]
Jul 22 02:37:41.478727 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.478681    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:41.478783 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:41.478762    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:41.481487 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.481460    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzph8"]
Jul 22 02:37:41.481599 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:41.481586    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:41.481710 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:41.481689    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:42.135662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:42.135628    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="176324bbc84e523ef8ba520653406bef2e2900f016ffba508e840dd1fb06caa0" exitCode=0
Jul 22 02:37:42.136093 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:42.135726    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"176324bbc84e523ef8ba520653406bef2e2900f016ffba508e840dd1fb06caa0"}
Jul 22 02:37:42.950528 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:42.950470    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:42.950528 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:42.950512    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:42.950528 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:42.950515    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:42.950829 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:42.950598    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:42.950829 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:42.950664    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:42.950829 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:42.950738    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:44.144554 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:44.144380    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="fb4fe5c7f65ab16765ada0f49f33bb6b15f97c6c77c2fbea325e7d7a3aa1c5e6" exitCode=0
Jul 22 02:37:44.145080 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:44.144463    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"fb4fe5c7f65ab16765ada0f49f33bb6b15f97c6c77c2fbea325e7d7a3aa1c5e6"}
Jul 22 02:37:44.951041 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:44.951003    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:44.951041 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:44.951031    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:44.951274 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:44.951003    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:44.951274 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:44.951126    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bzph8" podUID="00d8e4f7-c70b-44ba-8391-4d9d8e86570a"
Jul 22 02:37:44.951274 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:44.951268    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxj8k" podUID="7b54765c-d92b-43f8-9c98-8c83e4a06d8c"
Jul 22 02:37:44.951388 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:44.951326    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkdzf" podUID="4362c21e-df7b-4f10-a453-888270548674"
Jul 22 02:37:45.730752 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:45.730664    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:45.731233 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:45.730781    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:45.731233 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.730809    2523 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:45.731233 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.730884    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret podName:7b54765c-d92b-43f8-9c98-8c83e4a06d8c nodeName:}" failed. No retries permitted until 2026-07-22 02:38:17.730863557 +0000 UTC m=+66.192254286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret") pod "global-pull-secret-syncer-fxj8k" (UID: "7b54765c-d92b-43f8-9c98-8c83e4a06d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 22 02:37:45.731233 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.730955    2523 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:45.731233 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.731021    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs podName:4362c21e-df7b-4f10-a453-888270548674 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:17.731003106 +0000 UTC m=+66.192393825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs") pod "network-metrics-daemon-jkdzf" (UID: "4362c21e-df7b-4f10-a453-888270548674") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 02:37:45.831384 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:45.831346    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:45.831554 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.831518    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 02:37:45.831554 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.831545    2523 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 02:37:45.831655 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.831563    2523 projected.go:196] Error preparing data for projected volume kube-api-access-x2tsc for pod openshift-network-diagnostics/network-check-target-bzph8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:45.831655 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:45.831646    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc podName:00d8e4f7-c70b-44ba-8391-4d9d8e86570a nodeName:}" failed. No retries permitted until 2026-07-22 02:38:17.831624839 +0000 UTC m=+66.293015559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2tsc" (UniqueName: "kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc") pod "network-check-target-bzph8" (UID: "00d8e4f7-c70b-44ba-8391-4d9d8e86570a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 02:37:46.903022 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.902941    2523 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-119.ec2.internal" event="NodeReady"
Jul 22 02:37:46.903590 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.903123    2523 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 02:37:46.946341 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.946301    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:37:46.951542 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.951502    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:37:46.951542 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.951518    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:37:46.951727 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.951526    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:46.951727 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.951528    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:37:46.956441 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.956415    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24b6\""
Jul 22 02:37:46.956724 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.956705    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48l7s\""
Jul 22 02:37:46.956801 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.956740    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:37:46.957023 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957001    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:37:46.957172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957026    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 02:37:46.957172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957004    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 02:37:46.957172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957054    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 02:37:46.957172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957055    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 02:37:46.957675 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957657    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 02:37:46.957921 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.957905    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-swntg\""
Jul 22 02:37:46.964017 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.963990    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 02:37:46.964157 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.964056    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"]
Jul 22 02:37:46.969919 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.969896    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:46.972906 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.972880    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:37:46.974338 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.974307    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"]
Jul 22 02:37:46.976725 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.976645    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 02:37:46.976839 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.976770    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:46.976945 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.976927    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:46.977204 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.976935    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-qd6qm\""
Jul 22 02:37:46.982058 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.982038    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 02:37:46.982419 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.982398    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:46.985643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.985623    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"]
Jul 22 02:37:46.985720 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.985698    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 02:37:46.986644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.986623    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 02:37:46.986754 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.986695    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qjx7c\""
Jul 22 02:37:46.986826 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.986628    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 22 02:37:46.986910 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.986875    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 22 02:37:46.988250 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.988225    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tzw5k"]
Jul 22 02:37:46.992747 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.992722    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"]
Jul 22 02:37:46.992881 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.992860    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:46.996161 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.996124    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"]
Jul 22 02:37:46.996859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.996840    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:46.999365 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.999086    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 02:37:46.999365 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.999259    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:46.999523 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.999507    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 02:37:46.999712 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:46.999696    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 02:37:47.000053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000021    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5hsdz\""
Jul 22 02:37:47.000053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000043    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 22 02:37:47.000323 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000060    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.000630 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000567    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2vzsl\""
Jul 22 02:37:47.000630 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000621    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.000852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000832    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"]
Jul 22 02:37:47.000956 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.000944    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"
Jul 22 02:37:47.003621 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.003602    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"]
Jul 22 02:37:47.006189 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.006128    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.006446 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.006428    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xsj7h\""
Jul 22 02:37:47.006534 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.006477    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:47.009351 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.009320    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 02:37:47.013962 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.013940    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tzw5k"]
Jul 22 02:37:47.015741 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.015720    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f8fd84546-rmjqk"]
Jul 22 02:37:47.019002 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.018984    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"]
Jul 22 02:37:47.019346 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.019325    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.022296 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.022277    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"]
Jul 22 02:37:47.022470 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.022451    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.023549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.023524    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b7hbl\""
Jul 22 02:37:47.023657 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.023526    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 02:37:47.023657 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.023625    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 02:37:47.023786 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.023742    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.023786 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.023781    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 02:37:47.024048 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.024011    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 02:37:47.024265 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.024232    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 02:37:47.028725 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.028702    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fhvjp"]
Jul 22 02:37:47.028873 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.028856    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"
Jul 22 02:37:47.030101 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.030040    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 02:37:47.030101 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.030046    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:47.030101 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.030087    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.030779 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.030752    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fv54h\""
Jul 22 02:37:47.030894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.030874    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 02:37:47.031567 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.031546    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7llcp\""
Jul 22 02:37:47.040116 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040089    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040308 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040131    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040308 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040206    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040308 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040262    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhvc9\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040323    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040362    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040413    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.040738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.040456    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.051184 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.051162    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6bqkn"]
Jul 22 02:37:47.051288 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.051266    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.062308 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.062280    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 02:37:47.062473 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.062294    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 02:37:47.062473 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.062354    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7k6rz\""
Jul 22 02:37:47.071166 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.071127    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"]
Jul 22 02:37:47.071366 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.071347    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-959ds"]
Jul 22 02:37:47.071366 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.071268    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.074797 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.074772    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 02:37:47.074948 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.074773    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gq2kr\""
Jul 22 02:37:47.075955 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.075931    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.076050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.076002    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 02:37:47.095180 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095126    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"]
Jul 22 02:37:47.095350 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095262    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.095350 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095278    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"]
Jul 22 02:37:47.095350 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095309    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhvjp"]
Jul 22 02:37:47.095350 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095348    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8fd84546-rmjqk"]
Jul 22 02:37:47.095745 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095726    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-959ds"]
Jul 22 02:37:47.095854 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.095773    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bqkn"]
Jul 22 02:37:47.100260 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.100233    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sqsdm\""
Jul 22 02:37:47.100396 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.100264    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 02:37:47.101772 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.101753    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:37:47.101887 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.101776    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 02:37:47.102234 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.102215    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 02:37:47.107347 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.107325    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 02:37:47.141291 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141257    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2bffc8-82ca-45d0-bc1b-e976919cf59a-config\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.141490 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141311    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tr95\" (UniqueName: \"kubernetes.io/projected/203c8baf-e3f7-4837-af89-6de37a159dc7-kube-api-access-6tr95\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.141490 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141354    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-service-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.141490 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141378    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhvc9\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.141490 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141398    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxcgs\" (UniqueName: \"kubernetes.io/projected/66fab76f-eea7-4ece-9087-686594e9c0d1-kube-api-access-lxcgs\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.141490 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141424    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.141724 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141578    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.141724 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141635    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.141724 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141688    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4fcr\" (UniqueName: \"kubernetes.io/projected/b1a60811-090e-48aa-8abc-3572429356b5-kube-api-access-m4fcr\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.141885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141816    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/203c8baf-e3f7-4837-af89-6de37a159dc7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.141885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141868    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/807688ad-af8a-43a7-b3ec-3334d9aa5eea-config-volume\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.141885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141880    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.142015 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141918    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807688ad-af8a-43a7-b3ec-3334d9aa5eea-tmp-dir\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.142015 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141951    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.142015 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.141967    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvmsf\" (UniqueName: \"kubernetes.io/projected/af2bffc8-82ca-45d0-bc1b-e976919cf59a-kube-api-access-mvmsf\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.142125 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142005    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69bv\" (UniqueName: \"kubernetes.io/projected/04e3d544-bbf5-42ba-aac7-3a222e1df0fb-kube-api-access-c69bv\") pod \"volume-data-source-validator-78cf4c6f6-h66vm\" (UID: \"04e3d544-bbf5-42ba-aac7-3a222e1df0fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"
Jul 22 02:37:47.142253 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142233    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.142466 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142446    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-snapshots\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142474    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4908d57-875b-463c-8120-03ba5e42a17a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142505    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142521    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-stats-auth\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.142452    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.142556    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:37:47.142560 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142538    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp9kt\" (UniqueName: \"kubernetes.io/projected/807688ad-af8a-43a7-b3ec-3334d9aa5eea-kube-api-access-bp9kt\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.142628    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.642613108 +0000 UTC m=+36.104003824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142679    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142708    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmh8g\" (UniqueName: \"kubernetes.io/projected/1637501b-9e4e-4e8b-9f1a-59066184a53e-kube-api-access-rmh8g\") pod \"network-check-source-7bc5b6bf85-gzdtn\" (UID: \"1637501b-9e4e-4e8b-9f1a-59066184a53e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142733    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4908d57-875b-463c-8120-03ba5e42a17a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142756    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.142823 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142783    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.143053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142870    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cvsp\" (UniqueName: \"kubernetes.io/projected/c4908d57-875b-463c-8120-03ba5e42a17a-kube-api-access-8cvsp\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.143053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142912    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.143053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142937    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af2bffc8-82ca-45d0-bc1b-e976919cf59a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.143053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.142990    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.143053 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143028    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143074    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143104    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-tmp\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143129    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a60811-090e-48aa-8abc-3572429356b5-serving-cert\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143176    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-default-certificate\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143237    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.143348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143263    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg2g7\" (UniqueName: \"kubernetes.io/projected/23fae3d4-4606-4d8a-beff-6969e8742139-kube-api-access-wg2g7\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.143606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.143472    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.147712 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.147675    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.147712 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.147701    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.158714 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.158645    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.158850 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.158714    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhvc9\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.243718 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243682    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.243718 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243725    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243749    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4fcr\" (UniqueName: \"kubernetes.io/projected/b1a60811-090e-48aa-8abc-3572429356b5-kube-api-access-m4fcr\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243795    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/203c8baf-e3f7-4837-af89-6de37a159dc7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243816    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/807688ad-af8a-43a7-b3ec-3334d9aa5eea-config-volume\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243835    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807688ad-af8a-43a7-b3ec-3334d9aa5eea-tmp-dir\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243905    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvmsf\" (UniqueName: \"kubernetes.io/projected/af2bffc8-82ca-45d0-bc1b-e976919cf59a-kube-api-access-mvmsf\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243928    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69bv\" (UniqueName: \"kubernetes.io/projected/04e3d544-bbf5-42ba-aac7-3a222e1df0fb-kube-api-access-c69bv\") pod \"volume-data-source-validator-78cf4c6f6-h66vm\" (UID: \"04e3d544-bbf5-42ba-aac7-3a222e1df0fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"
Jul 22 02:37:47.243975 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243967    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-snapshots\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.243993    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-serving-cert\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244023    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4908d57-875b-463c-8120-03ba5e42a17a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244052    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244077    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-stats-auth\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244100    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp9kt\" (UniqueName: \"kubernetes.io/projected/807688ad-af8a-43a7-b3ec-3334d9aa5eea-kube-api-access-bp9kt\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244129    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-config\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244177    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-trusted-ca\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244206    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244234    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmh8g\" (UniqueName: \"kubernetes.io/projected/1637501b-9e4e-4e8b-9f1a-59066184a53e-kube-api-access-rmh8g\") pod \"network-check-source-7bc5b6bf85-gzdtn\" (UID: \"1637501b-9e4e-4e8b-9f1a-59066184a53e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244262    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4908d57-875b-463c-8120-03ba5e42a17a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244287    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f97af3-4226-44b8-bb9e-15433e2d248e-cert\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244311    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.244339 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244342    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cvsp\" (UniqueName: \"kubernetes.io/projected/c4908d57-875b-463c-8120-03ba5e42a17a-kube-api-access-8cvsp\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244369    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af2bffc8-82ca-45d0-bc1b-e976919cf59a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244411    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-tmp\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244435    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqmw\" (UniqueName: \"kubernetes.io/projected/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-kube-api-access-nhqmw\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244460    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a60811-090e-48aa-8abc-3572429356b5-serving-cert\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244484    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-default-certificate\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244537    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244564    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg2g7\" (UniqueName: \"kubernetes.io/projected/23fae3d4-4606-4d8a-beff-6969e8742139-kube-api-access-wg2g7\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244594    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92rpb\" (UniqueName: \"kubernetes.io/projected/62f97af3-4226-44b8-bb9e-15433e2d248e-kube-api-access-92rpb\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244627    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2bffc8-82ca-45d0-bc1b-e976919cf59a-config\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244653    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tr95\" (UniqueName: \"kubernetes.io/projected/203c8baf-e3f7-4837-af89-6de37a159dc7-kube-api-access-6tr95\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244693    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-service-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.244901 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.244725    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxcgs\" (UniqueName: \"kubernetes.io/projected/66fab76f-eea7-4ece-9087-686594e9c0d1-kube-api-access-lxcgs\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.245449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.244902    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:37:47.245449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.245000    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.744950373 +0000 UTC m=+36.206341093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:37:47.245449 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.245042    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.245449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.245363    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:47.245449 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.245423    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.745406992 +0000 UTC m=+36.206797721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:47.246128 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.246098    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-snapshots\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.246515 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.246489    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1a60811-090e-48aa-8abc-3572429356b5-tmp\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.246656 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.246640    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.746615971 +0000 UTC m=+36.208006690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:37:47.246716 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.246697    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af2bffc8-82ca-45d0-bc1b-e976919cf59a-config\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.247052 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.247029    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1a60811-090e-48aa-8abc-3572429356b5-service-ca-bundle\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.247360 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.247339    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:37:47.247428 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.247408    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.747393413 +0000 UTC m=+36.208784143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:37:47.247500 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.247469    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/203c8baf-e3f7-4837-af89-6de37a159dc7-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.247500 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.247493    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:47.247637 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.247624    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:47.747611724 +0000 UTC m=+36.209002439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:47.247637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.247629    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4908d57-875b-463c-8120-03ba5e42a17a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.247910 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.247890    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807688ad-af8a-43a7-b3ec-3334d9aa5eea-tmp-dir\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.248081 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.248050    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/807688ad-af8a-43a7-b3ec-3334d9aa5eea-config-volume\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.251903 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.249402    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b1a60811-090e-48aa-8abc-3572429356b5-serving-cert\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.251903 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.250603    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4908d57-875b-463c-8120-03ba5e42a17a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.251903 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.250750    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-default-certificate\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.252175 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.252106    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af2bffc8-82ca-45d0-bc1b-e976919cf59a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.252967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.252943    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-stats-auth\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.256159 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.256117    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxcgs\" (UniqueName: \"kubernetes.io/projected/66fab76f-eea7-4ece-9087-686594e9c0d1-kube-api-access-lxcgs\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.256512 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.256494    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg2g7\" (UniqueName: \"kubernetes.io/projected/23fae3d4-4606-4d8a-beff-6969e8742139-kube-api-access-wg2g7\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.268563 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.268533    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4fcr\" (UniqueName: \"kubernetes.io/projected/b1a60811-090e-48aa-8abc-3572429356b5-kube-api-access-m4fcr\") pod \"insights-operator-555d9d7885-tzw5k\" (UID: \"b1a60811-090e-48aa-8abc-3572429356b5\") " pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.268719 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.268533    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp9kt\" (UniqueName: \"kubernetes.io/projected/807688ad-af8a-43a7-b3ec-3334d9aa5eea-kube-api-access-bp9kt\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.271083 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.271050    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvmsf\" (UniqueName: \"kubernetes.io/projected/af2bffc8-82ca-45d0-bc1b-e976919cf59a-kube-api-access-mvmsf\") pod \"service-ca-operator-5bcbc94c78-v7pxv\" (UID: \"af2bffc8-82ca-45d0-bc1b-e976919cf59a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.271234 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.271103    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69bv\" (UniqueName: \"kubernetes.io/projected/04e3d544-bbf5-42ba-aac7-3a222e1df0fb-kube-api-access-c69bv\") pod \"volume-data-source-validator-78cf4c6f6-h66vm\" (UID: \"04e3d544-bbf5-42ba-aac7-3a222e1df0fb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"
Jul 22 02:37:47.271301 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.271252    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cvsp\" (UniqueName: \"kubernetes.io/projected/c4908d57-875b-463c-8120-03ba5e42a17a-kube-api-access-8cvsp\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7kgk\" (UID: \"c4908d57-875b-463c-8120-03ba5e42a17a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.271625 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.271607    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tr95\" (UniqueName: \"kubernetes.io/projected/203c8baf-e3f7-4837-af89-6de37a159dc7-kube-api-access-6tr95\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.273469 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.273449    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmh8g\" (UniqueName: \"kubernetes.io/projected/1637501b-9e4e-4e8b-9f1a-59066184a53e-kube-api-access-rmh8g\") pod \"network-check-source-7bc5b6bf85-gzdtn\" (UID: \"1637501b-9e4e-4e8b-9f1a-59066184a53e\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"
Jul 22 02:37:47.297520 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.297478    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"
Jul 22 02:37:47.316760 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.316723    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-tzw5k"
Jul 22 02:37:47.333705 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.333671    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"
Jul 22 02:37:47.346134 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346095    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-serving-cert\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.346303 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346172    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-config\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.346390 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346346    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-trusted-ca\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.346439 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346414    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f97af3-4226-44b8-bb9e-15433e2d248e-cert\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.346498 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346474    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqmw\" (UniqueName: \"kubernetes.io/projected/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-kube-api-access-nhqmw\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.346559 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346540    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92rpb\" (UniqueName: \"kubernetes.io/projected/62f97af3-4226-44b8-bb9e-15433e2d248e-kube-api-access-92rpb\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.346946 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.346898    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-config\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.347212 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.347191    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-trusted-ca\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.349068 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.349041    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-serving-cert\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.349195 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.349155    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62f97af3-4226-44b8-bb9e-15433e2d248e-cert\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.354001 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.353974    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"
Jul 22 02:37:47.362165 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.362114    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"
Jul 22 02:37:47.366270 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.366013    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqmw\" (UniqueName: \"kubernetes.io/projected/37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1-kube-api-access-nhqmw\") pod \"console-operator-565b7b569d-959ds\" (UID: \"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1\") " pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.366270 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.366025    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92rpb\" (UniqueName: \"kubernetes.io/projected/62f97af3-4226-44b8-bb9e-15433e2d248e-kube-api-access-92rpb\") pod \"ingress-canary-6bqkn\" (UID: \"62f97af3-4226-44b8-bb9e-15433e2d248e\") " pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.382346 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.382292    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6bqkn"
Jul 22 02:37:47.407009 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.406792    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:47.650206 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.650162    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:47.650381 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.650262    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:37:47.650381 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.650284    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:37:47.650381 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.650366    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.650345857 +0000 UTC m=+37.111736575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:37:47.751179 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.751117    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.751370 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.751243    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:47.751370 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751261    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:37:47.751370 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.751281    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:47.751370 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.751318    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:47.751370 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751335    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.751315162 +0000 UTC m=+37.212705898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751390    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751409    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.751392737 +0000 UTC m=+37.212783468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751413    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:47.751434    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751461    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.75144975 +0000 UTC m=+37.212840468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751473    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751482    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.751474729 +0000 UTC m=+37.212865444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:47.751618 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:47.751504    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:48.751495442 +0000 UTC m=+37.212886157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:37:48.661115 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.660591    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:48.662052 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.660960    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:37:48.662052 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.661578    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:37:48.662052 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.661657    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.661634091 +0000 UTC m=+39.123024809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.761956    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.762051    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.762083    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.762113    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.762211    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762403    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762464    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.762445808 +0000 UTC m=+39.223836524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762805    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762839    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.76282939 +0000 UTC m=+39.224220106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762883    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.762877268 +0000 UTC m=+39.224267984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762940    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.762965    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.762957795 +0000 UTC m=+39.224348510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.763006    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:48.763055 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:48.763024    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:37:50.763018751 +0000 UTC m=+39.224409466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:48.803963 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.803863    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk"]
Jul 22 02:37:48.808413 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.808361    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4908d57_875b_463c_8120_03ba5e42a17a.slice/crio-4f986aa02fd80590485cde0b54f01f1fc3bd6fe562dd0ae4c4fcd6a480aeae05 WatchSource:0}: Error finding container 4f986aa02fd80590485cde0b54f01f1fc3bd6fe562dd0ae4c4fcd6a480aeae05: Status 404 returned error can't find the container with id 4f986aa02fd80590485cde0b54f01f1fc3bd6fe562dd0ae4c4fcd6a480aeae05
Jul 22 02:37:48.810591 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.810563    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm"]
Jul 22 02:37:48.813908 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.812819    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-tzw5k"]
Jul 22 02:37:48.814105 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.813968    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6bqkn"]
Jul 22 02:37:48.815536 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.815452    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f97af3_4226_44b8_bb9e_15433e2d248e.slice/crio-f13ed8fd48435a5e647f5037126c74d2312dcb513caef0ad1e1b661c41d369b5 WatchSource:0}: Error finding container f13ed8fd48435a5e647f5037126c74d2312dcb513caef0ad1e1b661c41d369b5: Status 404 returned error can't find the container with id f13ed8fd48435a5e647f5037126c74d2312dcb513caef0ad1e1b661c41d369b5
Jul 22 02:37:48.816532 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.816502    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a60811_090e_48aa_8abc_3572429356b5.slice/crio-fbf3e644c2076fb94543714c3580d5e7bc5931d06e0c429577d64f6f8e220bf9 WatchSource:0}: Error finding container fbf3e644c2076fb94543714c3580d5e7bc5931d06e0c429577d64f6f8e220bf9: Status 404 returned error can't find the container with id fbf3e644c2076fb94543714c3580d5e7bc5931d06e0c429577d64f6f8e220bf9
Jul 22 02:37:48.819626 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.817804    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e3d544_bbf5_42ba_aac7_3a222e1df0fb.slice/crio-6980c48e5a9c4beb9c45554083b25433962f282b4be0d29f770b39109c9b4a76 WatchSource:0}: Error finding container 6980c48e5a9c4beb9c45554083b25433962f282b4be0d29f770b39109c9b4a76: Status 404 returned error can't find the container with id 6980c48e5a9c4beb9c45554083b25433962f282b4be0d29f770b39109c9b4a76
Jul 22 02:37:48.828114 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.828089    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-959ds"]
Jul 22 02:37:48.831318 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.831279    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn"]
Jul 22 02:37:48.832443 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.832340    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b1fe9b_0de7_4c27_a50a_cd3dd63f53f1.slice/crio-aef13a1b71b85788b92c3d84d48c0cb68510643a9116974b3bc554d937a80514 WatchSource:0}: Error finding container aef13a1b71b85788b92c3d84d48c0cb68510643a9116974b3bc554d937a80514: Status 404 returned error can't find the container with id aef13a1b71b85788b92c3d84d48c0cb68510643a9116974b3bc554d937a80514
Jul 22 02:37:48.833754 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:48.833705    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv"]
Jul 22 02:37:48.836703 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:37:48.836627    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2bffc8_82ca_45d0_bc1b_e976919cf59a.slice/crio-a9d8dab12f53f44ae510e72906669c06ae2a4ea0c40161ac9f82b7c6b57a4b8d WatchSource:0}: Error finding container a9d8dab12f53f44ae510e72906669c06ae2a4ea0c40161ac9f82b7c6b57a4b8d: Status 404 returned error can't find the container with id a9d8dab12f53f44ae510e72906669c06ae2a4ea0c40161ac9f82b7c6b57a4b8d
Jul 22 02:37:49.161599 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.161560    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv" event={"ID":"af2bffc8-82ca-45d0-bc1b-e976919cf59a","Type":"ContainerStarted","Data":"a9d8dab12f53f44ae510e72906669c06ae2a4ea0c40161ac9f82b7c6b57a4b8d"}
Jul 22 02:37:49.162957 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.162928    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bqkn" event={"ID":"62f97af3-4226-44b8-bb9e-15433e2d248e","Type":"ContainerStarted","Data":"f13ed8fd48435a5e647f5037126c74d2312dcb513caef0ad1e1b661c41d369b5"}
Jul 22 02:37:49.163976 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.163951    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn" event={"ID":"1637501b-9e4e-4e8b-9f1a-59066184a53e","Type":"ContainerStarted","Data":"9d34a8f7a5f1ff93cc15dec07fc84cc8f1139468be0443eb161443ab1a3ed67b"}
Jul 22 02:37:49.166708 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.166682    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="6e011365c206b076dbb939f685bae14ee000c5fe300fcbcf12346d5a85eb2e72" exitCode=0
Jul 22 02:37:49.166791 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.166760    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"6e011365c206b076dbb939f685bae14ee000c5fe300fcbcf12346d5a85eb2e72"}
Jul 22 02:37:49.168007 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.167980    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tzw5k" event={"ID":"b1a60811-090e-48aa-8abc-3572429356b5","Type":"ContainerStarted","Data":"fbf3e644c2076fb94543714c3580d5e7bc5931d06e0c429577d64f6f8e220bf9"}
Jul 22 02:37:49.169178 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.169130    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm" event={"ID":"04e3d544-bbf5-42ba-aac7-3a222e1df0fb","Type":"ContainerStarted","Data":"6980c48e5a9c4beb9c45554083b25433962f282b4be0d29f770b39109c9b4a76"}
Jul 22 02:37:49.170816 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.170795    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk" event={"ID":"c4908d57-875b-463c-8120-03ba5e42a17a","Type":"ContainerStarted","Data":"4f986aa02fd80590485cde0b54f01f1fc3bd6fe562dd0ae4c4fcd6a480aeae05"}
Jul 22 02:37:49.171925 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:49.171907    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-959ds" event={"ID":"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1","Type":"ContainerStarted","Data":"aef13a1b71b85788b92c3d84d48c0cb68510643a9116974b3bc554d937a80514"}
Jul 22 02:37:50.188781 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.187531    2523 generic.go:356] "Generic (PLEG): container finished" podID="ecf61016-171b-4475-b33b-2ff954b2dbfc" containerID="30d268c54d4edbb94f332473ba34e71725406f1ae2f3a362488d05792e2d7d59" exitCode=0
Jul 22 02:37:50.188781 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.187856    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerDied","Data":"30d268c54d4edbb94f332473ba34e71725406f1ae2f3a362488d05792e2d7d59"}
Jul 22 02:37:50.681422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.681377    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:50.681670 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.681651    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:37:50.681761 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.681674    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:37:50.681761 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.681738    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.681717962 +0000 UTC m=+43.143108768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:37:50.782891 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.782841    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:50.783080 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.782946    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:50.783080 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.782981    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:50.783080 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.783015    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:50.783080 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:50.783077    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:50.783302 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783254    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:37:50.783353 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783320    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.783300327 +0000 UTC m=+43.244691043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:37:50.783766 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783739    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:37:50.783913 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783796    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.783780635 +0000 UTC m=+43.245171354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:37:50.783913 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783863    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.783850878 +0000 UTC m=+43.245241593 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:37:50.784019 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783921    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:50.784019 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.783976    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.783964364 +0000 UTC m=+43.245355086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:50.784119 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.784031    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:50.784119 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:50.784056    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:37:54.784047274 +0000 UTC m=+43.245437989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:51.197543 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:51.197504    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" event={"ID":"ecf61016-171b-4475-b33b-2ff954b2dbfc","Type":"ContainerStarted","Data":"6d57ec80f0cb30053128a7a2d93448fc8658c265aaf09fce38acf07e74715ea3"}
Jul 22 02:37:54.724947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.724902    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:37:54.725475 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.725028    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:37:54.725475 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.725040    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:37:54.725475 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.725096    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.725080913 +0000 UTC m=+51.186471628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:37:54.825472 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.825423    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.825496    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.825519    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.825542    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825561    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:54.825582    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:37:54.825644 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825636    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.82561634 +0000 UTC m=+51.287007067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825648    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825663    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.825644679 +0000 UTC m=+51.287035395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825691    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825694    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825719    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.825704918 +0000 UTC m=+51.287095633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825741    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.825727672 +0000 UTC m=+51.287118388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:37:54.825892 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:54.825792    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.825782675 +0000 UTC m=+51.287173390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:37:57.217515 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.217416    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk" event={"ID":"c4908d57-875b-463c-8120-03ba5e42a17a","Type":"ContainerStarted","Data":"b349a72b27f8411d5f29018a5f42c0b4952749ad8c2157026e33ea3b21574a4c"}
Jul 22 02:37:57.220098 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.220068    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/0.log"
Jul 22 02:37:57.220289 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.220105    2523 generic.go:356] "Generic (PLEG): container finished" podID="37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1" containerID="3cf354046a59920af79ab1bcc6370f46cd33d5b14b92d7b2ee3954a90f06437d" exitCode=255
Jul 22 02:37:57.220289 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.220203    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-959ds" event={"ID":"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1","Type":"ContainerDied","Data":"3cf354046a59920af79ab1bcc6370f46cd33d5b14b92d7b2ee3954a90f06437d"}
Jul 22 02:37:57.220526 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.220506    2523 scope.go:117] "RemoveContainer" containerID="3cf354046a59920af79ab1bcc6370f46cd33d5b14b92d7b2ee3954a90f06437d"
Jul 22 02:37:57.222050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.222021    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv" event={"ID":"af2bffc8-82ca-45d0-bc1b-e976919cf59a","Type":"ContainerStarted","Data":"f0d4f8aa707ed601a77c097ab6c179c5471d3e042099c529d253afb26be37873"}
Jul 22 02:37:57.225176 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.224564    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6bqkn" event={"ID":"62f97af3-4226-44b8-bb9e-15433e2d248e","Type":"ContainerStarted","Data":"6d0bad575006a8ecf4d586e9e50425ec10bd524b6d53fa9985e8c206d64fd3dc"}
Jul 22 02:37:57.226404 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.226379    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn" event={"ID":"1637501b-9e4e-4e8b-9f1a-59066184a53e","Type":"ContainerStarted","Data":"50f54a889a507c42f58c5e5f4aea8e15947ab9c2084b906638a0bdc587155f10"}
Jul 22 02:37:57.228178 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.228134    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm" event={"ID":"04e3d544-bbf5-42ba-aac7-3a222e1df0fb","Type":"ContainerStarted","Data":"e0053b9043bfd1e846182753e501f6c8f507684086b9ddcc5c9a54387048cd01"}
Jul 22 02:37:57.252508 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.252460    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9rsk2" podStartSLOduration=15.171984185 podStartE2EDuration="45.252443675s" totalImagesPullingTime="30.08045949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:51.241746691 +0000 UTC m=+39.703137429" watchObservedRunningTime="2026-07-22 02:37:57.252443675 +0000 UTC m=+45.713834411"
Jul 22 02:37:57.253948 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.253905    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk" podStartSLOduration=11.10503819 podStartE2EDuration="19.253891656s" totalImagesPullingTime="8.148853466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:57.253428648 +0000 UTC m=+45.714819369" watchObservedRunningTime="2026-07-22 02:37:57.253891656 +0000 UTC m=+45.715282393"
Jul 22 02:37:57.311044 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.310985    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6bqkn" podStartSLOduration=3.167533744 podStartE2EDuration="11.310964742s" totalImagesPullingTime="8.143430998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:57.31029661 +0000 UTC m=+45.771687373" watchObservedRunningTime="2026-07-22 02:37:57.310964742 +0000 UTC m=+45.772355480"
Jul 22 02:37:57.312320 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.312273    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-gzdtn" podStartSLOduration=11.188310606 podStartE2EDuration="19.31225461s" totalImagesPullingTime="8.123944004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:57.277840312 +0000 UTC m=+45.739231048" watchObservedRunningTime="2026-07-22 02:37:57.31225461 +0000 UTC m=+45.773645349"
Jul 22 02:37:57.361533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.361464    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-h66vm" podStartSLOduration=11.221761475 podStartE2EDuration="19.361436833s" totalImagesPullingTime="8.139675358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:57.336993487 +0000 UTC m=+45.798384226" watchObservedRunningTime="2026-07-22 02:37:57.361436833 +0000 UTC m=+45.822827571"
Jul 22 02:37:57.392524 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.392462    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv" podStartSLOduration=11.269722451 podStartE2EDuration="19.392437445s" totalImagesPullingTime="8.122714994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:57.363776635 +0000 UTC m=+45.825167374" watchObservedRunningTime="2026-07-22 02:37:57.392437445 +0000 UTC m=+45.853828183"
Jul 22 02:37:57.407264 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.407235    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:57.407446 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:57.407436    2523 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:37:58.234346 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.234310    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:37:58.234864 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.234844    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/0.log"
Jul 22 02:37:58.234974 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.234893    2523 generic.go:356] "Generic (PLEG): container finished" podID="37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1" containerID="d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398" exitCode=255
Jul 22 02:37:58.235025 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.234991    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-959ds" event={"ID":"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1","Type":"ContainerDied","Data":"d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398"}
Jul 22 02:37:58.235091 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.235077    2523 scope.go:117] "RemoveContainer" containerID="3cf354046a59920af79ab1bcc6370f46cd33d5b14b92d7b2ee3954a90f06437d"
Jul 22 02:37:58.235355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.235333    2523 scope.go:117] "RemoveContainer" containerID="d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398"
Jul 22 02:37:58.235557 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:58.235532    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-959ds_openshift-console-operator(37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-959ds" podUID="37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1"
Jul 22 02:37:58.237591 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.237109    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tzw5k" event={"ID":"b1a60811-090e-48aa-8abc-3572429356b5","Type":"ContainerStarted","Data":"a8c43ff8fe41f5e64d990ff4a54442104b5007af628444facf751d3399be7818"}
Jul 22 02:37:58.273588 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.273464    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-tzw5k" podStartSLOduration=12.12910405 podStartE2EDuration="20.273440656s" totalImagesPullingTime="8.144336606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:37:58.273025996 +0000 UTC m=+46.734416733" watchObservedRunningTime="2026-07-22 02:37:58.273440656 +0000 UTC m=+46.734831392"
Jul 22 02:37:58.433188 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.431187    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v56dt"]
Jul 22 02:37:58.446270 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.446200    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.447985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.447900    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v56dt"]
Jul 22 02:37:58.448669 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.448646    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 02:37:58.448802 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.448658    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gmrt\""
Jul 22 02:37:58.448964 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.448943    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 02:37:58.459629 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.459598    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/291863b8-dfa2-474c-97ae-e67c79aebef2-data-volume\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.459783 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.459752    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/291863b8-dfa2-474c-97ae-e67c79aebef2-crio-socket\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.459783 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.459778    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.459894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.459863    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.460184 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.459940    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rct\" (UniqueName: \"kubernetes.io/projected/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-api-access-55rct\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561434 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561349    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/291863b8-dfa2-474c-97ae-e67c79aebef2-crio-socket\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561434 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561385    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561434 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561424    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561487    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rct\" (UniqueName: \"kubernetes.io/projected/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-api-access-55rct\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561498    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/291863b8-dfa2-474c-97ae-e67c79aebef2-crio-socket\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561523    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/291863b8-dfa2-474c-97ae-e67c79aebef2-data-volume\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:58.561534    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:58.561583    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:58.561619    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:59.061598211 +0000 UTC m=+47.522988928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:58.561706 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:58.561659    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:37:59.061640109 +0000 UTC m=+47.523030846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : configmap "kube-rbac-proxy" not found
Jul 22 02:37:58.561954 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.561786    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/291863b8-dfa2-474c-97ae-e67c79aebef2-data-volume\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:58.582892 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:58.582858    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rct\" (UniqueName: \"kubernetes.io/projected/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-api-access-55rct\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:59.065743 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:59.065700    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:59.065923 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:59.065775    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:37:59.065923 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:59.065872    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:59.065923 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:59.065900    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:37:59.066023 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:59.065956    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:00.065939139 +0000 UTC m=+48.527329854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:37:59.066023 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:59.065971    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:00.065964545 +0000 UTC m=+48.527355261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : configmap "kube-rbac-proxy" not found
Jul 22 02:37:59.241870 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:59.241830    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:37:59.242408 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:37:59.242265    2523 scope.go:117] "RemoveContainer" containerID="d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398"
Jul 22 02:37:59.242481 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:37:59.242458    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-959ds_openshift-console-operator(37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-959ds" podUID="37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1"
Jul 22 02:38:00.074950 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:00.074912    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:00.075135 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:00.074970    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:00.075135 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:00.075034    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:38:00.075135 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:00.075068    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:00.075135 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:00.075098    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.075084159 +0000 UTC m=+50.536474874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : configmap "kube-rbac-proxy" not found
Jul 22 02:38:00.075135 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:00.075120    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:02.075108401 +0000 UTC m=+50.536499116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:00.406208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:00.406106    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4zgv_ddf0b081-b5c8-49fe-8526-462cbe0745e7/dns-node-resolver/0.log"
Jul 22 02:38:01.606208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:01.606181    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skdmt_54edb804-d925-4d24-b532-2e0c2feca0bb/node-ca/0.log"
Jul 22 02:38:02.097670 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.097625    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:02.097857 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.097686    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:02.097857 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.097760    2523 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 02:38:02.097857 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.097813    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:02.097964 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.097818    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:06.097803417 +0000 UTC m=+54.559194133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : configmap "kube-rbac-proxy" not found
Jul 22 02:38:02.097964 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.097886    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:06.097866713 +0000 UTC m=+54.559257439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:02.207405 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.207367    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bqkn_62f97af3-4226-44b8-bb9e-15433e2d248e/serve-healthcheck-canary/0.log"
Jul 22 02:38:02.805124 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.805071    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:02.805546 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.805244    2523 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 02:38:02.805546 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.805263    2523 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65dd5f696d-d7d59: secret "image-registry-tls" not found
Jul 22 02:38:02.805546 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.805320    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls podName:ca11e329-c543-4af8-8091-6634f04fa622 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.805303716 +0000 UTC m=+67.266694431 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls") pod "image-registry-65dd5f696d-d7d59" (UID: "ca11e329-c543-4af8-8091-6634f04fa622") : secret "image-registry-tls" not found
Jul 22 02:38:02.906319 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.906270    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.906352    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.906376    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.906402    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:02.906439    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906442    2523 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 02:38:02.906520 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906522    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.906502288 +0000 UTC m=+67.367893003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : secret "router-metrics-certs-default" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906533    2523 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906535    2523 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906542    2523 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906537    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle podName:23fae3d4-4606-4d8a-beff-6969e8742139 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.906531517 +0000 UTC m=+67.367922232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle") pod "router-default-6f8fd84546-rmjqk" (UID: "23fae3d4-4606-4d8a-beff-6969e8742139") : configmap references non-existent config key: service-ca.crt
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906615    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls podName:203c8baf-e3f7-4837-af89-6de37a159dc7 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.906601605 +0000 UTC m=+67.367992320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-wdclm" (UID: "203c8baf-e3f7-4837-af89-6de37a159dc7") : secret "cluster-monitoring-operator-tls" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906625    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls podName:66fab76f-eea7-4ece-9087-686594e9c0d1 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.906619715 +0000 UTC m=+67.368010430 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j6kfm" (UID: "66fab76f-eea7-4ece-9087-686594e9c0d1") : secret "samples-operator-tls" not found
Jul 22 02:38:02.906748 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:02.906635    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls podName:807688ad-af8a-43a7-b3ec-3334d9aa5eea nodeName:}" failed. No retries permitted until 2026-07-22 02:38:18.906629275 +0000 UTC m=+67.368019990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls") pod "dns-default-fhvjp" (UID: "807688ad-af8a-43a7-b3ec-3334d9aa5eea") : secret "dns-default-metrics-tls" not found
Jul 22 02:38:06.136950 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:06.136908    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:06.137491 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:06.136964    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:06.137491 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:06.137088    2523 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:06.137491 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:06.137196    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls podName:291863b8-dfa2-474c-97ae-e67c79aebef2 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:14.137173768 +0000 UTC m=+62.598564500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v56dt" (UID: "291863b8-dfa2-474c-97ae-e67c79aebef2") : secret "insights-runtime-extractor-tls" not found
Jul 22 02:38:06.137621 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:06.137499    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/291863b8-dfa2-474c-97ae-e67c79aebef2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:07.407668 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:07.407612    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:38:07.407668 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:07.407685    2523 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:38:07.408095 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:07.408032    2523 scope.go:117] "RemoveContainer" containerID="d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398"
Jul 22 02:38:07.408230 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:07.408211    2523 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-959ds_openshift-console-operator(37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1)\"" pod="openshift-console-operator/console-operator-565b7b569d-959ds" podUID="37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1"
Jul 22 02:38:13.150812 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:13.150779    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcmfl"
Jul 22 02:38:14.213467 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:14.213425    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:14.215919 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:14.215889    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/291863b8-dfa2-474c-97ae-e67c79aebef2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v56dt\" (UID: \"291863b8-dfa2-474c-97ae-e67c79aebef2\") " pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:14.362060 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:14.362027    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5gmrt\""
Jul 22 02:38:14.369797 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:14.369754    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v56dt"
Jul 22 02:38:14.501691 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:14.501594    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v56dt"]
Jul 22 02:38:14.504493 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:14.504464    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291863b8_dfa2_474c_97ae_e67c79aebef2.slice/crio-54ae70a12228ad5390af1ba38ec9c6009fb96b1a165270244c9c8ba329790618 WatchSource:0}: Error finding container 54ae70a12228ad5390af1ba38ec9c6009fb96b1a165270244c9c8ba329790618: Status 404 returned error can't find the container with id 54ae70a12228ad5390af1ba38ec9c6009fb96b1a165270244c9c8ba329790618
Jul 22 02:38:15.298554 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:15.298510    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v56dt" event={"ID":"291863b8-dfa2-474c-97ae-e67c79aebef2","Type":"ContainerStarted","Data":"54ae70a12228ad5390af1ba38ec9c6009fb96b1a165270244c9c8ba329790618"}
Jul 22 02:38:17.752798 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.752747    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:38:17.753276 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.752829    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:38:17.755168 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.755128    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 02:38:17.755320 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.755127    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 02:38:17.766111 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.766079    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4362c21e-df7b-4f10-a453-888270548674-metrics-certs\") pod \"network-metrics-daemon-jkdzf\" (UID: \"4362c21e-df7b-4f10-a453-888270548674\") " pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:38:17.766274 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.766171    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b54765c-d92b-43f8-9c98-8c83e4a06d8c-original-pull-secret\") pod \"global-pull-secret-syncer-fxj8k\" (UID: \"7b54765c-d92b-43f8-9c98-8c83e4a06d8c\") " pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:38:17.853675 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.853637    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:38:17.856576 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.856538    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tsc\" (UniqueName: \"kubernetes.io/projected/00d8e4f7-c70b-44ba-8391-4d9d8e86570a-kube-api-access-x2tsc\") pod \"network-check-target-bzph8\" (UID: \"00d8e4f7-c70b-44ba-8391-4d9d8e86570a\") " pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:38:17.867444 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.867416    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d24b6\""
Jul 22 02:38:17.875558 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.875517    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:38:17.884458 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.884426    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48l7s\""
Jul 22 02:38:17.890467 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.890436    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxj8k"
Jul 22 02:38:17.892548 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:17.892525    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkdzf"
Jul 22 02:38:18.862894 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.862852    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:18.865692 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.865658    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"image-registry-65dd5f696d-d7d59\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") " pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:18.964325 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.964281    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:18.964649 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.964339    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:38:18.964649 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.964377    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:18.964649 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.964426    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:38:18.964649 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.964477    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:18.965097 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.965068    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23fae3d4-4606-4d8a-beff-6969e8742139-service-ca-bundle\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:18.967607 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.967573    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/807688ad-af8a-43a7-b3ec-3334d9aa5eea-metrics-tls\") pod \"dns-default-fhvjp\" (UID: \"807688ad-af8a-43a7-b3ec-3334d9aa5eea\") " pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:18.967707 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.967689    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/66fab76f-eea7-4ece-9087-686594e9c0d1-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j6kfm\" (UID: \"66fab76f-eea7-4ece-9087-686594e9c0d1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:38:18.967746 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.967721    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23fae3d4-4606-4d8a-beff-6969e8742139-metrics-certs\") pod \"router-default-6f8fd84546-rmjqk\" (UID: \"23fae3d4-4606-4d8a-beff-6969e8742139\") " pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:18.968056 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:18.968034    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/203c8baf-e3f7-4837-af89-6de37a159dc7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-wdclm\" (UID: \"203c8baf-e3f7-4837-af89-6de37a159dc7\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:38:19.077037 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.077000    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-swntg\""
Jul 22 02:38:19.084679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.084651    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:19.108526 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.108491    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qjx7c\""
Jul 22 02:38:19.116932 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.116616    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"
Jul 22 02:38:19.127929 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.127895    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5hsdz\""
Jul 22 02:38:19.136620 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.136580    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"
Jul 22 02:38:19.150544 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.150284    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b7hbl\""
Jul 22 02:38:19.158557 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.158523    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:19.172395 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.172172    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7k6rz\""
Jul 22 02:38:19.180739 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.180706    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:19.396157 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.396046    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bzph8"]
Jul 22 02:38:19.402697 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.402644    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d8e4f7_c70b_44ba_8391_4d9d8e86570a.slice/crio-33c9a779bdddc0a203c4e31e8167818b0d8af437b21790673c9283309ee807ca WatchSource:0}: Error finding container 33c9a779bdddc0a203c4e31e8167818b0d8af437b21790673c9283309ee807ca: Status 404 returned error can't find the container with id 33c9a779bdddc0a203c4e31e8167818b0d8af437b21790673c9283309ee807ca
Jul 22 02:38:19.457723 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.457692    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm"]
Jul 22 02:38:19.480083 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.480054    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:38:19.493059 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.490827    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8fd84546-rmjqk"]
Jul 22 02:38:19.504313 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.503838    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23fae3d4_4606_4d8a_beff_6969e8742139.slice/crio-2f0edd44d129a50838fe337e1c22df3bab18dbfbedcbd8c2cbf8a42a0b5561fc WatchSource:0}: Error finding container 2f0edd44d129a50838fe337e1c22df3bab18dbfbedcbd8c2cbf8a42a0b5561fc: Status 404 returned error can't find the container with id 2f0edd44d129a50838fe337e1c22df3bab18dbfbedcbd8c2cbf8a42a0b5561fc
Jul 22 02:38:19.516480 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.516401    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm"]
Jul 22 02:38:19.522779 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.522747    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203c8baf_e3f7_4837_af89_6de37a159dc7.slice/crio-112a1fb3b7d8cdfecae945e3f2a6b3b050ff6509e5ab3dba529b33cc2846f9a5 WatchSource:0}: Error finding container 112a1fb3b7d8cdfecae945e3f2a6b3b050ff6509e5ab3dba529b33cc2846f9a5: Status 404 returned error can't find the container with id 112a1fb3b7d8cdfecae945e3f2a6b3b050ff6509e5ab3dba529b33cc2846f9a5
Jul 22 02:38:19.743357 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.743257    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkdzf"]
Jul 22 02:38:19.746716 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.746609    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhvjp"]
Jul 22 02:38:19.746967 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.746854    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4362c21e_df7b_4f10_a453_888270548674.slice/crio-bf28708031496b690eddd3e3fc53d7e5d45f4f80c073b82c7b8f4568a30c9775 WatchSource:0}: Error finding container bf28708031496b690eddd3e3fc53d7e5d45f4f80c073b82c7b8f4568a30c9775: Status 404 returned error can't find the container with id bf28708031496b690eddd3e3fc53d7e5d45f4f80c073b82c7b8f4568a30c9775
Jul 22 02:38:19.747744 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:19.747729    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxj8k"]
Jul 22 02:38:19.750427 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.750401    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b54765c_d92b_43f8_9c98_8c83e4a06d8c.slice/crio-d4d38176368f6824267008f4e531174ef91eb3f69652d797cd01338ac2e08015 WatchSource:0}: Error finding container d4d38176368f6824267008f4e531174ef91eb3f69652d797cd01338ac2e08015: Status 404 returned error can't find the container with id d4d38176368f6824267008f4e531174ef91eb3f69652d797cd01338ac2e08015
Jul 22 02:38:19.750645 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:19.750623    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807688ad_af8a_43a7_b3ec_3334d9aa5eea.slice/crio-9bd7ef0eac2a2edad2eca1c2cf87e04d8c261635f89ab00af1b669ef75392f70 WatchSource:0}: Error finding container 9bd7ef0eac2a2edad2eca1c2cf87e04d8c261635f89ab00af1b669ef75392f70: Status 404 returned error can't find the container with id 9bd7ef0eac2a2edad2eca1c2cf87e04d8c261635f89ab00af1b669ef75392f70
Jul 22 02:38:20.332091 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.332042    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm" event={"ID":"203c8baf-e3f7-4837-af89-6de37a159dc7","Type":"ContainerStarted","Data":"112a1fb3b7d8cdfecae945e3f2a6b3b050ff6509e5ab3dba529b33cc2846f9a5"}
Jul 22 02:38:20.335880 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.335840    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v56dt" event={"ID":"291863b8-dfa2-474c-97ae-e67c79aebef2","Type":"ContainerStarted","Data":"84ef385d6d37d50b9b45839dfd8823453d149799722ef40a13b6e8667827322b"}
Jul 22 02:38:20.338399 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.338363    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm" event={"ID":"66fab76f-eea7-4ece-9087-686594e9c0d1","Type":"ContainerStarted","Data":"779c8a9a6fa4c5f9c03043e6f2d84255c83e15dd8efcc3775024350903054d74"}
Jul 22 02:38:20.342082 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.342005    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxj8k" event={"ID":"7b54765c-d92b-43f8-9c98-8c83e4a06d8c","Type":"ContainerStarted","Data":"d4d38176368f6824267008f4e531174ef91eb3f69652d797cd01338ac2e08015"}
Jul 22 02:38:20.346769 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.345741    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzph8" event={"ID":"00d8e4f7-c70b-44ba-8391-4d9d8e86570a","Type":"ContainerStarted","Data":"111b81ef7ef126e0ccb512704813b1681a3701ead1830978651a8782db484b01"}
Jul 22 02:38:20.346769 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.345812    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bzph8" event={"ID":"00d8e4f7-c70b-44ba-8391-4d9d8e86570a","Type":"ContainerStarted","Data":"33c9a779bdddc0a203c4e31e8167818b0d8af437b21790673c9283309ee807ca"}
Jul 22 02:38:20.346769 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.346687    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:38:20.351468 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.351433    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" event={"ID":"ca11e329-c543-4af8-8091-6634f04fa622","Type":"ContainerStarted","Data":"653db7aa90edfcb43e2e849cf9d72e6c375f2feeaa7ead452debde9746e5c15c"}
Jul 22 02:38:20.351629 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.351494    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" event={"ID":"ca11e329-c543-4af8-8091-6634f04fa622","Type":"ContainerStarted","Data":"8de8dafc52670320adeacdeb4cdf756ab1e5baeda57ad56246600048f334ba01"}
Jul 22 02:38:20.351720 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.351701    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:20.355597 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.354994    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8fd84546-rmjqk" event={"ID":"23fae3d4-4606-4d8a-beff-6969e8742139","Type":"ContainerStarted","Data":"679667dc766df66a7887415f11319997ea3bdd482ddb323785c32039b31dddf0"}
Jul 22 02:38:20.355597 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.355048    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8fd84546-rmjqk" event={"ID":"23fae3d4-4606-4d8a-beff-6969e8742139","Type":"ContainerStarted","Data":"2f0edd44d129a50838fe337e1c22df3bab18dbfbedcbd8c2cbf8a42a0b5561fc"}
Jul 22 02:38:20.358770 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.358684    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdzf" event={"ID":"4362c21e-df7b-4f10-a453-888270548674","Type":"ContainerStarted","Data":"bf28708031496b690eddd3e3fc53d7e5d45f4f80c073b82c7b8f4568a30c9775"}
Jul 22 02:38:20.361754 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.361707    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvjp" event={"ID":"807688ad-af8a-43a7-b3ec-3334d9aa5eea","Type":"ContainerStarted","Data":"9bd7ef0eac2a2edad2eca1c2cf87e04d8c261635f89ab00af1b669ef75392f70"}
Jul 22 02:38:20.369807 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.369744    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bzph8" podStartSLOduration=68.369721106 podStartE2EDuration="1m8.369721106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:20.36905779 +0000 UTC m=+68.830448529" watchObservedRunningTime="2026-07-22 02:38:20.369721106 +0000 UTC m=+68.831111844"
Jul 22 02:38:20.451165 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.451092    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f8fd84546-rmjqk" podStartSLOduration=42.451067003 podStartE2EDuration="42.451067003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:20.405062455 +0000 UTC m=+68.866453191" watchObservedRunningTime="2026-07-22 02:38:20.451067003 +0000 UTC m=+68.912457730"
Jul 22 02:38:20.951035 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:20.951005    2523 scope.go:117] "RemoveContainer" containerID="d0c149fd1146996bb4da6ed70e03a7a77a2dd693a61c01fe313721b698972398"
Jul 22 02:38:21.159769 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.159730    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:21.163003 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.162976    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:21.189792 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.188514    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" podStartSLOduration=69.188491644 podStartE2EDuration="1m9.188491644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:20.452774649 +0000 UTC m=+68.914165388" watchObservedRunningTime="2026-07-22 02:38:21.188491644 +0000 UTC m=+69.649882383"
Jul 22 02:38:21.372908 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.372259    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:38:21.374025 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.373429    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-959ds" event={"ID":"37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1","Type":"ContainerStarted","Data":"2240d935f1824bcfbb62084c3f478eccb9384c258198500ad18decf16570b82b"}
Jul 22 02:38:21.374785 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.374664    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:38:21.375593 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.375234    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:21.376606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.376584    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f8fd84546-rmjqk"
Jul 22 02:38:21.402816 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:21.402227    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-959ds" podStartSLOduration=35.275884148 podStartE2EDuration="43.402201683s" totalImagesPullingTime="8.126317535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:21.400812492 +0000 UTC m=+69.862203244" watchObservedRunningTime="2026-07-22 02:38:21.402201683 +0000 UTC m=+69.863592420"
Jul 22 02:38:22.132482 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:22.132448    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-959ds"
Jul 22 02:38:23.332116 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.332080    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-vxzpl"]
Jul 22 02:38:23.372082 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.372036    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-vxzpl"]
Jul 22 02:38:23.372263 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.372109    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:23.374592 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.374571    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hjxdw\""
Jul 22 02:38:23.374811 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.374799    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 02:38:23.375364 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.375343    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 02:38:23.513260 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.513098    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbrd\" (UniqueName: \"kubernetes.io/projected/2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28-kube-api-access-rpbrd\") pod \"downloads-5bc67dcd46-vxzpl\" (UID: \"2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28\") " pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:23.614911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.614859    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbrd\" (UniqueName: \"kubernetes.io/projected/2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28-kube-api-access-rpbrd\") pod \"downloads-5bc67dcd46-vxzpl\" (UID: \"2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28\") " pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:23.630652 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.630607    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbrd\" (UniqueName: \"kubernetes.io/projected/2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28-kube-api-access-rpbrd\") pod \"downloads-5bc67dcd46-vxzpl\" (UID: \"2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28\") " pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:23.683571 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:23.683532    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:28.367826 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.367744    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-vxzpl"]
Jul 22 02:38:28.405949 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.405770    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-vxzpl" event={"ID":"2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28","Type":"ContainerStarted","Data":"c31f382a54c58452ef976246f579da0ed8b1df5aeb966e68c879f6cb0fb4d736"}
Jul 22 02:38:28.408497 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.408467    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm" event={"ID":"66fab76f-eea7-4ece-9087-686594e9c0d1","Type":"ContainerStarted","Data":"95d495a07fcc4a8794192481867996da526a9ac283368aa78af7152a5471c246"}
Jul 22 02:38:28.917697 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.917616    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"]
Jul 22 02:38:28.930903 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.930872    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"]
Jul 22 02:38:28.931068 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.930967    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:28.933113 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.933090    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 02:38:28.933282 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.933135    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4kkcz\""
Jul 22 02:38:28.953319 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:28.953293    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dlsfk\" (UID: \"a2d7871f-4c2c-40f4-a23a-772b55b8f341\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:29.053720 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.053677    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dlsfk\" (UID: \"a2d7871f-4c2c-40f4-a23a-772b55b8f341\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:29.053897 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:29.053827    2523 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 22 02:38:29.053946 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:29.053899    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates podName:a2d7871f-4c2c-40f4-a23a-772b55b8f341 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:29.553878806 +0000 UTC m=+78.015269522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-dlsfk" (UID: "a2d7871f-4c2c-40f4-a23a-772b55b8f341") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 22 02:38:29.416912 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.416833    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v56dt" event={"ID":"291863b8-dfa2-474c-97ae-e67c79aebef2","Type":"ContainerStarted","Data":"cc092b9555f29baa81855add7ee072f6c61ca6628198d10324d6f2b68c966f4e"}
Jul 22 02:38:29.419075 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.419042    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm" event={"ID":"66fab76f-eea7-4ece-9087-686594e9c0d1","Type":"ContainerStarted","Data":"853282c247443f1613cff9b4f69bd4f69ec8713e2cd034f401081510928c3485"}
Jul 22 02:38:29.420821 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.420793    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxj8k" event={"ID":"7b54765c-d92b-43f8-9c98-8c83e4a06d8c","Type":"ContainerStarted","Data":"049ec8b6e506e2fd9f3ce04a33e45d5e95c7c009c139a447e1c2219a6afc8273"}
Jul 22 02:38:29.423907 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.423852    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdzf" event={"ID":"4362c21e-df7b-4f10-a453-888270548674","Type":"ContainerStarted","Data":"ea2ff2052bc171a9ba9291478305cbd5693374e0c4bcf3cdf27584a3d0e7552a"}
Jul 22 02:38:29.424011 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.423929    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkdzf" event={"ID":"4362c21e-df7b-4f10-a453-888270548674","Type":"ContainerStarted","Data":"41d9c39e2b1766974f47fbddea5d67705d74f7eb08b6ec4ef8071e8f62243eae"}
Jul 22 02:38:29.426745 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.426719    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvjp" event={"ID":"807688ad-af8a-43a7-b3ec-3334d9aa5eea","Type":"ContainerStarted","Data":"ed237a805673f29c68dd7251aa7a5b817f71c61480a39c14952293b9d05dbfb5"}
Jul 22 02:38:29.426986 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.426758    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvjp" event={"ID":"807688ad-af8a-43a7-b3ec-3334d9aa5eea","Type":"ContainerStarted","Data":"fcccf48e2fa27a6b552d513b256d66a590a16e3fc06ac8bd8162fe8d5020df96"}
Jul 22 02:38:29.427185 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.427165    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:29.429194 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.429167    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm" event={"ID":"203c8baf-e3f7-4837-af89-6de37a159dc7","Type":"ContainerStarted","Data":"7a8473224f67c5522af939cf398e60d5005bbca152bae8d9114ea2d14f951187"}
Jul 22 02:38:29.463725 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.463665    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j6kfm" podStartSLOduration=42.76248029 podStartE2EDuration="51.463641937s" totalImagesPullingTime="8.701161647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.44057573 +0000 UTC m=+77.901966500" watchObservedRunningTime="2026-07-22 02:38:29.463641937 +0000 UTC m=+77.925032675"
Jul 22 02:38:29.483576 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.482244    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jkdzf" podStartSLOduration=69.006455353 podStartE2EDuration="1m17.48222388s" totalImagesPullingTime="8.475768527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.481888501 +0000 UTC m=+77.943279301" watchObservedRunningTime="2026-07-22 02:38:29.48222388 +0000 UTC m=+77.943614618"
Jul 22 02:38:29.483576 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.482712    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-wdclm" podStartSLOduration=42.783537139 podStartE2EDuration="51.482700044s" totalImagesPullingTime="8.699162905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.462881952 +0000 UTC m=+77.924272709" watchObservedRunningTime="2026-07-22 02:38:29.482700044 +0000 UTC m=+77.944090780"
Jul 22 02:38:29.502173 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.502088    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fhvjp" podStartSLOduration=35.028576396 podStartE2EDuration="43.502066551s" totalImagesPullingTime="8.473490155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.500845164 +0000 UTC m=+77.962235919" watchObservedRunningTime="2026-07-22 02:38:29.502066551 +0000 UTC m=+77.963457292"
Jul 22 02:38:29.526842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.526774    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxj8k" podStartSLOduration=69.050120384 podStartE2EDuration="1m17.526749791s" totalImagesPullingTime="8.476629407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:29.525575862 +0000 UTC m=+77.986966623" watchObservedRunningTime="2026-07-22 02:38:29.526749791 +0000 UTC m=+77.988140531"
Jul 22 02:38:29.558432 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.558396    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dlsfk\" (UID: \"a2d7871f-4c2c-40f4-a23a-772b55b8f341\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:29.561533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.561502    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a2d7871f-4c2c-40f4-a23a-772b55b8f341-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-dlsfk\" (UID: \"a2d7871f-4c2c-40f4-a23a-772b55b8f341\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:29.840745 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:29.840707    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:30.013013 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:30.012977    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"]
Jul 22 02:38:30.015797 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:30.015766    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d7871f_4c2c_40f4_a23a_772b55b8f341.slice/crio-d66fd05831afd3cf430b115ee89a92586a7cdfd93a0086c679860f0c3d68bf30 WatchSource:0}: Error finding container d66fd05831afd3cf430b115ee89a92586a7cdfd93a0086c679860f0c3d68bf30: Status 404 returned error can't find the container with id d66fd05831afd3cf430b115ee89a92586a7cdfd93a0086c679860f0c3d68bf30
Jul 22 02:38:30.435295 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:30.435256    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk" event={"ID":"a2d7871f-4c2c-40f4-a23a-772b55b8f341","Type":"ContainerStarted","Data":"d66fd05831afd3cf430b115ee89a92586a7cdfd93a0086c679860f0c3d68bf30"}
Jul 22 02:38:33.452362 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.452254    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk" event={"ID":"a2d7871f-4c2c-40f4-a23a-772b55b8f341","Type":"ContainerStarted","Data":"c5fc1c9234f4810807de82acb34e73e12a273bd6ee73bc1f123779de248f5891"}
Jul 22 02:38:33.452362 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.452334    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:33.455086 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.455051    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v56dt" event={"ID":"291863b8-dfa2-474c-97ae-e67c79aebef2","Type":"ContainerStarted","Data":"0a22c040d0c4776ca385371b5842a06db57d31a3dedddee75a62603a7c9465d2"}
Jul 22 02:38:33.458186 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.458157    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk"
Jul 22 02:38:33.469127 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.469077    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-dlsfk" podStartSLOduration=2.295519317 podStartE2EDuration="5.469061285s" totalImagesPullingTime="3.173541968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:33.467850213 +0000 UTC m=+81.929240951" watchObservedRunningTime="2026-07-22 02:38:33.469061285 +0000 UTC m=+81.930452022"
Jul 22 02:38:33.486973 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.486904    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v56dt" podStartSLOduration=17.117429712 podStartE2EDuration="35.486880546s" totalImagesPullingTime="18.369450834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:37:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:33.484542038 +0000 UTC m=+81.945932774" watchObservedRunningTime="2026-07-22 02:38:33.486880546 +0000 UTC m=+81.948271265"
Jul 22 02:38:33.984207 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.984172    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"]
Jul 22 02:38:33.987793 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.987770    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:33.990606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.990579    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 02:38:33.990606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.990579    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5gjcb\""
Jul 22 02:38:33.990809 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.990629    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 02:38:33.990869 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.990850    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 02:38:33.995807 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.995779    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:33.995885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.995823    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lbp8\" (UniqueName: \"kubernetes.io/projected/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-kube-api-access-9lbp8\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:33.995885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.995848    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:33.995980 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.995926    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:33.997892 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:33.997822    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"]
Jul 22 02:38:34.097256 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.097218    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.097442 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.097270    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lbp8\" (UniqueName: \"kubernetes.io/projected/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-kube-api-access-9lbp8\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.097442 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.097301    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.097442 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.097344    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.098455 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.098435    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.100269 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.100210    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.102168 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.102131    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.105696 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.105671    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lbp8\" (UniqueName: \"kubernetes.io/projected/7238ac19-a00b-4fb2-bc36-bf566d53ffd8-kube-api-access-9lbp8\") pod \"prometheus-operator-5945b5cfd-m56b7\" (UID: \"7238ac19-a00b-4fb2-bc36-bf566d53ffd8\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.298747 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.298650    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"
Jul 22 02:38:34.451026 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:34.450994    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-m56b7"]
Jul 22 02:38:34.455347 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:34.455317    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7238ac19_a00b_4fb2_bc36_bf566d53ffd8.slice/crio-66c8f670ccce3f59bd7af7cac7eb2f2a03cb01dea91ab1338b1f428b43f8d613 WatchSource:0}: Error finding container 66c8f670ccce3f59bd7af7cac7eb2f2a03cb01dea91ab1338b1f428b43f8d613: Status 404 returned error can't find the container with id 66c8f670ccce3f59bd7af7cac7eb2f2a03cb01dea91ab1338b1f428b43f8d613
Jul 22 02:38:35.464576 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:35.464529    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7" event={"ID":"7238ac19-a00b-4fb2-bc36-bf566d53ffd8","Type":"ContainerStarted","Data":"66c8f670ccce3f59bd7af7cac7eb2f2a03cb01dea91ab1338b1f428b43f8d613"}
Jul 22 02:38:36.472171 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:36.472101    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7" event={"ID":"7238ac19-a00b-4fb2-bc36-bf566d53ffd8","Type":"ContainerStarted","Data":"78033b4043c4a838588b9a1745adca13a5d0024f8230e16dab59bee5b3e50f98"}
Jul 22 02:38:36.472643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:36.472186    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7" event={"ID":"7238ac19-a00b-4fb2-bc36-bf566d53ffd8","Type":"ContainerStarted","Data":"cb4405485395f031fffa28d895efd6a5a71f6e5d494dc4e582eb47a9d84e0dbc"}
Jul 22 02:38:36.496381 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:36.496267    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-m56b7" podStartSLOduration=1.70954162 podStartE2EDuration="3.496248502s" totalImagesPullingTime="1.786706882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:36.49554301 +0000 UTC m=+84.956933746" watchObservedRunningTime="2026-07-22 02:38:36.496248502 +0000 UTC m=+84.957639249"
Jul 22 02:38:37.430674 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.430635    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:38:37.434099 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.434066    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.436457 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.436430    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 02:38:37.436789 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.436759    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 02:38:37.437069 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.437045    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-449kn\""
Jul 22 02:38:37.437172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.437121    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 02:38:37.437227 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.437121    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 02:38:37.437227 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.437210    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 02:38:37.442237 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.442129    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 02:38:37.449239 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.449210    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:38:37.526840 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.526804    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.526872    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkgt\" (UniqueName: \"kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.526910    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.526953    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.527013    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.527066    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.527297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.527112    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628229 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628189    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628235    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkgt\" (UniqueName: \"kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628277    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628303    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628400    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628594 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628452    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.628594 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.628503    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.629177 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.629121    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.629288 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.629259    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.629612 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.629586    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.629689 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.629593    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.631636 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.631613    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.631714 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.631689    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.637623 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.637599    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkgt\" (UniqueName: \"kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt\") pod \"console-5d7f6cb66c-tkjcg\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") " pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.744819 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.744779    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:38:37.902567 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:37.902533    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:38:37.907856 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:37.907826    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242dae09_ffd5_479e_b73d_b4b5ce63693a.slice/crio-000bcf5031570ec307421b00af87ae7f3e78f1c4c22c1f8c4d53352a7ec2bf3f WatchSource:0}: Error finding container 000bcf5031570ec307421b00af87ae7f3e78f1c4c22c1f8c4d53352a7ec2bf3f: Status 404 returned error can't find the container with id 000bcf5031570ec307421b00af87ae7f3e78f1c4c22c1f8c4d53352a7ec2bf3f
Jul 22 02:38:38.451404 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.449732    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zkbqb"]
Jul 22 02:38:38.453643 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.453619    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.456071 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.456026    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 02:38:38.456071 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.456028    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 02:38:38.456300 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.456238    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 02:38:38.456352 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.456240    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9tpt9\""
Jul 22 02:38:38.495732 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.495695    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f6cb66c-tkjcg" event={"ID":"242dae09-ffd5-479e-b73d-b4b5ce63693a","Type":"ContainerStarted","Data":"000bcf5031570ec307421b00af87ae7f3e78f1c4c22c1f8c4d53352a7ec2bf3f"}
Jul 22 02:38:38.537743 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537696    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-wtmp\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537760    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537800    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-root\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537827    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-sys\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537872    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-textfile\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537903    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537928    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537942    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-metrics-client-ca\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.538225 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.537968    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cslbc\" (UniqueName: \"kubernetes.io/projected/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-kube-api-access-cslbc\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639454 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639393    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-root\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639454 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639446    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-sys\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639489    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-textfile\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639524    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639534    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-root\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639550    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:38.639649    2523 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639709    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-sys\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.639911 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:38.639726    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls podName:0634b6b1-6105-4ba6-b2eb-e5a8de523bbb nodeName:}" failed. No retries permitted until 2026-07-22 02:38:39.139705464 +0000 UTC m=+87.601096205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls") pod "node-exporter-zkbqb" (UID: "0634b6b1-6105-4ba6-b2eb-e5a8de523bbb") : secret "node-exporter-tls" not found
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.639981    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-metrics-client-ca\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640022    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-textfile\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640162    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cslbc\" (UniqueName: \"kubernetes.io/projected/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-kube-api-access-cslbc\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640196    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-wtmp\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640244    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640356    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-accelerators-collector-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640516 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640370    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-wtmp\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.640723 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.640695    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-metrics-client-ca\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.643175 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.643091    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:38.649533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:38.649497    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cslbc\" (UniqueName: \"kubernetes.io/projected/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-kube-api-access-cslbc\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:39.145272 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:39.145228    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:39.147978 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:39.147949    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0634b6b1-6105-4ba6-b2eb-e5a8de523bbb-node-exporter-tls\") pod \"node-exporter-zkbqb\" (UID: \"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb\") " pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:39.366752 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:39.366712    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zkbqb"
Jul 22 02:38:40.443808 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.443772    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fhvjp"
Jul 22 02:38:40.568833 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.568801    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"]
Jul 22 02:38:40.572654 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.572626    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.576820 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.576794    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 02:38:40.577383 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577363    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 02:38:40.577517 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577416    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 02:38:40.577517 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577483    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 02:38:40.577628 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577517    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 02:38:40.577778 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577760    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cr14otbjd82oh\""
Jul 22 02:38:40.577853 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.577845    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4txgt\""
Jul 22 02:38:40.589534 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.589505    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"]
Jul 22 02:38:40.660045 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660007    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660264 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660071    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660264 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660102    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dada40f-9e9d-4193-aacc-663dda148ea5-metrics-client-ca\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660264 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660155    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660264 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660220    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9f75\" (UniqueName: \"kubernetes.io/projected/2dada40f-9e9d-4193-aacc-663dda148ea5-kube-api-access-r9f75\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660288    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660315    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-grpc-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.660415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.660347    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761079 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761044    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761079 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761085    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9f75\" (UniqueName: \"kubernetes.io/projected/2dada40f-9e9d-4193-aacc-663dda148ea5-kube-api-access-r9f75\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761124    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761164    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-grpc-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761190    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761219    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761267    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.761355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.761296    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dada40f-9e9d-4193-aacc-663dda148ea5-metrics-client-ca\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.762050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.762021    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2dada40f-9e9d-4193-aacc-663dda148ea5-metrics-client-ca\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.764595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.764540    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.764836 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.764788    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.764953 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.764900    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.765045 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.765024    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-grpc-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.765435 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.765411    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.765832 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.765816    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2dada40f-9e9d-4193-aacc-663dda148ea5-secret-thanos-querier-tls\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.772844 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.772812    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9f75\" (UniqueName: \"kubernetes.io/projected/2dada40f-9e9d-4193-aacc-663dda148ea5-kube-api-access-r9f75\") pod \"thanos-querier-5f8d874fd5-wb9xk\" (UID: \"2dada40f-9e9d-4193-aacc-663dda148ea5\") " pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:40.884596 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:40.884556    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:41.381065 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:41.381036    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:38:43.174237 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.174202    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"]
Jul 22 02:38:43.257114 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.257080    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"]
Jul 22 02:38:43.257344 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.257252    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.260697 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.260660    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 02:38:43.261387 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.261362    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z7n4n\""
Jul 22 02:38:43.287096 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.287053    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qj9\" (UniqueName: \"kubernetes.io/projected/d50ac9e4-cd56-471c-8fe7-b202277a02d8-kube-api-access-24qj9\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.287299 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.287106    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.388445 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.388407    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qj9\" (UniqueName: \"kubernetes.io/projected/d50ac9e4-cd56-471c-8fe7-b202277a02d8-kube-api-access-24qj9\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.388615 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.388460    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.388615 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:43.388599    2523 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 22 02:38:43.388732 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:38:43.388684    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert podName:d50ac9e4-cd56-471c-8fe7-b202277a02d8 nodeName:}" failed. No retries permitted until 2026-07-22 02:38:43.888660756 +0000 UTC m=+92.350051475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-z65rr" (UID: "d50ac9e4-cd56-471c-8fe7-b202277a02d8") : secret "monitoring-plugin-cert" not found
Jul 22 02:38:43.405012 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.404982    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qj9\" (UniqueName: \"kubernetes.io/projected/d50ac9e4-cd56-471c-8fe7-b202277a02d8-kube-api-access-24qj9\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.893774 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.893738    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:43.896843 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:43.896809    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d50ac9e4-cd56-471c-8fe7-b202277a02d8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-z65rr\" (UID: \"d50ac9e4-cd56-471c-8fe7-b202277a02d8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:44.170884 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:44.170792    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:46.049929 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:46.049883    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:38:48.273331 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:48.272697    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0634b6b1_6105_4ba6_b2eb_e5a8de523bbb.slice/crio-35244b9441458c0888686a338708cc2f781ad99c664d1a641dee7e652749f715 WatchSource:0}: Error finding container 35244b9441458c0888686a338708cc2f781ad99c664d1a641dee7e652749f715: Status 404 returned error can't find the container with id 35244b9441458c0888686a338708cc2f781ad99c664d1a641dee7e652749f715
Jul 22 02:38:48.436183 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.436136    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"]
Jul 22 02:38:48.437863 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:48.437825    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dada40f_9e9d_4193_aacc_663dda148ea5.slice/crio-0b68ee85e52305797f12d083cfbe79bde51025188abe161febbfa769c6cb01d1 WatchSource:0}: Error finding container 0b68ee85e52305797f12d083cfbe79bde51025188abe161febbfa769c6cb01d1: Status 404 returned error can't find the container with id 0b68ee85e52305797f12d083cfbe79bde51025188abe161febbfa769c6cb01d1
Jul 22 02:38:48.448775 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.448746    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"]
Jul 22 02:38:48.451885 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:38:48.451859    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50ac9e4_cd56_471c_8fe7_b202277a02d8.slice/crio-d6a26c81c23ebb8d1d342867b546de45471792f20d54e4a1700395d4c980571f WatchSource:0}: Error finding container d6a26c81c23ebb8d1d342867b546de45471792f20d54e4a1700395d4c980571f: Status 404 returned error can't find the container with id d6a26c81c23ebb8d1d342867b546de45471792f20d54e4a1700395d4c980571f
Jul 22 02:38:48.519154 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.519062    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:38:48.547540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.547462    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-vxzpl" event={"ID":"2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28","Type":"ContainerStarted","Data":"798e6ab645b07f90d6430e1ed95aeeaa22779ae26e277e5304cbac4b15166d85"}
Jul 22 02:38:48.548393 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.548374    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:48.549846 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.549680    2523 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-vxzpl container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused" start-of-body=
Jul 22 02:38:48.549846 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.549720    2523 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-vxzpl" podUID="2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.19:8080/\": dial tcp 10.132.0.19:8080: connect: connection refused"
Jul 22 02:38:48.550470 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.550445    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr" event={"ID":"d50ac9e4-cd56-471c-8fe7-b202277a02d8","Type":"ContainerStarted","Data":"d6a26c81c23ebb8d1d342867b546de45471792f20d54e4a1700395d4c980571f"}
Jul 22 02:38:48.552044 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.552021    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"0b68ee85e52305797f12d083cfbe79bde51025188abe161febbfa769c6cb01d1"}
Jul 22 02:38:48.553500 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.553444    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkbqb" event={"ID":"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb","Type":"ContainerStarted","Data":"35244b9441458c0888686a338708cc2f781ad99c664d1a641dee7e652749f715"}
Jul 22 02:38:48.555361 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.555340    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f6cb66c-tkjcg" event={"ID":"242dae09-ffd5-479e-b73d-b4b5ce63693a","Type":"ContainerStarted","Data":"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"}
Jul 22 02:38:48.569438 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.569365    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-vxzpl" podStartSLOduration=5.682017474 podStartE2EDuration="25.569292342s" totalImagesPullingTime="19.887274868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:48.567411635 +0000 UTC m=+97.028802373" watchObservedRunningTime="2026-07-22 02:38:48.569292342 +0000 UTC m=+97.030683080"
Jul 22 02:38:48.594757 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:48.594699    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7f6cb66c-tkjcg" podStartSLOduration=1.228786194 podStartE2EDuration="11.594678094s" totalImagesPullingTime="10.3658919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:48.587417373 +0000 UTC m=+97.048808110" watchObservedRunningTime="2026-07-22 02:38:48.594678094 +0000 UTC m=+97.056068831"
Jul 22 02:38:49.571541 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:49.571503    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-vxzpl"
Jul 22 02:38:50.568627 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:50.568589    2523 generic.go:356] "Generic (PLEG): container finished" podID="0634b6b1-6105-4ba6-b2eb-e5a8de523bbb" containerID="009e1b0c1db1d12c106d0335750cbb63a92e723e0a0cd20a929ee53b13f586b4" exitCode=0
Jul 22 02:38:50.569499 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:50.569215    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkbqb" event={"ID":"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb","Type":"ContainerDied","Data":"009e1b0c1db1d12c106d0335750cbb63a92e723e0a0cd20a929ee53b13f586b4"}
Jul 22 02:38:52.380707 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.380598    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bzph8"
Jul 22 02:38:52.582343 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.582304    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr" event={"ID":"d50ac9e4-cd56-471c-8fe7-b202277a02d8","Type":"ContainerStarted","Data":"7e83eebaf7828028e2e2cc02760bf63910a9f08f7fb38317c2eb09cc7702ab46"}
Jul 22 02:38:52.582824 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.582802    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:52.585087 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.584855    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"11f8b01e7da0c5b67610572448ac8947a87c603e3d6ff70ca9e6a7ee925fd0a2"}
Jul 22 02:38:52.585229 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.585165    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"67b6da67fbb4271b6daa1da90b400de46335419522bd41c228297fcbd3803ed7"}
Jul 22 02:38:52.587561 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.587536    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkbqb" event={"ID":"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb","Type":"ContainerStarted","Data":"ce92e406ba1e2e5ef431479c82a150049fdd22259d68c4feac0543d78db5d105"}
Jul 22 02:38:52.587671 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.587583    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zkbqb" event={"ID":"0634b6b1-6105-4ba6-b2eb-e5a8de523bbb","Type":"ContainerStarted","Data":"9814dfbe16c54a3aecc84c45e4d9b92058ca57e316606126ee58d5a92442e3df"}
Jul 22 02:38:52.588694 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.588674    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr"
Jul 22 02:38:52.602633 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.602569    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-z65rr" podStartSLOduration=5.873137691 podStartE2EDuration="9.602551858s" totalImagesPullingTime="3.729414167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:52.60069163 +0000 UTC m=+101.062082393" watchObservedRunningTime="2026-07-22 02:38:52.602551858 +0000 UTC m=+101.063942594"
Jul 22 02:38:52.622190 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:52.622102    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zkbqb" podStartSLOduration=13.102362689 podStartE2EDuration="14.622083238s" totalImagesPullingTime="1.354221443s" totalInitContainerRuntime="165.499106ms" isStatefulPod=true podCreationTimestamp="2026-07-22 02:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:52.620711111 +0000 UTC m=+101.082101903" watchObservedRunningTime="2026-07-22 02:38:52.622083238 +0000 UTC m=+101.083473975"
Jul 22 02:38:53.596061 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:53.596027    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"07e04af3de422b530a411df5ad873e418392479f7e3c74dc98d5e51d05b66ffb"}
Jul 22 02:38:54.604121 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:54.604027    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"3873a1cfe0100809f3a7729a0c3385897a98fed0ad858249ee570c181ce5bd7c"}
Jul 22 02:38:54.604625 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:54.604122    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"7009529d2f9895fb1e050a557df0d5e232093b4b0f46d77701d66cae53578eb6"}
Jul 22 02:38:54.604625 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:54.604199    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" event={"ID":"2dada40f-9e9d-4193-aacc-663dda148ea5","Type":"ContainerStarted","Data":"5b4553f05783de0158fecc2ee2079b125b81959c9009abdfdd633ee782f33319"}
Jul 22 02:38:54.632531 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:54.632463    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk" podStartSLOduration=9.560816042 podStartE2EDuration="14.632440048s" totalImagesPullingTime="5.071624006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:38:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:38:54.630475503 +0000 UTC m=+103.091866267" watchObservedRunningTime="2026-07-22 02:38:54.632440048 +0000 UTC m=+103.093830784"
Jul 22 02:38:55.609216 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:55.609177    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:38:57.745679 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:38:57.745635    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:39:01.619289 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:01.619256    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f8d874fd5-wb9xk"
Jul 22 02:39:08.662945 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:08.662905    2523 generic.go:356] "Generic (PLEG): container finished" podID="c4908d57-875b-463c-8120-03ba5e42a17a" containerID="b349a72b27f8411d5f29018a5f42c0b4952749ad8c2157026e33ea3b21574a4c" exitCode=0
Jul 22 02:39:08.663456 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:08.662979    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk" event={"ID":"c4908d57-875b-463c-8120-03ba5e42a17a","Type":"ContainerDied","Data":"b349a72b27f8411d5f29018a5f42c0b4952749ad8c2157026e33ea3b21574a4c"}
Jul 22 02:39:08.663456 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:08.663331    2523 scope.go:117] "RemoveContainer" containerID="b349a72b27f8411d5f29018a5f42c0b4952749ad8c2157026e33ea3b21574a4c"
Jul 22 02:39:09.669163 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:09.669118    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7kgk" event={"ID":"c4908d57-875b-463c-8120-03ba5e42a17a","Type":"ContainerStarted","Data":"b5611dfb57e1db60e78220d3ca87bafe7e887695ab85146d90477baba229d750"}
Jul 22 02:39:13.544628 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.544574    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" podUID="ca11e329-c543-4af8-8091-6634f04fa622" containerName="registry" containerID="cri-o://653db7aa90edfcb43e2e849cf9d72e6c375f2feeaa7ead452debde9746e5c15c" gracePeriod=30
Jul 22 02:39:13.579398 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.579319    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7f6cb66c-tkjcg" podUID="242dae09-ffd5-479e-b73d-b4b5ce63693a" containerName="console" containerID="cri-o://0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544" gracePeriod=15
Jul 22 02:39:13.690732 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.690694    2523 generic.go:356] "Generic (PLEG): container finished" podID="ca11e329-c543-4af8-8091-6634f04fa622" containerID="653db7aa90edfcb43e2e849cf9d72e6c375f2feeaa7ead452debde9746e5c15c" exitCode=0
Jul 22 02:39:13.690882 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.690764    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" event={"ID":"ca11e329-c543-4af8-8091-6634f04fa622","Type":"ContainerDied","Data":"653db7aa90edfcb43e2e849cf9d72e6c375f2feeaa7ead452debde9746e5c15c"}
Jul 22 02:39:13.892966 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.892925    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:39:13.919814 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:13.919781    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:39:14.071540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071446    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071493    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071512    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071542    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071572    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071613    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071656    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071689    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxkgt\" (UniqueName: \"kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt\") pod \"242dae09-ffd5-479e-b73d-b4b5ce63693a\" (UID: \"242dae09-ffd5-479e-b73d-b4b5ce63693a\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071713    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071778    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.071852 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071813    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071872    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhvc9\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071880    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071898    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071899    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca" (OuterVolumeSpecName: "service-ca") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071923    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071927    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config" (OuterVolumeSpecName: "console-config") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.072208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.071960    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token\") pod \"ca11e329-c543-4af8-8091-6634f04fa622\" (UID: \"ca11e329-c543-4af8-8091-6634f04fa622\") "
Jul 22 02:39:14.072533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072283    2523 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-trusted-ca-bundle\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.072533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072308    2523 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.072533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072320    2523 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-config\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.072533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072338    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.072533 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072459    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.072831 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.072802    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:39:14.075319 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.075280    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt" (OuterVolumeSpecName: "kube-api-access-xxkgt") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "kube-api-access-xxkgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:39:14.075476 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.075434    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9" (OuterVolumeSpecName: "kube-api-access-zhvc9") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "kube-api-access-zhvc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:39:14.075564 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.075530    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:39:14.075670 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.075649    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:39:14.075740 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.075667    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "242dae09-ffd5-479e-b73d-b4b5ce63693a" (UID: "242dae09-ffd5-479e-b73d-b4b5ce63693a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:39:14.076203 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.076173    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:39:14.076323 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.076264    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:39:14.076424 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.076406    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:39:14.082137 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.082108    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ca11e329-c543-4af8-8091-6634f04fa622" (UID: "ca11e329-c543-4af8-8091-6634f04fa622"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:39:14.172709 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172670    2523 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-serving-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172709 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172714    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxkgt\" (UniqueName: \"kubernetes.io/projected/242dae09-ffd5-479e-b73d-b4b5ce63693a-kube-api-access-xxkgt\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172709 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172724    2523 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-registry-certificates\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172734    2523 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-image-registry-private-configuration\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172745    2523 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca11e329-c543-4af8-8091-6634f04fa622-trusted-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172757    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhvc9\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-kube-api-access-zhvc9\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172765    2523 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca11e329-c543-4af8-8091-6634f04fa622-installation-pull-secrets\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172773    2523 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca11e329-c543-4af8-8091-6634f04fa622-ca-trust-extracted\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172782    2523 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-bound-sa-token\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172789    2523 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/242dae09-ffd5-479e-b73d-b4b5ce63693a-console-oauth-config\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172797    2523 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca11e329-c543-4af8-8091-6634f04fa622-registry-tls\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.172947 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.172804    2523 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/242dae09-ffd5-479e-b73d-b4b5ce63693a-oauth-serving-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:39:14.696078 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.696048    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59"
Jul 22 02:39:14.696573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.696051    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65dd5f696d-d7d59" event={"ID":"ca11e329-c543-4af8-8091-6634f04fa622","Type":"ContainerDied","Data":"8de8dafc52670320adeacdeb4cdf756ab1e5baeda57ad56246600048f334ba01"}
Jul 22 02:39:14.696573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.696206    2523 scope.go:117] "RemoveContainer" containerID="653db7aa90edfcb43e2e849cf9d72e6c375f2feeaa7ead452debde9746e5c15c"
Jul 22 02:39:14.697688 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.697638    2523 generic.go:356] "Generic (PLEG): container finished" podID="242dae09-ffd5-479e-b73d-b4b5ce63693a" containerID="0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544" exitCode=0
Jul 22 02:39:14.697688 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.697682    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7f6cb66c-tkjcg"
Jul 22 02:39:14.697809 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.697700    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f6cb66c-tkjcg" event={"ID":"242dae09-ffd5-479e-b73d-b4b5ce63693a","Type":"ContainerDied","Data":"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"}
Jul 22 02:39:14.697809 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.697737    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7f6cb66c-tkjcg" event={"ID":"242dae09-ffd5-479e-b73d-b4b5ce63693a","Type":"ContainerDied","Data":"000bcf5031570ec307421b00af87ae7f3e78f1c4c22c1f8c4d53352a7ec2bf3f"}
Jul 22 02:39:14.705119 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.704999    2523 scope.go:117] "RemoveContainer" containerID="0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"
Jul 22 02:39:14.713738 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.713718    2523 scope.go:117] "RemoveContainer" containerID="0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"
Jul 22 02:39:14.714108 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:39:14.714084    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544\": container with ID starting with 0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544 not found: ID does not exist" containerID="0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"
Jul 22 02:39:14.714209 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.714119    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544"} err="failed to get container status \"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544\": rpc error: code = NotFound desc = could not find container \"0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544\": container with ID starting with 0281bcfb463c94861388f906dd9245853782dd3015f4b1a1efdb1bc8d8844544 not found: ID does not exist"
Jul 22 02:39:14.720927 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.720897    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:39:14.728618 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.728592    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65dd5f696d-d7d59"]
Jul 22 02:39:14.738272 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.738241    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:39:14.744867 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:14.744835    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7f6cb66c-tkjcg"]
Jul 22 02:39:15.956411 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:15.956378    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242dae09-ffd5-479e-b73d-b4b5ce63693a" path="/var/lib/kubelet/pods/242dae09-ffd5-479e-b73d-b4b5ce63693a/volumes"
Jul 22 02:39:15.956854 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:15.956768    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca11e329-c543-4af8-8091-6634f04fa622" path="/var/lib/kubelet/pods/ca11e329-c543-4af8-8091-6634f04fa622/volumes"
Jul 22 02:39:22.732431 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:22.732395    2523 generic.go:356] "Generic (PLEG): container finished" podID="af2bffc8-82ca-45d0-bc1b-e976919cf59a" containerID="f0d4f8aa707ed601a77c097ab6c179c5471d3e042099c529d253afb26be37873" exitCode=0
Jul 22 02:39:22.732833 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:22.732445    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv" event={"ID":"af2bffc8-82ca-45d0-bc1b-e976919cf59a","Type":"ContainerDied","Data":"f0d4f8aa707ed601a77c097ab6c179c5471d3e042099c529d253afb26be37873"}
Jul 22 02:39:22.732833 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:22.732777    2523 scope.go:117] "RemoveContainer" containerID="f0d4f8aa707ed601a77c097ab6c179c5471d3e042099c529d253afb26be37873"
Jul 22 02:39:23.739003 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:23.738968    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-v7pxv" event={"ID":"af2bffc8-82ca-45d0-bc1b-e976919cf59a","Type":"ContainerStarted","Data":"1360ad1bee53bab4b26f797b37607ae2197f4674d111020d05daacecceb1f248"}
Jul 22 02:39:28.759388 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:28.759354    2523 generic.go:356] "Generic (PLEG): container finished" podID="b1a60811-090e-48aa-8abc-3572429356b5" containerID="a8c43ff8fe41f5e64d990ff4a54442104b5007af628444facf751d3399be7818" exitCode=0
Jul 22 02:39:28.759818 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:28.759432    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tzw5k" event={"ID":"b1a60811-090e-48aa-8abc-3572429356b5","Type":"ContainerDied","Data":"a8c43ff8fe41f5e64d990ff4a54442104b5007af628444facf751d3399be7818"}
Jul 22 02:39:28.759818 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:28.759800    2523 scope.go:117] "RemoveContainer" containerID="a8c43ff8fe41f5e64d990ff4a54442104b5007af628444facf751d3399be7818"
Jul 22 02:39:29.764869 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:39:29.764834    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-tzw5k" event={"ID":"b1a60811-090e-48aa-8abc-3572429356b5","Type":"ContainerStarted","Data":"c3ce42c76ed10e6b126d3ce51a2ab5f55fb8af9503480be94848fa79c1c4abb5"}
Jul 22 02:40:00.672454 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672419    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672776    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca11e329-c543-4af8-8091-6634f04fa622" containerName="registry"
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672790    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca11e329-c543-4af8-8091-6634f04fa622" containerName="registry"
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672806    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242dae09-ffd5-479e-b73d-b4b5ce63693a" containerName="console"
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672812    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="242dae09-ffd5-479e-b73d-b4b5ce63693a" containerName="console"
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672858    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca11e329-c543-4af8-8091-6634f04fa622" containerName="registry"
Jul 22 02:40:00.672918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.672867    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="242dae09-ffd5-479e-b73d-b4b5ce63693a" containerName="console"
Jul 22 02:40:00.678028 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.678011    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.682644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682616    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 02:40:00.682644 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682614    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 02:40:00.682865 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682616    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 02:40:00.682865 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682732    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 02:40:00.682865 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682778    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 02:40:00.683020 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682880    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 02:40:00.683020 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.682938    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 02:40:00.683163 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.683122    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 02:40:00.683253 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.683239    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5nv8r\""
Jul 22 02:40:00.687723 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.687704    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 02:40:00.709017 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.708995    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:40:00.744282 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744247    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744282 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744292    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5szx\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-kube-api-access-x5szx\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744318    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744334    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744423    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744514    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744542    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744569    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744608    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744636    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-config-out\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744659    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744683    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-web-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.744784 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.744725    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845105 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845069    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845105 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845106    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845340 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845136    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845377 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845338    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845426 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845375    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-config-out\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845426 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845396    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845426 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845420    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-web-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845574 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845453    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845574 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845483    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845574 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845521    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5szx\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-kube-api-access-x5szx\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845574 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845567    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845763 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845595    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.845763 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.845628    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.846338 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.846313    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.848446 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848367    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.848558 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848484    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.848610 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848581    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-config-out\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.848725 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848703    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.848855 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848815    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.849014 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.848980    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0248a432-05b2-45cc-91af-4f4c6542141e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.849114 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.849095    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.849258 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.849238    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-web-config\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.849297 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.849244    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0248a432-05b2-45cc-91af-4f4c6542141e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.849386 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.849368    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0248a432-05b2-45cc-91af-4f4c6542141e-config-volume\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.850867 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.850847    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.857836 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.857813    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5szx\" (UniqueName: \"kubernetes.io/projected/0248a432-05b2-45cc-91af-4f4c6542141e-kube-api-access-x5szx\") pod \"alertmanager-main-0\" (UID: \"0248a432-05b2-45cc-91af-4f4c6542141e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:00.988751 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:00.988716    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 02:40:01.148172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:01.147352    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 02:40:01.894500 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:01.894462    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"aa1fdb02456901f7c404554a749b3c2da9b3890fa2635489d9237c81d1d3a4fa"}
Jul 22 02:40:02.903281 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:02.903189    2523 generic.go:356] "Generic (PLEG): container finished" podID="0248a432-05b2-45cc-91af-4f4c6542141e" containerID="4b2950406f67ea813b7e9df486bc7a60e3c4effb9e65b3549f865dce5707eb4f" exitCode=0
Jul 22 02:40:02.903281 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:02.903261    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerDied","Data":"4b2950406f67ea813b7e9df486bc7a60e3c4effb9e65b3549f865dce5707eb4f"}
Jul 22 02:40:03.021368 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.021331    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"]
Jul 22 02:40:03.025703 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.025672    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.028423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.028398    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fmm5r\""
Jul 22 02:40:03.028889 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.028862    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 02:40:03.029029 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.028994    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 02:40:03.029121 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.029100    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 02:40:03.029931 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.029898    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 02:40:03.031347 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.031303    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 02:40:03.037197 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.037173    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 02:40:03.050245 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.050215    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"]
Jul 22 02:40:03.167877 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.167773    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-telemeter-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.167877 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.167833    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.167918    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-federate-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.167954    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8gn5\" (UniqueName: \"kubernetes.io/projected/72dfb696-fc54-4245-abcc-da987587b214-kube-api-access-w8gn5\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.167987    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.168010    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-serving-certs-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.168049    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.168085 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.168081    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-metrics-client-ca\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.268752 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268709    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.268752 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268752    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-serving-certs-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269004 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268788    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269004 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268811    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-metrics-client-ca\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269004 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268839    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-telemeter-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269004 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.268867    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269306 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.269019    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-federate-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269306 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.269065    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8gn5\" (UniqueName: \"kubernetes.io/projected/72dfb696-fc54-4245-abcc-da987587b214-kube-api-access-w8gn5\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.269803 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.269591    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-serving-certs-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.270017 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.269990    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-metrics-client-ca\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.270304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.270282    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72dfb696-fc54-4245-abcc-da987587b214-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.271595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.271568    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-telemeter-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.271700 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.271568    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.271700 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.271675    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-federate-client-tls\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.271792 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.271698    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72dfb696-fc54-4245-abcc-da987587b214-secret-telemeter-client\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.280847 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.280827    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8gn5\" (UniqueName: \"kubernetes.io/projected/72dfb696-fc54-4245-abcc-da987587b214-kube-api-access-w8gn5\") pod \"telemeter-client-84f7fbbb9f-kbdk2\" (UID: \"72dfb696-fc54-4245-abcc-da987587b214\") " pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.337094 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.337053    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"
Jul 22 02:40:03.522177 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.522028    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2"]
Jul 22 02:40:03.532194 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:40:03.532160    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72dfb696_fc54_4245_abcc_da987587b214.slice/crio-c4078fbd59cb87e90209fc127130d9b37642e0388080f4e986fa1f2927c90d1a WatchSource:0}: Error finding container c4078fbd59cb87e90209fc127130d9b37642e0388080f4e986fa1f2927c90d1a: Status 404 returned error can't find the container with id c4078fbd59cb87e90209fc127130d9b37642e0388080f4e986fa1f2927c90d1a
Jul 22 02:40:03.909602 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:03.909566    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2" event={"ID":"72dfb696-fc54-4245-abcc-da987587b214","Type":"ContainerStarted","Data":"c4078fbd59cb87e90209fc127130d9b37642e0388080f4e986fa1f2927c90d1a"}
Jul 22 02:40:04.920170 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920106    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"403c736e6c6fed9be873c4548cd45c2a873651ac149acc4b28e0687f17690c30"}
Jul 22 02:40:04.920637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920219    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"bf2c41b60a46803d1d7d49dbae81abc3c9bcbd4af395d428a5afbbc5cc636034"}
Jul 22 02:40:04.920637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920263    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"e15855ff970078072590f0c7a93e151673478a49af9790f21ce6cc72a39229c5"}
Jul 22 02:40:04.920637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920301    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"fd52551ce5d11bf5ff862ca71223714904a78dfba815b6d79c4628219b2a9711"}
Jul 22 02:40:04.920637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920341    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"7bfa84828090b9f1948e45787340025cb3cc75f3d3e1211b5d215ab5c6aa82ca"}
Jul 22 02:40:04.920637 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.920376    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0248a432-05b2-45cc-91af-4f4c6542141e","Type":"ContainerStarted","Data":"2fbf1d0ac3f919391567a0d258e9dc1e394502edd0f1d9d612e649c25c7bfdaf"}
Jul 22 02:40:04.957452 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:04.957335    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.0770074689999998 podStartE2EDuration="4.95731112s" totalImagesPullingTime="2.866146247s" totalInitContainerRuntime="14.157404ms" isStatefulPod=false podCreationTimestamp="2026-07-22 02:40:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:40:04.954053589 +0000 UTC m=+173.415444364" watchObservedRunningTime="2026-07-22 02:40:04.95731112 +0000 UTC m=+173.418701860"
Jul 22 02:40:05.926547 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:05.926516    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2" event={"ID":"72dfb696-fc54-4245-abcc-da987587b214","Type":"ContainerStarted","Data":"8ecbc754b9f94d1e631e627322bd376b77c54ef6b206e2d3398970ec5643322d"}
Jul 22 02:40:06.933237 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:06.933195    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2" event={"ID":"72dfb696-fc54-4245-abcc-da987587b214","Type":"ContainerStarted","Data":"7f62fd919e81de5fa8562610df52130791ca92cd2a875ad12b5ccc323db05e0c"}
Jul 22 02:40:06.933726 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:06.933260    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2" event={"ID":"72dfb696-fc54-4245-abcc-da987587b214","Type":"ContainerStarted","Data":"50670e04de75593d888b7aa15ed6914d64ed731b0155c77dc45343348d08f30a"}
Jul 22 02:40:06.980172 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:40:06.980098    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84f7fbbb9f-kbdk2" podStartSLOduration=1.6812741500000001 podStartE2EDuration="3.980079388s" totalImagesPullingTime="2.298805238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:40:06.978684361 +0000 UTC m=+175.440075097" watchObservedRunningTime="2026-07-22 02:40:06.980079388 +0000 UTC m=+175.441470125"
Jul 22 02:42:11.870249 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:11.870216    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:42:11.873414 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:11.873374    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:42:11.873579 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:11.873428    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:42:11.876623 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:11.876602    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:42:11.881379 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:11.881357    2523 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 02:42:48.967601 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.967561    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"]
Jul 22 02:42:48.971068 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.971052    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:48.973776 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.973751    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jz75q\""
Jul 22 02:42:48.974043 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.974025    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 22 02:42:48.974294 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.974278    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 22 02:42:48.988018 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:48.987987    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"]
Jul 22 02:42:49.056534 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.056496    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.056728 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.056548    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.056728 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.056583    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mpw\" (UniqueName: \"kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.157171 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.157091    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.157345 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.157204    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.157345 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.157248    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mpw\" (UniqueName: \"kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.157498 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.157481    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.157599 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.157579    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.166996 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.166966    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mpw\" (UniqueName: \"kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.280741 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.280645    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:42:49.440767 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.440742    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"]
Jul 22 02:42:49.442877 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:42:49.442844    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5b46c3_2166_4f6e_a7c5_c2822661ad85.slice/crio-0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e WatchSource:0}: Error finding container 0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e: Status 404 returned error can't find the container with id 0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e
Jul 22 02:42:49.444860 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.444843    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:42:49.608361 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:49.608275    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq" event={"ID":"0c5b46c3-2166-4f6e-a7c5-c2822661ad85","Type":"ContainerStarted","Data":"0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e"}
Jul 22 02:42:55.637925 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:55.637891    2523 generic.go:356] "Generic (PLEG): container finished" podID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerID="0f7574262b78d9aac0040cc5c7924c445d5534e2271663ede78ebabff3734877" exitCode=0
Jul 22 02:42:55.638355 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:55.637974    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq" event={"ID":"0c5b46c3-2166-4f6e-a7c5-c2822661ad85","Type":"ContainerDied","Data":"0f7574262b78d9aac0040cc5c7924c445d5534e2271663ede78ebabff3734877"}
Jul 22 02:42:58.651730 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:58.651689    2523 generic.go:356] "Generic (PLEG): container finished" podID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerID="6661b7521450eaaa22e981dcbba1e3264f85a7de0e23b0b60c4c9d18a7c7a768" exitCode=0
Jul 22 02:42:58.652188 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:42:58.651760    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq" event={"ID":"0c5b46c3-2166-4f6e-a7c5-c2822661ad85","Type":"ContainerDied","Data":"6661b7521450eaaa22e981dcbba1e3264f85a7de0e23b0b60c4c9d18a7c7a768"}
Jul 22 02:43:00.794697 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.794660    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lnhq7"]
Jul 22 02:43:00.799193 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.799165    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.801594 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.801573    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 02:43:00.802003 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.801983    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8rwfx\""
Jul 22 02:43:00.802107 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.802002    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 02:43:00.813632 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.813602    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lnhq7"]
Jul 22 02:43:00.865419 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.865376    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hn2\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-kube-api-access-d7hn2\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.865598 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.865447    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-bound-sa-token\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.966749 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.966706    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hn2\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-kube-api-access-d7hn2\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.966940 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.966798    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-bound-sa-token\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.976828 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.976769    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hn2\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-kube-api-access-d7hn2\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:00.977584 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:00.977535    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6dc8e591-2573-4904-b583-ca5b4505376d-bound-sa-token\") pod \"cert-manager-55b4d954d5-lnhq7\" (UID: \"6dc8e591-2573-4904-b583-ca5b4505376d\") " pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:01.120749 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:01.120663    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lnhq7"
Jul 22 02:43:01.281317 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:01.281288    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lnhq7"]
Jul 22 02:43:01.283881 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:01.283847    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dc8e591_2573_4904_b583_ca5b4505376d.slice/crio-749b4a855d1d5dcb8f14074edae6cf4d70041aac2ffbf994227f42f22b8b4aff WatchSource:0}: Error finding container 749b4a855d1d5dcb8f14074edae6cf4d70041aac2ffbf994227f42f22b8b4aff: Status 404 returned error can't find the container with id 749b4a855d1d5dcb8f14074edae6cf4d70041aac2ffbf994227f42f22b8b4aff
Jul 22 02:43:01.667270 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:01.667226    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lnhq7" event={"ID":"6dc8e591-2573-4904-b583-ca5b4505376d","Type":"ContainerStarted","Data":"749b4a855d1d5dcb8f14074edae6cf4d70041aac2ffbf994227f42f22b8b4aff"}
Jul 22 02:43:07.700822 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:07.700788    2523 generic.go:356] "Generic (PLEG): container finished" podID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerID="63b6f871d3b496f695b163b8c351d25f85023e787deec95bf0a8315368f4fed2" exitCode=0
Jul 22 02:43:07.701316 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:07.700877    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq" event={"ID":"0c5b46c3-2166-4f6e-a7c5-c2822661ad85","Type":"ContainerDied","Data":"63b6f871d3b496f695b163b8c351d25f85023e787deec95bf0a8315368f4fed2"}
Jul 22 02:43:07.702372 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:07.702353    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lnhq7" event={"ID":"6dc8e591-2573-4904-b583-ca5b4505376d","Type":"ContainerStarted","Data":"4960b074d61584efac6e9c0b48542b6003ad14a3c81066f8cde98880693b089b"}
Jul 22 02:43:08.837076 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.837047    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:43:08.861550 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.860483    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lnhq7" podStartSLOduration=3.346173965 podStartE2EDuration="8.860460698s" totalImagesPullingTime="5.514286733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:07.74809106 +0000 UTC m=+356.209481796" watchObservedRunningTime="2026-07-22 02:43:08.860460698 +0000 UTC m=+357.321851438"
Jul 22 02:43:08.939534 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.939495    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle\") pod \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") "
Jul 22 02:43:08.939689 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.939560    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9mpw\" (UniqueName: \"kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw\") pod \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") "
Jul 22 02:43:08.939689 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.939639    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util\") pod \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\" (UID: \"0c5b46c3-2166-4f6e-a7c5-c2822661ad85\") "
Jul 22 02:43:08.940018 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.939987    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle" (OuterVolumeSpecName: "bundle") pod "0c5b46c3-2166-4f6e-a7c5-c2822661ad85" (UID: "0c5b46c3-2166-4f6e-a7c5-c2822661ad85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:43:08.942015 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.941988    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw" (OuterVolumeSpecName: "kube-api-access-j9mpw") pod "0c5b46c3-2166-4f6e-a7c5-c2822661ad85" (UID: "0c5b46c3-2166-4f6e-a7c5-c2822661ad85"). InnerVolumeSpecName "kube-api-access-j9mpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:43:08.944192 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:08.944166    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util" (OuterVolumeSpecName: "util") pod "0c5b46c3-2166-4f6e-a7c5-c2822661ad85" (UID: "0c5b46c3-2166-4f6e-a7c5-c2822661ad85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 02:43:09.040918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.040875    2523 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-util\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:43:09.040918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.040908    2523 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-bundle\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:43:09.040918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.040922    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9mpw\" (UniqueName: \"kubernetes.io/projected/0c5b46c3-2166-4f6e-a7c5-c2822661ad85-kube-api-access-j9mpw\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:43:09.713208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.713176    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq"
Jul 22 02:43:09.713208 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.713193    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk59vq" event={"ID":"0c5b46c3-2166-4f6e-a7c5-c2822661ad85","Type":"ContainerDied","Data":"0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e"}
Jul 22 02:43:09.713417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:09.713241    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a0d2dffe06046447d9abfafa32c8b2b3b9c1280429760c63942c20788932f0e"
Jul 22 02:43:16.450812 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.450770    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"]
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451112    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="util"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451123    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="util"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451161    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="pull"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451168    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="pull"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451178    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="extract"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451184    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="extract"
Jul 22 02:43:16.451304 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.451238    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5b46c3-2166-4f6e-a7c5-c2822661ad85" containerName="extract"
Jul 22 02:43:16.459677 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.459654    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.465218 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.465186    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 02:43:16.465815 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.465789    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 02:43:16.465985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.465824    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mwlqf\""
Jul 22 02:43:16.466828 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.466806    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"]
Jul 22 02:43:16.609517 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.609474    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50bf192d-1f2b-411d-a582-160645e621f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.609716 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.609606    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6whd\" (UniqueName: \"kubernetes.io/projected/50bf192d-1f2b-411d-a582-160645e621f2-kube-api-access-z6whd\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.710817 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.710787    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6whd\" (UniqueName: \"kubernetes.io/projected/50bf192d-1f2b-411d-a582-160645e621f2-kube-api-access-z6whd\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.711011 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.710856    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50bf192d-1f2b-411d-a582-160645e621f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.711237 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.711216    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50bf192d-1f2b-411d-a582-160645e621f2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.727500 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.727457    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6whd\" (UniqueName: \"kubernetes.io/projected/50bf192d-1f2b-411d-a582-160645e621f2-kube-api-access-z6whd\") pod \"openshift-lws-operator-fd8ccff4c-q4558\" (UID: \"50bf192d-1f2b-411d-a582-160645e621f2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.770403 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.770365    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"
Jul 22 02:43:16.920251 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:16.920225    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558"]
Jul 22 02:43:16.923238 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:16.923210    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50bf192d_1f2b_411d_a582_160645e621f2.slice/crio-7519b92149b61ee4a5993e5e1bfc4343fe5823d2e0bfbe2d3c7ab6d9d808d5cd WatchSource:0}: Error finding container 7519b92149b61ee4a5993e5e1bfc4343fe5823d2e0bfbe2d3c7ab6d9d808d5cd: Status 404 returned error can't find the container with id 7519b92149b61ee4a5993e5e1bfc4343fe5823d2e0bfbe2d3c7ab6d9d808d5cd
Jul 22 02:43:17.751483 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:17.751442    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558" event={"ID":"50bf192d-1f2b-411d-a582-160645e621f2","Type":"ContainerStarted","Data":"7519b92149b61ee4a5993e5e1bfc4343fe5823d2e0bfbe2d3c7ab6d9d808d5cd"}
Jul 22 02:43:19.763221 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:19.763173    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558" event={"ID":"50bf192d-1f2b-411d-a582-160645e621f2","Type":"ContainerStarted","Data":"c54bed2dc83e5474ea2b7ff3976db8ed45a99a8c109d5eb2889d3d4c97e6ffa5"}
Jul 22 02:43:19.786676 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:19.786615    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q4558" podStartSLOduration=1.404503557 podStartE2EDuration="3.786594179s" totalImagesPullingTime="2.382090622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:19.786347752 +0000 UTC m=+368.247738500" watchObservedRunningTime="2026-07-22 02:43:19.786594179 +0000 UTC m=+368.247984916"
Jul 22 02:43:35.792552 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.792514    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"]
Jul 22 02:43:35.796132 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.796112    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.801340 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.801307    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p8xl5\""
Jul 22 02:43:35.801340 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.801307    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 02:43:35.801718 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.801700    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 02:43:35.802050 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.802032    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 02:43:35.802212 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.802193    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 02:43:35.836944 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.836905    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"]
Jul 22 02:43:35.868683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.868641    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.868683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.868688    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.868900 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.868710    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.868900 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.868760    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qckn\" (UniqueName: \"kubernetes.io/projected/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-kube-api-access-6qckn\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.868900 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.868856    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.969521 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.969487    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.969753 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.969547    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.969753 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.969583    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.969753 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.969617    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.969753 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.969641    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qckn\" (UniqueName: \"kubernetes.io/projected/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-kube-api-access-6qckn\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.970074 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.970049    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-manifests\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.972180 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.972131    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-tmp\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.972321 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.972302    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.972465 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.972443    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:35.982793 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:35.982757    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qckn\" (UniqueName: \"kubernetes.io/projected/bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2-kube-api-access-6qckn\") pod \"opendatahub-operator-controller-manager-5b96c6dbc5-827vs\" (UID: \"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2\") " pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:36.107038 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:36.106952    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:36.265110 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:36.265084    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"]
Jul 22 02:43:36.268094 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:36.268063    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0e8c97_d5e4_44a1_8117_c6f4c3901cc2.slice/crio-b99e2fb9632c425c0a0959165e8807dba3d3121ba859c46081bff4d1116d28d3 WatchSource:0}: Error finding container b99e2fb9632c425c0a0959165e8807dba3d3121ba859c46081bff4d1116d28d3: Status 404 returned error can't find the container with id b99e2fb9632c425c0a0959165e8807dba3d3121ba859c46081bff4d1116d28d3
Jul 22 02:43:36.843095 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:36.843050    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs" event={"ID":"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2","Type":"ContainerStarted","Data":"b99e2fb9632c425c0a0959165e8807dba3d3121ba859c46081bff4d1116d28d3"}
Jul 22 02:43:39.860603 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:39.860563    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs" event={"ID":"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2","Type":"ContainerStarted","Data":"7399d734d059bfc4a4aa9bc6a528d1ab950137e6e3906e077be95e0ef9763a98"}
Jul 22 02:43:40.867605 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:40.867565    2523 generic.go:356] "Generic (PLEG): container finished" podID="bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2" containerID="7399d734d059bfc4a4aa9bc6a528d1ab950137e6e3906e077be95e0ef9763a98" exitCode=0
Jul 22 02:43:40.868030 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:40.867643    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs" event={"ID":"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2","Type":"ContainerDied","Data":"7399d734d059bfc4a4aa9bc6a528d1ab950137e6e3906e077be95e0ef9763a98"}
Jul 22 02:43:41.874896 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:41.874856    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs" event={"ID":"bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2","Type":"ContainerStarted","Data":"2c20f2e6b48181068766dedfcbc7cf68562c71528b64f19d361388a4d804507d"}
Jul 22 02:43:41.875361 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:41.875016    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:41.911551 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:41.911487    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs" podStartSLOduration=2.106498612 podStartE2EDuration="6.91146781s" totalImagesPullingTime="3.773330818s" totalInitContainerRuntime="1.03163838s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:43:41.909823357 +0000 UTC m=+390.371214111" watchObservedRunningTime="2026-07-22 02:43:41.91146781 +0000 UTC m=+390.372858618"
Jul 22 02:43:52.882318 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:52.882222    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b96c6dbc5-827vs"
Jul 22 02:43:55.472417 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.472373    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"]
Jul 22 02:43:55.482734 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.482702    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.488753 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.488722    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 02:43:55.489290 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.489257    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 02:43:55.490061 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.489685    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g982k\""
Jul 22 02:43:55.496704 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.496678    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"]
Jul 22 02:43:55.554542 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.554494    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tls-certs\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.554542 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.554546    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d7db\" (UniqueName: \"kubernetes.io/projected/257e062f-5cca-4f4f-8e43-59e15ceab0cd-kube-api-access-4d7db\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.554759 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.554601    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tmp\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.655571 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.655529    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tmp\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.655749 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.655652    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tls-certs\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.655749 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.655691    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d7db\" (UniqueName: \"kubernetes.io/projected/257e062f-5cca-4f4f-8e43-59e15ceab0cd-kube-api-access-4d7db\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.658096 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.658062    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tmp\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.658423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.658401    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/257e062f-5cca-4f4f-8e43-59e15ceab0cd-tls-certs\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.676070 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.676031    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d7db\" (UniqueName: \"kubernetes.io/projected/257e062f-5cca-4f4f-8e43-59e15ceab0cd-kube-api-access-4d7db\") pod \"kube-auth-proxy-7885ddc578-7j5xw\" (UID: \"257e062f-5cca-4f4f-8e43-59e15ceab0cd\") " pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.689128 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.689092    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tjqzt"]
Jul 22 02:43:55.693011 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.692985    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:55.696096 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.696069    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 02:43:55.697589 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.697570    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tscnl\""
Jul 22 02:43:55.708541 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.708513    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tjqzt"]
Jul 22 02:43:55.753429 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.753342    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"]
Jul 22 02:43:55.757023 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.757004    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.761488 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.761462    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 02:43:55.761488 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.761484    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mzfx2\""
Jul 22 02:43:55.761725 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.761535    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 02:43:55.761904 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.761883    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 02:43:55.789867 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.789832    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"]
Jul 22 02:43:55.793042 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.793018    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"
Jul 22 02:43:55.858316 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858269    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh59\" (UniqueName: \"kubernetes.io/projected/859c2523-c57a-4eb3-9d2a-7afaa8681909-kube-api-access-kmh59\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.858662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858346    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-metrics-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.858662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858382    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:55.858662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858408    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-kube-api-access-qkxqn\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:55.858662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858436    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.858662 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.858569    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/859c2523-c57a-4eb3-9d2a-7afaa8681909-manager-config\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.959509 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959467    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/859c2523-c57a-4eb3-9d2a-7afaa8681909-manager-config\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.959683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959544    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh59\" (UniqueName: \"kubernetes.io/projected/859c2523-c57a-4eb3-9d2a-7afaa8681909-kube-api-access-kmh59\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.959683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959592    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-metrics-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.959683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959621    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:55.959683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959644    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-kube-api-access-qkxqn\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:55.959683 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.959671    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.959937 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:43:55.959783    2523 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 02:43:55.959937 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:43:55.959857    2523 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert podName:c608980f-c004-4d54-a4dd-d2a1b9d3a60a nodeName:}" failed. No retries permitted until 2026-07-22 02:43:56.459836992 +0000 UTC m=+404.921227712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert") pod "odh-model-controller-7998c67dc4-tjqzt" (UID: "c608980f-c004-4d54-a4dd-d2a1b9d3a60a") : secret "odh-model-controller-webhook-cert" not found
Jul 22 02:43:55.960422 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.960399    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/859c2523-c57a-4eb3-9d2a-7afaa8681909-manager-config\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.962350 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.962329    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-metrics-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.962448 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.962414    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw"]
Jul 22 02:43:55.962606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.962587    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/859c2523-c57a-4eb3-9d2a-7afaa8681909-cert\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.963263 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:55.963241    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257e062f_5cca_4f4f_8e43_59e15ceab0cd.slice/crio-ea7c680322cb0d255a8f84615a38818873990d0ef98581aace48601c8ac897d1 WatchSource:0}: Error finding container ea7c680322cb0d255a8f84615a38818873990d0ef98581aace48601c8ac897d1: Status 404 returned error can't find the container with id ea7c680322cb0d255a8f84615a38818873990d0ef98581aace48601c8ac897d1
Jul 22 02:43:55.975695 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.975665    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh59\" (UniqueName: \"kubernetes.io/projected/859c2523-c57a-4eb3-9d2a-7afaa8681909-kube-api-access-kmh59\") pod \"lws-controller-manager-d897679c6-5dmvv\" (UID: \"859c2523-c57a-4eb3-9d2a-7afaa8681909\") " pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:55.976180 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:55.976128    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkxqn\" (UniqueName: \"kubernetes.io/projected/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-kube-api-access-qkxqn\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:56.066746 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.066652    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:43:56.248865 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.248838    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"]
Jul 22 02:43:56.249135 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:56.249106    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859c2523_c57a_4eb3_9d2a_7afaa8681909.slice/crio-0fd43588e8ba2592740488fced3646e15b285b50ef079e797c2c7b64c3139024 WatchSource:0}: Error finding container 0fd43588e8ba2592740488fced3646e15b285b50ef079e797c2c7b64c3139024: Status 404 returned error can't find the container with id 0fd43588e8ba2592740488fced3646e15b285b50ef079e797c2c7b64c3139024
Jul 22 02:43:56.463802 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.463768    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:56.466461 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.466432    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c608980f-c004-4d54-a4dd-d2a1b9d3a60a-cert\") pod \"odh-model-controller-7998c67dc4-tjqzt\" (UID: \"c608980f-c004-4d54-a4dd-d2a1b9d3a60a\") " pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:56.603828 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.603782    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:43:56.811083 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.810995    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tjqzt"]
Jul 22 02:43:56.815027 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:43:56.814983    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc608980f_c004_4d54_a4dd_d2a1b9d3a60a.slice/crio-16c2284eeac1d26e5c2dca7a01a6ad17550a26a805e1b624c317a74435fdce38 WatchSource:0}: Error finding container 16c2284eeac1d26e5c2dca7a01a6ad17550a26a805e1b624c317a74435fdce38: Status 404 returned error can't find the container with id 16c2284eeac1d26e5c2dca7a01a6ad17550a26a805e1b624c317a74435fdce38
Jul 22 02:43:56.950778 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.950735    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt" event={"ID":"c608980f-c004-4d54-a4dd-d2a1b9d3a60a","Type":"ContainerStarted","Data":"16c2284eeac1d26e5c2dca7a01a6ad17550a26a805e1b624c317a74435fdce38"}
Jul 22 02:43:56.952215 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.952183    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv" event={"ID":"859c2523-c57a-4eb3-9d2a-7afaa8681909","Type":"ContainerStarted","Data":"0fd43588e8ba2592740488fced3646e15b285b50ef079e797c2c7b64c3139024"}
Jul 22 02:43:56.954429 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:43:56.954393    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw" event={"ID":"257e062f-5cca-4f4f-8e43-59e15ceab0cd","Type":"ContainerStarted","Data":"ea7c680322cb0d255a8f84615a38818873990d0ef98581aace48601c8ac897d1"}
Jul 22 02:44:00.979859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:00.979818    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv" event={"ID":"859c2523-c57a-4eb3-9d2a-7afaa8681909","Type":"ContainerStarted","Data":"52b067396f6ce353765f41de74189baf994676ec2c420d93d88e299fdbdbea56"}
Jul 22 02:44:00.980392 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:00.979911    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:44:00.981493 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:00.981467    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw" event={"ID":"257e062f-5cca-4f4f-8e43-59e15ceab0cd","Type":"ContainerStarted","Data":"b52a7060de1e10b8883737a0d90e3be546e2abfc5d2cb6e6cdee292b14cb01da"}
Jul 22 02:44:00.983061 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:00.983035    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt" event={"ID":"c608980f-c004-4d54-a4dd-d2a1b9d3a60a","Type":"ContainerStarted","Data":"b66d67f0e7b8c8cb487f1362b76be93cee5e2a5a2237431a6c6fdcc3d010daf3"}
Jul 22 02:44:00.983220 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:00.983198    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:44:01.000573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:01.000519    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv" podStartSLOduration=2.065927818 podStartE2EDuration="6.000502357s" totalImagesPullingTime="3.934574539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:00.998663331 +0000 UTC m=+409.460054066" watchObservedRunningTime="2026-07-22 02:44:01.000502357 +0000 UTC m=+409.461893093"
Jul 22 02:44:01.017865 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:01.017812    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt" podStartSLOduration=2.590432613 podStartE2EDuration="6.017796105s" totalImagesPullingTime="3.427363492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:01.016064549 +0000 UTC m=+409.477455286" watchObservedRunningTime="2026-07-22 02:44:01.017796105 +0000 UTC m=+409.479186841"
Jul 22 02:44:01.034162 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:01.034092    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7885ddc578-7j5xw" podStartSLOduration=1.813383098 podStartE2EDuration="6.034075446s" totalImagesPullingTime="4.220692348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:44:01.033782166 +0000 UTC m=+409.495172924" watchObservedRunningTime="2026-07-22 02:44:01.034075446 +0000 UTC m=+409.495466185"
Jul 22 02:44:11.991569 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:11.991535    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d897679c6-5dmvv"
Jul 22 02:44:11.992044 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:44:11.991630    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tjqzt"
Jul 22 02:46:26.683620 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.683582    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:46:26.687180 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.687134    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.689415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.689385    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 02:46:26.689415 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.689412    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 02:46:26.689782 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.689760    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-crzfq\""
Jul 22 02:46:26.689902 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.689794    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 02:46:26.695019 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.694936    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:46:26.720367 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.720328    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:46:26.777443 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.777403    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6ab174d8-5fa8-488c-b04e-d643d34aeabe-config-file\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.777443 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.777459    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c79xn\" (UniqueName: \"kubernetes.io/projected/6ab174d8-5fa8-488c-b04e-d643d34aeabe-kube-api-access-c79xn\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.878420 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.878378    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6ab174d8-5fa8-488c-b04e-d643d34aeabe-config-file\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.878420 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.878433    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c79xn\" (UniqueName: \"kubernetes.io/projected/6ab174d8-5fa8-488c-b04e-d643d34aeabe-kube-api-access-c79xn\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.879086 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.879055    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6ab174d8-5fa8-488c-b04e-d643d34aeabe-config-file\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.886884 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.886853    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c79xn\" (UniqueName: \"kubernetes.io/projected/6ab174d8-5fa8-488c-b04e-d643d34aeabe-kube-api-access-c79xn\") pod \"limitador-limitador-54d6d988d5-7gfc2\" (UID: \"6ab174d8-5fa8-488c-b04e-d643d34aeabe\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:26.998983 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:26.998947    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:27.144640 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.144612    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:46:27.146998 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:46:27.146969    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab174d8_5fa8_488c_b04e_d643d34aeabe.slice/crio-1e9a781f7c96cc413e678a49e4d57c53d5cc027f831b5ca745660fb79f87f092 WatchSource:0}: Error finding container 1e9a781f7c96cc413e678a49e4d57c53d5cc027f831b5ca745660fb79f87f092: Status 404 returned error can't find the container with id 1e9a781f7c96cc413e678a49e4d57c53d5cc027f831b5ca745660fb79f87f092
Jul 22 02:46:27.197765 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.197729    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:27.202480 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.202457    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:27.205440 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.205414    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xg2vk\""
Jul 22 02:46:27.209698 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.209657    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:27.281101 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.281021    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8gm\" (UniqueName: \"kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm\") pod \"authorino-58cd955675-x8v9b\" (UID: \"53989f16-f84c-41bb-9624-e897de484022\") " pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:27.381932 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.381896    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:46:27.382151 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.382119    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8gm\" (UniqueName: \"kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm\") pod \"authorino-58cd955675-x8v9b\" (UID: \"53989f16-f84c-41bb-9624-e897de484022\") " pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:27.385536 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.385517    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:46:27.394325 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.394286    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:46:27.395957 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.395926    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8gm\" (UniqueName: \"kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm\") pod \"authorino-58cd955675-x8v9b\" (UID: \"53989f16-f84c-41bb-9624-e897de484022\") " pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:27.482976 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.482921    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqkbx\" (UniqueName: \"kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx\") pod \"authorino-75d556bd77-2bfck\" (UID: \"2fefa716-c949-4689-8b61-daca74376c8d\") " pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:46:27.513548 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.513509    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:27.584163 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.584104    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqkbx\" (UniqueName: \"kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx\") pod \"authorino-75d556bd77-2bfck\" (UID: \"2fefa716-c949-4689-8b61-daca74376c8d\") " pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:46:27.595783 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.595754    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqkbx\" (UniqueName: \"kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx\") pod \"authorino-75d556bd77-2bfck\" (UID: \"2fefa716-c949-4689-8b61-daca74376c8d\") " pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:46:27.672997 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.672633    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:27.676687 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:46:27.676650    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53989f16_f84c_41bb_9624_e897de484022.slice/crio-50c83e22c5ccfd500054418aae2d1ea61036eed39cfdd76e3c933df23fecd5a8 WatchSource:0}: Error finding container 50c83e22c5ccfd500054418aae2d1ea61036eed39cfdd76e3c933df23fecd5a8: Status 404 returned error can't find the container with id 50c83e22c5ccfd500054418aae2d1ea61036eed39cfdd76e3c933df23fecd5a8
Jul 22 02:46:27.696397 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.696352    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:46:27.723113 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.723073    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2" event={"ID":"6ab174d8-5fa8-488c-b04e-d643d34aeabe","Type":"ContainerStarted","Data":"1e9a781f7c96cc413e678a49e4d57c53d5cc027f831b5ca745660fb79f87f092"}
Jul 22 02:46:27.727681 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.727610    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x8v9b" event={"ID":"53989f16-f84c-41bb-9624-e897de484022","Type":"ContainerStarted","Data":"50c83e22c5ccfd500054418aae2d1ea61036eed39cfdd76e3c933df23fecd5a8"}
Jul 22 02:46:27.891200 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:27.891162    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:46:28.741024 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:28.740922    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2bfck" event={"ID":"2fefa716-c949-4689-8b61-daca74376c8d","Type":"ContainerStarted","Data":"7f0d789c6fe4abe31d401d5bf4a8a3d1af345681470d9a6ae2c67b5c9d3b7344"}
Jul 22 02:46:32.767412 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.767373    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x8v9b" event={"ID":"53989f16-f84c-41bb-9624-e897de484022","Type":"ContainerStarted","Data":"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"}
Jul 22 02:46:32.769007 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.768973    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2bfck" event={"ID":"2fefa716-c949-4689-8b61-daca74376c8d","Type":"ContainerStarted","Data":"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"}
Jul 22 02:46:32.770612 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.770583    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2" event={"ID":"6ab174d8-5fa8-488c-b04e-d643d34aeabe","Type":"ContainerStarted","Data":"16fb9490eb07d0147b2bd1b39d2af24d2c0a0b810241c3002f858ce13f2cc95b"}
Jul 22 02:46:32.770748 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.770637    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:46:32.781734 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.781669    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-x8v9b" podStartSLOduration=1.339246447 podStartE2EDuration="5.781650168s" totalImagesPullingTime="4.442403721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:32.781339045 +0000 UTC m=+561.242729783" watchObservedRunningTime="2026-07-22 02:46:32.781650168 +0000 UTC m=+561.243040905"
Jul 22 02:46:32.796730 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.796677    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2bfck" podStartSLOduration=1.561505129 podStartE2EDuration="5.79665824s" totalImagesPullingTime="4.235153111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:32.795056894 +0000 UTC m=+561.256447628" watchObservedRunningTime="2026-07-22 02:46:32.79665824 +0000 UTC m=+561.258048976"
Jul 22 02:46:32.812440 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.812300    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2" podStartSLOduration=1.84062339 podStartE2EDuration="6.81227773s" totalImagesPullingTime="4.97165434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:46:32.811701419 +0000 UTC m=+561.273092156" watchObservedRunningTime="2026-07-22 02:46:32.81227773 +0000 UTC m=+561.273668467"
Jul 22 02:46:32.822549 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:32.822516    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:34.780967 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:34.780922    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-x8v9b" podUID="53989f16-f84c-41bb-9624-e897de484022" containerName="authorino" containerID="cri-o://fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7" gracePeriod=30
Jul 22 02:46:35.032452 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.032383    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:35.157690 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.157653    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk8gm\" (UniqueName: \"kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm\") pod \"53989f16-f84c-41bb-9624-e897de484022\" (UID: \"53989f16-f84c-41bb-9624-e897de484022\") "
Jul 22 02:46:35.160423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.160387    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm" (OuterVolumeSpecName: "kube-api-access-qk8gm") pod "53989f16-f84c-41bb-9624-e897de484022" (UID: "53989f16-f84c-41bb-9624-e897de484022"). InnerVolumeSpecName "kube-api-access-qk8gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:46:35.259318 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.259274    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk8gm\" (UniqueName: \"kubernetes.io/projected/53989f16-f84c-41bb-9624-e897de484022-kube-api-access-qk8gm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:46:35.787595 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.787555    2523 generic.go:356] "Generic (PLEG): container finished" podID="53989f16-f84c-41bb-9624-e897de484022" containerID="fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7" exitCode=0
Jul 22 02:46:35.788064 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.787603    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-x8v9b"
Jul 22 02:46:35.788064 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.787628    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x8v9b" event={"ID":"53989f16-f84c-41bb-9624-e897de484022","Type":"ContainerDied","Data":"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"}
Jul 22 02:46:35.788064 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.787670    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-x8v9b" event={"ID":"53989f16-f84c-41bb-9624-e897de484022","Type":"ContainerDied","Data":"50c83e22c5ccfd500054418aae2d1ea61036eed39cfdd76e3c933df23fecd5a8"}
Jul 22 02:46:35.788064 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.787694    2523 scope.go:117] "RemoveContainer" containerID="fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"
Jul 22 02:46:35.796922 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.796903    2523 scope.go:117] "RemoveContainer" containerID="fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"
Jul 22 02:46:35.797264 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:46:35.797221    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7\": container with ID starting with fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7 not found: ID does not exist" containerID="fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"
Jul 22 02:46:35.797348 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.797269    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7"} err="failed to get container status \"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7\": rpc error: code = NotFound desc = could not find container \"fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7\": container with ID starting with fd53614aa7232bf85e573ba0f7ec5f466023226585fba70d7a97ef39a47ab1a7 not found: ID does not exist"
Jul 22 02:46:35.809782 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.809748    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:35.813423 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.813395    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-x8v9b"]
Jul 22 02:46:35.956414 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:35.956376    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53989f16-f84c-41bb-9624-e897de484022" path="/var/lib/kubelet/pods/53989f16-f84c-41bb-9624-e897de484022/volumes"
Jul 22 02:46:43.777232 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:46:43.777200    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"
Jul 22 02:47:00.777046 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.777006    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:00.777475 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.777458    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53989f16-f84c-41bb-9624-e897de484022" containerName="authorino"
Jul 22 02:47:00.777475 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.777472    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="53989f16-f84c-41bb-9624-e897de484022" containerName="authorino"
Jul 22 02:47:00.777581 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.777569    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="53989f16-f84c-41bb-9624-e897de484022" containerName="authorino"
Jul 22 02:47:00.785510 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.785475    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:00.786813 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.786774    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:00.791684 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.791603    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7mp2\" (UniqueName: \"kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2\") pod \"authorino-5d4b67c446-zqk66\" (UID: \"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d\") " pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:00.893113 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.893074    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7mp2\" (UniqueName: \"kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2\") pod \"authorino-5d4b67c446-zqk66\" (UID: \"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d\") " pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:00.902273 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:00.902244    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7mp2\" (UniqueName: \"kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2\") pod \"authorino-5d4b67c446-zqk66\" (UID: \"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d\") " pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:01.010992 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.010943    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:01.011326 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.011307    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:01.039024 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.038939    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:01.042606 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.042583    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:01.053456 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.053424    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:01.095524 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.095487    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5xt\" (UniqueName: \"kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt\") pod \"authorino-57dd996df7-wtb57\" (UID: \"50c073eb-47f3-45c6-826f-f6dde3d2441e\") " pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:01.158700 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.158674    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:01.160882 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:47:01.160850    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8c9b93f_7eda_4663_9b9d_b3b4e17d0f3d.slice/crio-afd0af4ffb1233be2502580648446dca25e9876c7069639d262e5681657a12f2 WatchSource:0}: Error finding container afd0af4ffb1233be2502580648446dca25e9876c7069639d262e5681657a12f2: Status 404 returned error can't find the container with id afd0af4ffb1233be2502580648446dca25e9876c7069639d262e5681657a12f2
Jul 22 02:47:01.196618 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.196573    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5xt\" (UniqueName: \"kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt\") pod \"authorino-57dd996df7-wtb57\" (UID: \"50c073eb-47f3-45c6-826f-f6dde3d2441e\") " pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:01.207382 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.207353    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5xt\" (UniqueName: \"kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt\") pod \"authorino-57dd996df7-wtb57\" (UID: \"50c073eb-47f3-45c6-826f-f6dde3d2441e\") " pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:01.354189 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.354054    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:01.494774 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.494747    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:01.497210 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:47:01.497133    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50c073eb_47f3_45c6_826f_f6dde3d2441e.slice/crio-6b05954f46f49049f5da10edbbe719afb8309d56967ebe5b78cba6d3b2705ec7 WatchSource:0}: Error finding container 6b05954f46f49049f5da10edbbe719afb8309d56967ebe5b78cba6d3b2705ec7: Status 404 returned error can't find the container with id 6b05954f46f49049f5da10edbbe719afb8309d56967ebe5b78cba6d3b2705ec7
Jul 22 02:47:01.548240 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.548207    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:01.576342 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.576315    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:47:01.579713 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.579695    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.581908 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.581889    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 02:47:01.589571 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.589543    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:47:01.601836 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.601789    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.602032 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.601883    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw47q\" (UniqueName: \"kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.702742 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.702645    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.702742 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.702700    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw47q\" (UniqueName: \"kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.705232 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.705211    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.712525 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.712497    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw47q\" (UniqueName: \"kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q\") pod \"authorino-784d4bbb8f-fs7dg\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") " pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.889764 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.889737    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:47:01.926056 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.926005    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dd996df7-wtb57" event={"ID":"50c073eb-47f3-45c6-826f-f6dde3d2441e","Type":"ContainerStarted","Data":"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"}
Jul 22 02:47:01.926056 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.926070    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dd996df7-wtb57" event={"ID":"50c073eb-47f3-45c6-826f-f6dde3d2441e","Type":"ContainerStarted","Data":"6b05954f46f49049f5da10edbbe719afb8309d56967ebe5b78cba6d3b2705ec7"}
Jul 22 02:47:01.926367 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.926024    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57dd996df7-wtb57" podUID="50c073eb-47f3-45c6-826f-f6dde3d2441e" containerName="authorino" containerID="cri-o://a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22" gracePeriod=30
Jul 22 02:47:01.928859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.928091    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zqk66" event={"ID":"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d","Type":"ContainerStarted","Data":"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"}
Jul 22 02:47:01.928859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.928135    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zqk66" event={"ID":"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d","Type":"ContainerStarted","Data":"afd0af4ffb1233be2502580648446dca25e9876c7069639d262e5681657a12f2"}
Jul 22 02:47:01.928859 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.928241    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-zqk66" podUID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" containerName="authorino" containerID="cri-o://b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875" gracePeriod=30
Jul 22 02:47:01.942870 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.942785    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57dd996df7-wtb57" podStartSLOduration=0.59620779 podStartE2EDuration="942.765643ms" totalImagesPullingTime="346.557853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:01.94249342 +0000 UTC m=+590.403884159" watchObservedRunningTime="2026-07-22 02:47:01.942765643 +0000 UTC m=+590.404156381"
Jul 22 02:47:01.963961 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:01.963900    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-zqk66" podStartSLOduration=1.5959238519999999 podStartE2EDuration="1.963876381s" totalImagesPullingTime="367.952529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:01.962503542 +0000 UTC m=+590.423894278" watchObservedRunningTime="2026-07-22 02:47:01.963876381 +0000 UTC m=+590.425267119"
Jul 22 02:47:02.064101 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.064070    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:47:02.066876 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:47:02.066829    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabba54e4_31e0_443c_bfcc_46291050821f.slice/crio-c2be72aeec29cc4a3e56634ddc27d24258696b8cc585d2ea3102e2929e4fb9af WatchSource:0}: Error finding container c2be72aeec29cc4a3e56634ddc27d24258696b8cc585d2ea3102e2929e4fb9af: Status 404 returned error can't find the container with id c2be72aeec29cc4a3e56634ddc27d24258696b8cc585d2ea3102e2929e4fb9af
Jul 22 02:47:02.170822 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.170796    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:02.208745 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.208636    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz5xt\" (UniqueName: \"kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt\") pod \"50c073eb-47f3-45c6-826f-f6dde3d2441e\" (UID: \"50c073eb-47f3-45c6-826f-f6dde3d2441e\") "
Jul 22 02:47:02.210996 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.210962    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt" (OuterVolumeSpecName: "kube-api-access-dz5xt") pod "50c073eb-47f3-45c6-826f-f6dde3d2441e" (UID: "50c073eb-47f3-45c6-826f-f6dde3d2441e"). InnerVolumeSpecName "kube-api-access-dz5xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:47:02.217444 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.217416    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:02.309658 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.309622    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7mp2\" (UniqueName: \"kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2\") pod \"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d\" (UID: \"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d\") "
Jul 22 02:47:02.309946 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.309927    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz5xt\" (UniqueName: \"kubernetes.io/projected/50c073eb-47f3-45c6-826f-f6dde3d2441e-kube-api-access-dz5xt\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:47:02.311910 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.311884    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2" (OuterVolumeSpecName: "kube-api-access-t7mp2") pod "e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" (UID: "e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d"). InnerVolumeSpecName "kube-api-access-t7mp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:47:02.411318 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.411283    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7mp2\" (UniqueName: \"kubernetes.io/projected/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d-kube-api-access-t7mp2\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:47:02.934468 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.934425    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" event={"ID":"abba54e4-31e0-443c-bfcc-46291050821f","Type":"ContainerStarted","Data":"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"}
Jul 22 02:47:02.934468 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.934474    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" event={"ID":"abba54e4-31e0-443c-bfcc-46291050821f","Type":"ContainerStarted","Data":"c2be72aeec29cc4a3e56634ddc27d24258696b8cc585d2ea3102e2929e4fb9af"}
Jul 22 02:47:02.935763 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.935735    2523 generic.go:356] "Generic (PLEG): container finished" podID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" containerID="b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875" exitCode=0
Jul 22 02:47:02.935885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.935771    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zqk66"
Jul 22 02:47:02.935885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.935826    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zqk66" event={"ID":"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d","Type":"ContainerDied","Data":"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"}
Jul 22 02:47:02.935885 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.935862    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-zqk66" event={"ID":"e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d","Type":"ContainerDied","Data":"afd0af4ffb1233be2502580648446dca25e9876c7069639d262e5681657a12f2"}
Jul 22 02:47:02.936006 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.935900    2523 scope.go:117] "RemoveContainer" containerID="b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"
Jul 22 02:47:02.937115 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.937096    2523 generic.go:356] "Generic (PLEG): container finished" podID="50c073eb-47f3-45c6-826f-f6dde3d2441e" containerID="a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22" exitCode=2
Jul 22 02:47:02.937199 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.937164    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dd996df7-wtb57" event={"ID":"50c073eb-47f3-45c6-826f-f6dde3d2441e","Type":"ContainerDied","Data":"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"}
Jul 22 02:47:02.937199 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.937192    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57dd996df7-wtb57" event={"ID":"50c073eb-47f3-45c6-826f-f6dde3d2441e","Type":"ContainerDied","Data":"6b05954f46f49049f5da10edbbe719afb8309d56967ebe5b78cba6d3b2705ec7"}
Jul 22 02:47:02.937292 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.937168    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57dd996df7-wtb57"
Jul 22 02:47:02.946722 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.946699    2523 scope.go:117] "RemoveContainer" containerID="b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"
Jul 22 02:47:02.947089 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:47:02.947065    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875\": container with ID starting with b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875 not found: ID does not exist" containerID="b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"
Jul 22 02:47:02.947136 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.947104    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875"} err="failed to get container status \"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875\": rpc error: code = NotFound desc = could not find container \"b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875\": container with ID starting with b7adc0979ee953782a06120f797d3f620dfc9a414b31f003174e5325986ba875 not found: ID does not exist"
Jul 22 02:47:02.947136 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.947128    2523 scope.go:117] "RemoveContainer" containerID="a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"
Jul 22 02:47:02.953456 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.953410    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" podStartSLOduration=1.58123834 podStartE2EDuration="1.953392792s" totalImagesPullingTime="372.154452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:47:02.951895424 +0000 UTC m=+591.413286181" watchObservedRunningTime="2026-07-22 02:47:02.953392792 +0000 UTC m=+591.414783544"
Jul 22 02:47:02.956256 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.956238    2523 scope.go:117] "RemoveContainer" containerID="a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"
Jul 22 02:47:02.956558 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:47:02.956538    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22\": container with ID starting with a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22 not found: ID does not exist" containerID="a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"
Jul 22 02:47:02.956616 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.956569    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22"} err="failed to get container status \"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22\": rpc error: code = NotFound desc = could not find container \"a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22\": container with ID starting with a4233a266d090ff5445252d1d7b511ecd1be02d60aebe0dd5b25185c8b8fac22 not found: ID does not exist"
Jul 22 02:47:02.968830 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.968795    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:02.972012 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.971981    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57dd996df7-wtb57"]
Jul 22 02:47:02.979990 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.979961    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:02.985283 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.985251    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:47:02.985508 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.985480    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2bfck" podUID="2fefa716-c949-4689-8b61-daca74376c8d" containerName="authorino" containerID="cri-o://58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd" gracePeriod=30
Jul 22 02:47:02.988746 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:02.988717    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zqk66"]
Jul 22 02:47:03.247985 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.247950    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:47:03.319471 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.319433    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqkbx\" (UniqueName: \"kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx\") pod \"2fefa716-c949-4689-8b61-daca74376c8d\" (UID: \"2fefa716-c949-4689-8b61-daca74376c8d\") "
Jul 22 02:47:03.321694 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.321667    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx" (OuterVolumeSpecName: "kube-api-access-dqkbx") pod "2fefa716-c949-4689-8b61-daca74376c8d" (UID: "2fefa716-c949-4689-8b61-daca74376c8d"). InnerVolumeSpecName "kube-api-access-dqkbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:47:03.420573 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.420532    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqkbx\" (UniqueName: \"kubernetes.io/projected/2fefa716-c949-4689-8b61-daca74376c8d-kube-api-access-dqkbx\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:47:03.945040 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.945006    2523 generic.go:356] "Generic (PLEG): container finished" podID="2fefa716-c949-4689-8b61-daca74376c8d" containerID="58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd" exitCode=0
Jul 22 02:47:03.945532 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.945055    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2bfck"
Jul 22 02:47:03.945532 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.945084    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2bfck" event={"ID":"2fefa716-c949-4689-8b61-daca74376c8d","Type":"ContainerDied","Data":"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"}
Jul 22 02:47:03.945532 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.945122    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2bfck" event={"ID":"2fefa716-c949-4689-8b61-daca74376c8d","Type":"ContainerDied","Data":"7f0d789c6fe4abe31d401d5bf4a8a3d1af345681470d9a6ae2c67b5c9d3b7344"}
Jul 22 02:47:03.945532 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.945174    2523 scope.go:117] "RemoveContainer" containerID="58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"
Jul 22 02:47:03.954203 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.954176    2523 scope.go:117] "RemoveContainer" containerID="58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"
Jul 22 02:47:03.954505 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:47:03.954487    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd\": container with ID starting with 58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd not found: ID does not exist" containerID="58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"
Jul 22 02:47:03.954577 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.954515    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd"} err="failed to get container status \"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd\": rpc error: code = NotFound desc = could not find container \"58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd\": container with ID starting with 58a07aca4c3e16fe61086e32371deb643d5d474c052350db7b3d70e6279af2cd not found: ID does not exist"
Jul 22 02:47:03.957340 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.957311    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50c073eb-47f3-45c6-826f-f6dde3d2441e" path="/var/lib/kubelet/pods/50c073eb-47f3-45c6-826f-f6dde3d2441e/volumes"
Jul 22 02:47:03.957713 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.957695    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" path="/var/lib/kubelet/pods/e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d/volumes"
Jul 22 02:47:03.970974 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.970937    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:47:03.973789 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:03.973757    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2bfck"]
Jul 22 02:47:05.956714 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:05.956676    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fefa716-c949-4689-8b61-daca74376c8d" path="/var/lib/kubelet/pods/2fefa716-c949-4689-8b61-daca74376c8d/volumes"
Jul 22 02:47:11.908058 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:11.908023    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:47:11.909495 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:11.909474    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:47:11.910772 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:11.910753    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:47:11.912258 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:11.912237    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:47:45.276672 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:47:45.276633    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:48:04.754280 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:48:04.754237    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:48:09.570478 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:48:09.570439    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:48:26.097936 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:48:26.097879    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:48:35.380452 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:48:35.380411    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:48:48.607742 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:48:48.607700    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:49:06.124917 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:49:06.124880    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:50:11.118723 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.118681    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bbf4cddc6-7qzj7"]
Jul 22 02:50:11.119294 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119256    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" containerName="authorino"
Jul 22 02:50:11.119294 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119278    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" containerName="authorino"
Jul 22 02:50:11.119412 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119301    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fefa716-c949-4689-8b61-daca74376c8d" containerName="authorino"
Jul 22 02:50:11.119412 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119310    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fefa716-c949-4689-8b61-daca74376c8d" containerName="authorino"
Jul 22 02:50:11.119412 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119335    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50c073eb-47f3-45c6-826f-f6dde3d2441e" containerName="authorino"
Jul 22 02:50:11.119412 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119344    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="50c073eb-47f3-45c6-826f-f6dde3d2441e" containerName="authorino"
Jul 22 02:50:11.119600 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119447    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fefa716-c949-4689-8b61-daca74376c8d" containerName="authorino"
Jul 22 02:50:11.119600 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119460    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c9b93f-7eda-4663-9b9d-b3b4e17d0f3d" containerName="authorino"
Jul 22 02:50:11.119600 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.119470    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="50c073eb-47f3-45c6-826f-f6dde3d2441e" containerName="authorino"
Jul 22 02:50:11.122540 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.122515    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.132869 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.132841    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbf4cddc6-7qzj7"]
Jul 22 02:50:11.229384 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.229339    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33ad0a82-57c6-43c6-80f9-30c6abbb5193-tls-cert\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.229565 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.229510    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/33ad0a82-57c6-43c6-80f9-30c6abbb5193-kube-api-access-qww8w\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.330842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.330797    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33ad0a82-57c6-43c6-80f9-30c6abbb5193-tls-cert\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.331009 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.330883    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/33ad0a82-57c6-43c6-80f9-30c6abbb5193-kube-api-access-qww8w\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.333650 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.333618    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33ad0a82-57c6-43c6-80f9-30c6abbb5193-tls-cert\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.342186 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.342134    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww8w\" (UniqueName: \"kubernetes.io/projected/33ad0a82-57c6-43c6-80f9-30c6abbb5193-kube-api-access-qww8w\") pod \"authorino-5bbf4cddc6-7qzj7\" (UID: \"33ad0a82-57c6-43c6-80f9-30c6abbb5193\") " pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.433442 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.433364    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7"
Jul 22 02:50:11.598062 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.598036    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bbf4cddc6-7qzj7"]
Jul 22 02:50:11.600537 ip-10-0-130-119 kubenswrapper[2523]: W0722 02:50:11.600501    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33ad0a82_57c6_43c6_80f9_30c6abbb5193.slice/crio-1e4e5446290b445ce7ded17284b358b9271f4c893f4368e4d34dcdc0a629afc2 WatchSource:0}: Error finding container 1e4e5446290b445ce7ded17284b358b9271f4c893f4368e4d34dcdc0a629afc2: Status 404 returned error can't find the container with id 1e4e5446290b445ce7ded17284b358b9271f4c893f4368e4d34dcdc0a629afc2
Jul 22 02:50:11.601854 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.601832    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:50:11.907104 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:11.907042    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7" event={"ID":"33ad0a82-57c6-43c6-80f9-30c6abbb5193","Type":"ContainerStarted","Data":"1e4e5446290b445ce7ded17284b358b9271f4c893f4368e4d34dcdc0a629afc2"}
Jul 22 02:50:12.915518 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:12.915474    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7" event={"ID":"33ad0a82-57c6-43c6-80f9-30c6abbb5193","Type":"ContainerStarted","Data":"74aaa3de025417627bcdcc9377acfda4a8e498bf3067ba21717fbac3d578c4a4"}
Jul 22 02:50:12.954795 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:12.954737    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bbf4cddc6-7qzj7" podStartSLOduration=1.58325061 podStartE2EDuration="1.954715247s" totalImagesPullingTime="371.464637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:50:12.952864792 +0000 UTC m=+781.414255531" watchObservedRunningTime="2026-07-22 02:50:12.954715247 +0000 UTC m=+781.416105984"
Jul 22 02:50:13.054773 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.054731    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:50:13.055044 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.054981    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" podUID="abba54e4-31e0-443c-bfcc-46291050821f" containerName="authorino" containerID="cri-o://d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3" gracePeriod=30
Jul 22 02:50:13.318333 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.318296    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:50:13.451463 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.451357    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw47q\" (UniqueName: \"kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q\") pod \"abba54e4-31e0-443c-bfcc-46291050821f\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") "
Jul 22 02:50:13.451463 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.451466    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert\") pod \"abba54e4-31e0-443c-bfcc-46291050821f\" (UID: \"abba54e4-31e0-443c-bfcc-46291050821f\") "
Jul 22 02:50:13.453920 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.453882    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q" (OuterVolumeSpecName: "kube-api-access-kw47q") pod "abba54e4-31e0-443c-bfcc-46291050821f" (UID: "abba54e4-31e0-443c-bfcc-46291050821f"). InnerVolumeSpecName "kube-api-access-kw47q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:50:13.465313 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.465265    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "abba54e4-31e0-443c-bfcc-46291050821f" (UID: "abba54e4-31e0-443c-bfcc-46291050821f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:50:13.552861 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.552817    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw47q\" (UniqueName: \"kubernetes.io/projected/abba54e4-31e0-443c-bfcc-46291050821f-kube-api-access-kw47q\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:50:13.552861 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.552854    2523 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abba54e4-31e0-443c-bfcc-46291050821f-tls-cert\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 02:50:13.925169 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.925101    2523 generic.go:356] "Generic (PLEG): container finished" podID="abba54e4-31e0-443c-bfcc-46291050821f" containerID="d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3" exitCode=0
Jul 22 02:50:13.925842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.925184    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" event={"ID":"abba54e4-31e0-443c-bfcc-46291050821f","Type":"ContainerDied","Data":"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"}
Jul 22 02:50:13.925842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.925257    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg"
Jul 22 02:50:13.925842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.925281    2523 scope.go:117] "RemoveContainer" containerID="d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"
Jul 22 02:50:13.925842 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.925260    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-784d4bbb8f-fs7dg" event={"ID":"abba54e4-31e0-443c-bfcc-46291050821f","Type":"ContainerDied","Data":"c2be72aeec29cc4a3e56634ddc27d24258696b8cc585d2ea3102e2929e4fb9af"}
Jul 22 02:50:13.939948 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.939924    2523 scope.go:117] "RemoveContainer" containerID="d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"
Jul 22 02:50:13.940486 ip-10-0-130-119 kubenswrapper[2523]: E0722 02:50:13.940448    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3\": container with ID starting with d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3 not found: ID does not exist" containerID="d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"
Jul 22 02:50:13.940613 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.940505    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3"} err="failed to get container status \"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3\": rpc error: code = NotFound desc = could not find container \"d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3\": container with ID starting with d9a23bbde0a3594c9f98f81f464a431fa7d6c471ac258661e80fd1f375ca0fa3 not found: ID does not exist"
Jul 22 02:50:13.970329 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.970249    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:50:13.971585 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:13.971532    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-784d4bbb8f-fs7dg"]
Jul 22 02:50:15.957700 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:15.957666    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abba54e4-31e0-443c-bfcc-46291050821f" path="/var/lib/kubelet/pods/abba54e4-31e0-443c-bfcc-46291050821f/volumes"
Jul 22 02:50:48.145856 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:48.145767    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:50:57.049890 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:50:57.049848    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:51:07.666119 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:51:07.666078    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:52:11.945620 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:11.945590    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:52:11.946182 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:11.945656    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:52:11.948387 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:11.948362    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:52:11.948626 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:11.948607    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:52:49.144602 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:49.144565    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:52:58.068647 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:52:58.068614    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:53:29.055544 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:53:29.055489    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:53:38.651121 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:53:38.651033    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:53:46.853709 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:53:46.853675    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:53:57.062199 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:53:57.062156    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:54:06.997825 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:54:06.997783    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:54:15.850880 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:54:15.850840    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:54:28.748036 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:54:28.744015    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:54:37.851737 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:54:37.851699    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:54:59.854060 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:54:59.854024    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:55:08.660828 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:55:08.660777    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:55:33.957235 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:55:33.957200    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:55:43.864706 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:55:43.864663    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:56:00.065389 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:56:00.065350    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:56:10.455713 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:56:10.455662    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:56:19.856220 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:56:19.856183    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:56:28.552534 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:56:28.552491    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:56:37.558464 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:56:37.558376    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:57:11.978410 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:57:11.978370    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:57:11.980979 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:57:11.980953    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:57:11.981541 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:57:11.981520    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 02:57:11.984178 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:57:11.984157    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 02:58:25.756658 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:58:25.756616    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:58:34.062248 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:58:34.062202    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:58:46.469562 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:58:46.469520    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:58:55.166918 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:58:55.166879    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:03.766904 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:03.766864    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:13.357676 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:13.357637    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:24.166607 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:24.166568    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:35.362414 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:35.362315    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:43.960425 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:43.960384    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 02:59:55.165039 ip-10-0-130-119 kubenswrapper[2523]: I0722 02:59:55.165001    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:00:00.165692 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.165655    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"]
Jul 22 03:00:00.166094 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.166063    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abba54e4-31e0-443c-bfcc-46291050821f" containerName="authorino"
Jul 22 03:00:00.166094 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.166074    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="abba54e4-31e0-443c-bfcc-46291050821f" containerName="authorino"
Jul 22 03:00:00.166216 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.166134    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="abba54e4-31e0-443c-bfcc-46291050821f" containerName="authorino"
Jul 22 03:00:00.169232 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.169215    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"
Jul 22 03:00:00.172505 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.172484    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:00:00.179080 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.179060    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"
Jul 22 03:00:00.194461 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.194426    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"]
Jul 22 03:00:00.323029 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.323003    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"]
Jul 22 03:00:00.324736 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:00:00.324704    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917af1d0_d3d6_458f_abd6_382a545fd192.slice/crio-773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b WatchSource:0}: Error finding container 773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b: Status 404 returned error can't find the container with id 773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b
Jul 22 03:00:00.326737 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.326722    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:00:00.934731 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:00.934690    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29" event={"ID":"917af1d0-d3d6-458f-abd6-382a545fd192","Type":"ContainerStarted","Data":"773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b"}
Jul 22 03:00:05.961568 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:05.961530    2523 generic.go:356] "Generic (PLEG): container finished" podID="917af1d0-d3d6-458f-abd6-382a545fd192" containerID="136b786fb31f5f22aed5d1922ec94002b3b50850a58de3182ba035baef84d2b7" exitCode=0
Jul 22 03:00:05.961948 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:05.961616    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29" event={"ID":"917af1d0-d3d6-458f-abd6-382a545fd192","Type":"ContainerDied","Data":"136b786fb31f5f22aed5d1922ec94002b3b50850a58de3182ba035baef84d2b7"}
Jul 22 03:00:06.168710 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:06.168669    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:00:07.120258 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:07.120225    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"
Jul 22 03:00:07.972521 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:07.972489    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29" event={"ID":"917af1d0-d3d6-458f-abd6-382a545fd192","Type":"ContainerDied","Data":"773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b"}
Jul 22 03:00:07.972521 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:07.972510    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744820-krg29"
Jul 22 03:00:07.972717 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:07.972538    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="773380cce67b2c6ffe7cc9d8f9567b20fbe8b3156dbbbbed9ccbd73d1472759b"
Jul 22 03:00:15.160248 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:15.160204    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:00:32.418221 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:32.418183    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:00:42.361903 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:00:42.361857    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:01:13.565495 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.565454    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:13.566025 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.566005    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="917af1d0-d3d6-458f-abd6-382a545fd192" containerName="cleanup"
Jul 22 03:01:13.566070 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.566029    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="917af1d0-d3d6-458f-abd6-382a545fd192" containerName="cleanup"
Jul 22 03:01:13.566218 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.566205    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="917af1d0-d3d6-458f-abd6-382a545fd192" containerName="cleanup"
Jul 22 03:01:13.569250 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.569230    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.571748 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.571724    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xsxlk\""
Jul 22 03:01:13.571889 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.571727    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 03:01:13.572270 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.572255    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 03:01:13.572419 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.572404    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-499f8b96-kserve-self-signed-certs\""
Jul 22 03:01:13.578917 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.578892    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:13.659454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659407    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.659454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659456    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.659725 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659525    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.659725 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659547    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.659725 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659577    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.659725 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.659661    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760537 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760481    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760576    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760596    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760622    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760638    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.760768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.760655    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.761047 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.761030    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.761133 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.761104    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.761133 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.761123    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.763111 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.763086    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.763456 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.763436    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.775451 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.775418    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd\") pod \"e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") " pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:13.879443 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:13.879343    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:14.044096 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:01:14.044062    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b0ce992_dc65_4af5_be1b_2ae906abac1f.slice/crio-c09281e51bc54a72d983765828bc9f2fed956e15cd72642318420701f7aee144 WatchSource:0}: Error finding container c09281e51bc54a72d983765828bc9f2fed956e15cd72642318420701f7aee144: Status 404 returned error can't find the container with id c09281e51bc54a72d983765828bc9f2fed956e15cd72642318420701f7aee144
Jul 22 03:01:14.044399 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:14.044376    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:14.314675 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:14.314635    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" event={"ID":"1b0ce992-dc65-4af5-be1b-2ae906abac1f","Type":"ContainerStarted","Data":"c09281e51bc54a72d983765828bc9f2fed956e15cd72642318420701f7aee144"}
Jul 22 03:01:16.329576 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:16.329541    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" event={"ID":"1b0ce992-dc65-4af5-be1b-2ae906abac1f","Type":"ContainerStarted","Data":"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"}
Jul 22 03:01:16.359070 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:16.359005    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" podStartSLOduration=2.103889097 podStartE2EDuration="3.358985213s" totalImagesPullingTime="1.255096116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:01:16.357780368 +0000 UTC m=+1444.819171105" watchObservedRunningTime="2026-07-22 03:01:16.358985213 +0000 UTC m=+1444.820375942"
Jul 22 03:01:17.604388 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:17.604344    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:01:23.879630 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:23.879593    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:23.880045 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:23.879648    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:23.892310 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:23.892274    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:24.382493 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:24.382452    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:39.721705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:39.721664    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:41.956960 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:41.956918    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:01:54.743228 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:54.743186    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" podUID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" containerName="main" containerID="cri-o://2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a" gracePeriod=45
Jul 22 03:01:55.002587 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.002509    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:55.047494 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047448    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047704 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047516    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047704 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047554    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047704 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047598    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047704 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047674    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047915 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047744    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir\") pod \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\" (UID: \"1b0ce992-dc65-4af5-be1b-2ae906abac1f\") "
Jul 22 03:01:55.047915 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047844    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:01:55.048030 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.047994    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home" (OuterVolumeSpecName: "home") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:01:55.048129 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.048112    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:01:55.048288 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.048250    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.048356 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.048317    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.048477 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.048343    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.050004 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.049975    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:01:55.050455 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.050424    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm" (OuterVolumeSpecName: "dshm") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:01:55.050455 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.050439    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd" (OuterVolumeSpecName: "kube-api-access-kz6xd") pod "1b0ce992-dc65-4af5-be1b-2ae906abac1f" (UID: "1b0ce992-dc65-4af5-be1b-2ae906abac1f"). InnerVolumeSpecName "kube-api-access-kz6xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:01:55.149862 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.149827    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b0ce992-dc65-4af5-be1b-2ae906abac1f-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.149862 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.149859    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b0ce992-dc65-4af5-be1b-2ae906abac1f-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.149862 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.149870    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz6xd\" (UniqueName: \"kubernetes.io/projected/1b0ce992-dc65-4af5-be1b-2ae906abac1f-kube-api-access-kz6xd\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:01:55.155942 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.155902    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:01:55.528646 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.528608    2523 generic.go:356] "Generic (PLEG): container finished" podID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" containerID="2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a" exitCode=0
Jul 22 03:01:55.528835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.528672    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"
Jul 22 03:01:55.528835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.528699    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" event={"ID":"1b0ce992-dc65-4af5-be1b-2ae906abac1f","Type":"ContainerDied","Data":"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"}
Jul 22 03:01:55.528835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.528749    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs" event={"ID":"1b0ce992-dc65-4af5-be1b-2ae906abac1f","Type":"ContainerDied","Data":"c09281e51bc54a72d983765828bc9f2fed956e15cd72642318420701f7aee144"}
Jul 22 03:01:55.528835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.528768    2523 scope.go:117] "RemoveContainer" containerID="2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"
Jul 22 03:01:55.547236 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.547198    2523 scope.go:117] "RemoveContainer" containerID="2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"
Jul 22 03:01:55.547586 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:01:55.547564    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a\": container with ID starting with 2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a not found: ID does not exist" containerID="2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"
Jul 22 03:01:55.547647 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.547596    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a"} err="failed to get container status \"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a\": rpc error: code = NotFound desc = could not find container \"2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a\": container with ID starting with 2ef4320ba5ee61e4368c9d8cd504ec0077ef4c82593394029cc6ce02f1187b0a not found: ID does not exist"
Jul 22 03:01:55.554888 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.554856    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:55.559251 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.559220    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-499f8b96-kserve-5cb9699759-gssxs"]
Jul 22 03:01:55.957382 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:01:55.957296    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" path="/var/lib/kubelet/pods/1b0ce992-dc65-4af5-be1b-2ae906abac1f/volumes"
Jul 22 03:02:04.463555 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:04.463517    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:02:12.011736 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:12.011703    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:02:12.014494 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:12.014465    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:02:12.015032 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:12.015014    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:02:12.017841 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:12.017822    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:02:15.242932 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:15.242886    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:02:25.649108 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:25.649066    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:02:35.147835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:35.147745    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:02:43.650292 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:43.650247    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:02:54.452234 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:02:54.452180    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:03:04.048005 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:03:04.047965    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:03:16.662514 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:03:16.662479    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:03:25.550980 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:03:25.550931    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:03:36.850102 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:03:36.850067    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:03:48.649097 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:03:48.649053    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:00.642069 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:00.642026    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:08.155968 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:08.155928    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:20.564318 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:20.564274    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:32.447153 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:32.447110    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:43.447771 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:43.447735    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:04:57.156787 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:04:57.156742    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:05:07.852384 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:07.852338    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:05:23.646911 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:23.646873    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:05:44.106476 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.106386    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"]
Jul 22 03:05:44.106939 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.106815    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" containerName="main"
Jul 22 03:05:44.106939 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.106829    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" containerName="main"
Jul 22 03:05:44.106939 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.106918    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0ce992-dc65-4af5-be1b-2ae906abac1f" containerName="main"
Jul 22 03:05:44.109853 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.109834    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:44.112059 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.112027    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:05:44.112228 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.112096    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:05:44.123741 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.123709    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"]
Jul 22 03:05:44.165676 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.165633    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c22b602d-95gz4\" (UID: \"5c61c157-9e65-4da2-8364-2cc62cacb49f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:44.266425 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.266390    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c22b602d-95gz4\" (UID: \"5c61c157-9e65-4da2-8364-2cc62cacb49f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:44.266983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.266954    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c22b602d-95gz4\" (UID: \"5c61c157-9e65-4da2-8364-2cc62cacb49f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:44.429316 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.429226    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:44.575719 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.575685    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"]
Jul 22 03:05:44.579614 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:05:44.579581    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c61c157_9e65_4da2_8364_2cc62cacb49f.slice/crio-4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d WatchSource:0}: Error finding container 4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d: Status 404 returned error can't find the container with id 4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d
Jul 22 03:05:44.724130 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:44.724087    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4" event={"ID":"5c61c157-9e65-4da2-8364-2cc62cacb49f","Type":"ContainerStarted","Data":"4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d"}
Jul 22 03:05:45.731278 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:45.731243    2523 generic.go:356] "Generic (PLEG): container finished" podID="5c61c157-9e65-4da2-8364-2cc62cacb49f" containerID="dabc562ec6ff12cba72cb51430cc290d6a74bd26cec08ae770064b40ca8e155a" exitCode=0
Jul 22 03:05:45.731671 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:45.731339    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4" event={"ID":"5c61c157-9e65-4da2-8364-2cc62cacb49f","Type":"ContainerDied","Data":"dabc562ec6ff12cba72cb51430cc290d6a74bd26cec08ae770064b40ca8e155a"}
Jul 22 03:05:46.873588 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:46.873560    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:46.993315 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:46.993216    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca\") pod \"5c61c157-9e65-4da2-8364-2cc62cacb49f\" (UID: \"5c61c157-9e65-4da2-8364-2cc62cacb49f\") "
Jul 22 03:05:46.993678 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:46.993645    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c61c157-9e65-4da2-8364-2cc62cacb49f" (UID: "5c61c157-9e65-4da2-8364-2cc62cacb49f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:05:47.094678 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:47.094637    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c61c157-9e65-4da2-8364-2cc62cacb49f-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:05:47.742808 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:47.742776    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"
Jul 22 03:05:47.742983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:47.742777    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4" event={"ID":"5c61c157-9e65-4da2-8364-2cc62cacb49f","Type":"ContainerDied","Data":"4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d"}
Jul 22 03:05:47.742983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:47.742901    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eee6b67dd82637b554d3dd8a03c5b57e018387aae966ef4125544ca8dcb372d"
Jul 22 03:05:57.855044 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:57.854992    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:05:59.189891 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:59.189850    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"]
Jul 22 03:05:59.192011 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:59.191983    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c22b602d-95gz4"]
Jul 22 03:05:59.956573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:05:59.956531    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c61c157-9e65-4da2-8364-2cc62cacb49f" path="/var/lib/kubelet/pods/5c61c157-9e65-4da2-8364-2cc62cacb49f/volumes"
Jul 22 03:06:09.162993 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:09.162954    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:06:27.968970 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.968934    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"]
Jul 22 03:06:27.969435 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.969340    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c61c157-9e65-4da2-8364-2cc62cacb49f" containerName="revoke-keys"
Jul 22 03:06:27.969435 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.969353    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c61c157-9e65-4da2-8364-2cc62cacb49f" containerName="revoke-keys"
Jul 22 03:06:27.969435 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.969431    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c61c157-9e65-4da2-8364-2cc62cacb49f" containerName="revoke-keys"
Jul 22 03:06:27.972610 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.972593    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:27.975323 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.975300    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:06:27.975783 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.975764    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:06:27.983448 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:27.983424    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"]
Jul 22 03:06:28.075370 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.075319    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq\" (UID: \"b06c5086-ed36-4531-89c3-70527039e533\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:28.176457 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.176414    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq\" (UID: \"b06c5086-ed36-4531-89c3-70527039e533\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:28.177004 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.176984    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq\" (UID: \"b06c5086-ed36-4531-89c3-70527039e533\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:28.283336 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.283237    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:28.425297 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.425264    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"]
Jul 22 03:06:28.428711 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:06:28.428680    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06c5086_ed36_4531_89c3_70527039e533.slice/crio-e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde WatchSource:0}: Error finding container e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde: Status 404 returned error can't find the container with id e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde
Jul 22 03:06:28.952460 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.952356    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq" event={"ID":"b06c5086-ed36-4531-89c3-70527039e533","Type":"ContainerStarted","Data":"5d92a0f0be131d940321f6b9476c8c5963283e601924a7e50c9b283b7084adcb"}
Jul 22 03:06:28.952460 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.952410    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq" event={"ID":"b06c5086-ed36-4531-89c3-70527039e533","Type":"ContainerStarted","Data":"e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde"}
Jul 22 03:06:28.972626 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:28.972569    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq" podStartSLOduration=1.972552042 podStartE2EDuration="1.972552042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:06:28.97095049 +0000 UTC m=+1757.432341228" watchObservedRunningTime="2026-07-22 03:06:28.972552042 +0000 UTC m=+1757.433942779"
Jul 22 03:06:29.958584 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:29.958545    2523 generic.go:356] "Generic (PLEG): container finished" podID="b06c5086-ed36-4531-89c3-70527039e533" containerID="5d92a0f0be131d940321f6b9476c8c5963283e601924a7e50c9b283b7084adcb" exitCode=0
Jul 22 03:06:29.958756 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:29.958629    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq" event={"ID":"b06c5086-ed36-4531-89c3-70527039e533","Type":"ContainerDied","Data":"5d92a0f0be131d940321f6b9476c8c5963283e601924a7e50c9b283b7084adcb"}
Jul 22 03:06:31.107620 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.107592    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:31.203100 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.203054    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca\") pod \"b06c5086-ed36-4531-89c3-70527039e533\" (UID: \"b06c5086-ed36-4531-89c3-70527039e533\") "
Jul 22 03:06:31.203508 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.203484    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b06c5086-ed36-4531-89c3-70527039e533" (UID: "b06c5086-ed36-4531-89c3-70527039e533"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:06:31.304797 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.304707    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b06c5086-ed36-4531-89c3-70527039e533-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:06:31.976313 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.976279    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"
Jul 22 03:06:31.976490 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.976315    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq" event={"ID":"b06c5086-ed36-4531-89c3-70527039e533","Type":"ContainerDied","Data":"e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde"}
Jul 22 03:06:31.976490 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:31.976390    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e851bd05baaccb140edcea2265ec103ac811ed25eba42f76ad747fb2bf3d1bde"
Jul 22 03:06:41.469904 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:41.469863    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:06:43.075584 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:43.075545    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"]
Jul 22 03:06:43.086385 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:43.086347    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-7c53861a-lv4rq"]
Jul 22 03:06:43.957723 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:43.957686    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06c5086-ed36-4531-89c3-70527039e533" path="/var/lib/kubelet/pods/b06c5086-ed36-4531-89c3-70527039e533/volumes"
Jul 22 03:06:52.173071 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:06:52.173035    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:07:12.045050 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.045018    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:07:12.047994 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.047972    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:07:12.049263 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.049241    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:07:12.052213 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.052193    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:07:12.931488 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.931447    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"]
Jul 22 03:07:12.931854 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.931840    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06c5086-ed36-4531-89c3-70527039e533" containerName="revoke-keys"
Jul 22 03:07:12.931901 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.931857    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06c5086-ed36-4531-89c3-70527039e533" containerName="revoke-keys"
Jul 22 03:07:12.931935 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.931930    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06c5086-ed36-4531-89c3-70527039e533" containerName="revoke-keys"
Jul 22 03:07:12.934963 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.934944    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:12.937157 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.937122    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:07:12.937290 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.937274    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:07:12.942946 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:12.942920    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"]
Jul 22 03:07:13.061177 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:13.061101    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr\" (UID: \"4973fff8-03ef-417b-bd19-2a60c01c91da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:13.162157 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:13.162099    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr\" (UID: \"4973fff8-03ef-417b-bd19-2a60c01c91da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:13.162745 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:13.162726    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr\" (UID: \"4973fff8-03ef-417b-bd19-2a60c01c91da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:13.247674 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:13.247638    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:13.404276 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:13.404246    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"]
Jul 22 03:07:13.406793 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:07:13.406761    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4973fff8_03ef_417b_bd19_2a60c01c91da.slice/crio-4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb WatchSource:0}: Error finding container 4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb: Status 404 returned error can't find the container with id 4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb
Jul 22 03:07:14.188897 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:14.188856    2523 generic.go:356] "Generic (PLEG): container finished" podID="4973fff8-03ef-417b-bd19-2a60c01c91da" containerID="c034edb236105a68b0672d7a071a45e48847c282180219a1820d0eac091665ae" exitCode=0
Jul 22 03:07:14.189390 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:14.188937    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr" event={"ID":"4973fff8-03ef-417b-bd19-2a60c01c91da","Type":"ContainerDied","Data":"c034edb236105a68b0672d7a071a45e48847c282180219a1820d0eac091665ae"}
Jul 22 03:07:14.189390 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:14.188989    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr" event={"ID":"4973fff8-03ef-417b-bd19-2a60c01c91da","Type":"ContainerStarted","Data":"4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb"}
Jul 22 03:07:15.332475 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:15.332447    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:15.382039 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:15.381999    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca\") pod \"4973fff8-03ef-417b-bd19-2a60c01c91da\" (UID: \"4973fff8-03ef-417b-bd19-2a60c01c91da\") "
Jul 22 03:07:15.382477 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:15.382453    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4973fff8-03ef-417b-bd19-2a60c01c91da" (UID: "4973fff8-03ef-417b-bd19-2a60c01c91da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:07:15.483449 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:15.483408    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4973fff8-03ef-417b-bd19-2a60c01c91da-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:07:16.201236 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:16.201196    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr" event={"ID":"4973fff8-03ef-417b-bd19-2a60c01c91da","Type":"ContainerDied","Data":"4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb"}
Jul 22 03:07:16.201404 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:16.201237    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"
Jul 22 03:07:16.201404 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:16.201249    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4288e32ab11d9d8e13481566fd782511213eee89cdf40dd17c604187692461cb"
Jul 22 03:07:26.449715 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:26.449674    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:07:28.009554 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:28.009509    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"]
Jul 22 03:07:28.012316 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:28.012284    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b3e829f9-4vdmr"]
Jul 22 03:07:29.957597 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:29.957560    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4973fff8-03ef-417b-bd19-2a60c01c91da" path="/var/lib/kubelet/pods/4973fff8-03ef-417b-bd19-2a60c01c91da/volumes"
Jul 22 03:07:35.346521 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:35.346483    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:07:57.153600 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.153558    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"]
Jul 22 03:07:57.154347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.154020    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4973fff8-03ef-417b-bd19-2a60c01c91da" containerName="revoke-keys"
Jul 22 03:07:57.154347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.154033    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="4973fff8-03ef-417b-bd19-2a60c01c91da" containerName="revoke-keys"
Jul 22 03:07:57.154347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.154088    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="4973fff8-03ef-417b-bd19-2a60c01c91da" containerName="revoke-keys"
Jul 22 03:07:57.157183 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.157166    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:57.159518 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.159494    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:07:57.159628 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.159531    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:07:57.163940 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.163901    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd\" (UID: \"763e98f6-14bb-43b5-9cf3-8e572c01bbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:57.166472 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.166446    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"]
Jul 22 03:07:57.265106 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.265054    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd\" (UID: \"763e98f6-14bb-43b5-9cf3-8e572c01bbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:57.265740 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.265714    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd\" (UID: \"763e98f6-14bb-43b5-9cf3-8e572c01bbcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:57.470218 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.470176    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:57.613694 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:57.613663    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"]
Jul 22 03:07:57.615726 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:07:57.615694    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763e98f6_14bb_43b5_9cf3_8e572c01bbcc.slice/crio-ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2 WatchSource:0}: Error finding container ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2: Status 404 returned error can't find the container with id ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2
Jul 22 03:07:58.428519 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:58.428478    2523 generic.go:356] "Generic (PLEG): container finished" podID="763e98f6-14bb-43b5-9cf3-8e572c01bbcc" containerID="be0682a2b074fb4d291d33e7371523063757fcd6192eede314c97c3303a183f0" exitCode=0
Jul 22 03:07:58.428914 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:58.428563    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd" event={"ID":"763e98f6-14bb-43b5-9cf3-8e572c01bbcc","Type":"ContainerDied","Data":"be0682a2b074fb4d291d33e7371523063757fcd6192eede314c97c3303a183f0"}
Jul 22 03:07:58.428914 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:58.428618    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd" event={"ID":"763e98f6-14bb-43b5-9cf3-8e572c01bbcc","Type":"ContainerStarted","Data":"ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2"}
Jul 22 03:07:59.575826 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:59.575797    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:07:59.584669 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:59.584641    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca\") pod \"763e98f6-14bb-43b5-9cf3-8e572c01bbcc\" (UID: \"763e98f6-14bb-43b5-9cf3-8e572c01bbcc\") "
Jul 22 03:07:59.585043 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:59.585014    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "763e98f6-14bb-43b5-9cf3-8e572c01bbcc" (UID: "763e98f6-14bb-43b5-9cf3-8e572c01bbcc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:07:59.686108 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:07:59.686010    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/763e98f6-14bb-43b5-9cf3-8e572c01bbcc-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:08:00.440267 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:00.440173    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"
Jul 22 03:08:00.440267 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:00.440197    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd" event={"ID":"763e98f6-14bb-43b5-9cf3-8e572c01bbcc","Type":"ContainerDied","Data":"ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2"}
Jul 22 03:08:00.440267 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:00.440256    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae0e1f855344e1a2863f1156d9669c98f919259c40274c9a12386896dfe6f2a2"
Jul 22 03:08:10.448333 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:10.448294    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:08:12.229088 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:12.229042    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"]
Jul 22 03:08:12.232327 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:12.232297    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-f3673a9a-7lscd"]
Jul 22 03:08:13.957454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:08:13.957412    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763e98f6-14bb-43b5-9cf3-8e572c01bbcc" path="/var/lib/kubelet/pods/763e98f6-14bb-43b5-9cf3-8e572c01bbcc/volumes"
Jul 22 03:09:40.144747 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:09:40.144704    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:09:51.453283 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:09:51.453246    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:10:01.449480 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:01.449435    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:10:08.636850 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.636812    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"]
Jul 22 03:10:08.637301 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.637231    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763e98f6-14bb-43b5-9cf3-8e572c01bbcc" containerName="revoke-keys"
Jul 22 03:10:08.637301 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.637243    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="763e98f6-14bb-43b5-9cf3-8e572c01bbcc" containerName="revoke-keys"
Jul 22 03:10:08.637378 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.637310    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="763e98f6-14bb-43b5-9cf3-8e572c01bbcc" containerName="revoke-keys"
Jul 22 03:10:08.640577 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.640556    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:08.642692 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.642663    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:10:08.642830 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.642750    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:10:08.649359 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.649241    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"]
Jul 22 03:10:08.764806 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.764765    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp\" (UID: \"17acfd03-ad78-4f1b-97f2-5d193420889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:08.866100 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.866055    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp\" (UID: \"17acfd03-ad78-4f1b-97f2-5d193420889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:08.866753 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.866732    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp\" (UID: \"17acfd03-ad78-4f1b-97f2-5d193420889c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:08.953383 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:08.953297    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:09.098267 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:09.098231    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"]
Jul 22 03:10:09.100729 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:10:09.100697    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17acfd03_ad78_4f1b_97f2_5d193420889c.slice/crio-e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027 WatchSource:0}: Error finding container e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027: Status 404 returned error can't find the container with id e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027
Jul 22 03:10:09.132996 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:09.132966    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp" event={"ID":"17acfd03-ad78-4f1b-97f2-5d193420889c","Type":"ContainerStarted","Data":"e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027"}
Jul 22 03:10:10.139563 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:10.139532    2523 generic.go:356] "Generic (PLEG): container finished" podID="17acfd03-ad78-4f1b-97f2-5d193420889c" containerID="33c8fa7aea0535fef6351a81996c3d3f1a999debe8f42996d4b5f2d885bc3565" exitCode=0
Jul 22 03:10:10.139990 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:10.139630    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp" event={"ID":"17acfd03-ad78-4f1b-97f2-5d193420889c","Type":"ContainerDied","Data":"33c8fa7aea0535fef6351a81996c3d3f1a999debe8f42996d4b5f2d885bc3565"}
Jul 22 03:10:11.287886 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:11.287854    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:11.389059 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:11.389016    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca\") pod \"17acfd03-ad78-4f1b-97f2-5d193420889c\" (UID: \"17acfd03-ad78-4f1b-97f2-5d193420889c\") "
Jul 22 03:10:11.389485 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:11.389458    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "17acfd03-ad78-4f1b-97f2-5d193420889c" (UID: "17acfd03-ad78-4f1b-97f2-5d193420889c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:11.490083 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:11.490045    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17acfd03-ad78-4f1b-97f2-5d193420889c-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:10:12.151410 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:12.151377    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"
Jul 22 03:10:12.151616 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:12.151412    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp" event={"ID":"17acfd03-ad78-4f1b-97f2-5d193420889c","Type":"ContainerDied","Data":"e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027"}
Jul 22 03:10:12.151616 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:12.151464    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e74cc60184d6cd0236f8dd732c95624a06f0b3da93d0ae6d410ba9efb86b3027"
Jul 22 03:10:21.645530 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:21.645479    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:10:23.721155 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:23.721113    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"]
Jul 22 03:10:23.723308 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:23.723280    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-30037ff3-5p4zp"]
Jul 22 03:10:23.957392 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:23.957359    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17acfd03-ad78-4f1b-97f2-5d193420889c" path="/var/lib/kubelet/pods/17acfd03-ad78-4f1b-97f2-5d193420889c/volumes"
Jul 22 03:10:56.561516 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:10:56.561476    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:11:14.452744 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:14.452704    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:11:27.848658 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:27.848603    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:11:31.358745 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.358701    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"]
Jul 22 03:11:31.359178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.359087    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17acfd03-ad78-4f1b-97f2-5d193420889c" containerName="revoke-keys"
Jul 22 03:11:31.359178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.359099    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="17acfd03-ad78-4f1b-97f2-5d193420889c" containerName="revoke-keys"
Jul 22 03:11:31.359261 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.359199    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="17acfd03-ad78-4f1b-97f2-5d193420889c" containerName="revoke-keys"
Jul 22 03:11:31.362390 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.362370    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:31.364454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.364426    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:11:31.364588 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.364426    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:11:31.369869 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.369772    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"]
Jul 22 03:11:31.418414 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.418371    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6\" (UID: \"6bcbf827-d3df-4128-a8da-4ed442748c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:31.519943 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.519900    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6\" (UID: \"6bcbf827-d3df-4128-a8da-4ed442748c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:31.520651 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.520630    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6\" (UID: \"6bcbf827-d3df-4128-a8da-4ed442748c8e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:31.675887 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.675780    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:31.827408 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:31.827378    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"]
Jul 22 03:11:31.829862 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:11:31.829831    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bcbf827_d3df_4128_a8da_4ed442748c8e.slice/crio-24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b WatchSource:0}: Error finding container 24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b: Status 404 returned error can't find the container with id 24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b
Jul 22 03:11:32.599472 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:32.599434    2523 generic.go:356] "Generic (PLEG): container finished" podID="6bcbf827-d3df-4128-a8da-4ed442748c8e" containerID="ddcd81589186360ad9072569a91d2761aebd53eaa623536bca0741fb60aadc19" exitCode=0
Jul 22 03:11:32.599946 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:32.599514    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6" event={"ID":"6bcbf827-d3df-4128-a8da-4ed442748c8e","Type":"ContainerDied","Data":"ddcd81589186360ad9072569a91d2761aebd53eaa623536bca0741fb60aadc19"}
Jul 22 03:11:32.599946 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:32.599600    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6" event={"ID":"6bcbf827-d3df-4128-a8da-4ed442748c8e","Type":"ContainerStarted","Data":"24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b"}
Jul 22 03:11:33.751822 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:33.751786    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:33.842620 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:33.842569    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca\") pod \"6bcbf827-d3df-4128-a8da-4ed442748c8e\" (UID: \"6bcbf827-d3df-4128-a8da-4ed442748c8e\") "
Jul 22 03:11:33.842963 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:33.842938    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6bcbf827-d3df-4128-a8da-4ed442748c8e" (UID: "6bcbf827-d3df-4128-a8da-4ed442748c8e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:11:33.944264 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:33.944174    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6bcbf827-d3df-4128-a8da-4ed442748c8e-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:11:34.611621 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:34.611584    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"
Jul 22 03:11:34.611621 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:34.611601    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6" event={"ID":"6bcbf827-d3df-4128-a8da-4ed442748c8e","Type":"ContainerDied","Data":"24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b"}
Jul 22 03:11:34.611861 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:34.611657    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24a22a766bbc3a5a14c93641579ef5601fc276422f1bf28a1f2880b0f967203b"
Jul 22 03:11:44.960487 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:44.960442    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:11:51.436323 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:51.436280    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"]
Jul 22 03:11:51.438660 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:51.438627    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e1c7132e-g8tv6"]
Jul 22 03:11:51.957540 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:51.957499    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bcbf827-d3df-4128-a8da-4ed442748c8e" path="/var/lib/kubelet/pods/6bcbf827-d3df-4128-a8da-4ed442748c8e/volumes"
Jul 22 03:11:54.741888 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:11:54.741840    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:12:12.088923 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:12:12.088892    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:12:12.091945 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:12:12.091920    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:12:12.093667 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:12:12.093638    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:12:12.096491 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:12:12.096468    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:12:12.138196 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:12:12.138164    2523 scope.go:117] "RemoveContainer" containerID="dabc562ec6ff12cba72cb51430cc290d6a74bd26cec08ae770064b40ca8e155a"
Jul 22 03:13:00.754895 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:13:00.754853    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:13:10.640874 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:13:10.640834    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:13:12.161499 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:13:12.161461    2523 scope.go:117] "RemoveContainer" containerID="5d92a0f0be131d940321f6b9476c8c5963283e601924a7e50c9b283b7084adcb"
Jul 22 03:14:02.393916 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:02.393876    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:14:12.185286 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:12.185252    2523 scope.go:117] "RemoveContainer" containerID="be0682a2b074fb4d291d33e7371523063757fcd6192eede314c97c3303a183f0"
Jul 22 03:14:12.194311 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:12.194286    2523 scope.go:117] "RemoveContainer" containerID="c034edb236105a68b0672d7a071a45e48847c282180219a1820d0eac091665ae"
Jul 22 03:14:17.309846 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.309803    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:14:17.310288 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.310255    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bcbf827-d3df-4128-a8da-4ed442748c8e" containerName="revoke-keys"
Jul 22 03:14:17.310288 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.310269    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bcbf827-d3df-4128-a8da-4ed442748c8e" containerName="revoke-keys"
Jul 22 03:14:17.310372 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.310350    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bcbf827-d3df-4128-a8da-4ed442748c8e" containerName="revoke-keys"
Jul 22 03:14:17.313478 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.313456    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.318179 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.318114    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9ded6d\"/\"test-model-9ded6d-kserve-self-signed-certs\""
Jul 22 03:14:17.318179 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.318136    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9ded6d\"/\"openshift-service-ca.crt\""
Jul 22 03:14:17.318425 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.318183    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9ded6d\"/\"kube-root-ca.crt\""
Jul 22 03:14:17.318425 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.318132    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9ded6d\"/\"default-dockercfg-vpp52\""
Jul 22 03:14:17.332875 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.332829    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:14:17.359388 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359344    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.359388 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359391    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.359645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359421    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.359645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359478    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.359645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359525    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mq8g\" (UniqueName: \"kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.359645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.359545    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460052 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460006    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460295 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460058    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460295 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460089    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460295 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460118    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460295 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460213    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mq8g\" (UniqueName: \"kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460295 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460256    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460557 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460525    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460611 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460556    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.460659 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.460616    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.462728 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.462704    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.462933 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.462910    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.479347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.479312    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mq8g\" (UniqueName: \"kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g\") pod \"test-model-9ded6d-kserve-65c84b98b5-x775m\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") " pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.624107 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.623985    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:17.782802 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.782774    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:14:17.784842 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:14:17.784809    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead02283_4c16_4cf4_915c_7034ef9062f4.slice/crio-c865e6f8a5745a289b2ae06f763d4f9dc851ca06b7c66df4bb3857589704f89e WatchSource:0}: Error finding container c865e6f8a5745a289b2ae06f763d4f9dc851ca06b7c66df4bb3857589704f89e: Status 404 returned error can't find the container with id c865e6f8a5745a289b2ae06f763d4f9dc851ca06b7c66df4bb3857589704f89e
Jul 22 03:14:17.895971 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:17.895873    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:14:18.507454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:18.507414    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" event={"ID":"ead02283-4c16-4cf4-915c-7034ef9062f4","Type":"ContainerStarted","Data":"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"}
Jul 22 03:14:18.507454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:18.507460    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" event={"ID":"ead02283-4c16-4cf4-915c-7034ef9062f4","Type":"ContainerStarted","Data":"c865e6f8a5745a289b2ae06f763d4f9dc851ca06b7c66df4bb3857589704f89e"}
Jul 22 03:14:18.527612 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:18.527553    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" podStartSLOduration=1.527534398 podStartE2EDuration="1.527534398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:14:18.525712747 +0000 UTC m=+2226.987103485" watchObservedRunningTime="2026-07-22 03:14:18.527534398 +0000 UTC m=+2226.988925114"
Jul 22 03:14:27.625107 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:27.625049    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:27.625642 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:27.625131    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:27.638235 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:27.638211    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:28.572283 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:28.572250    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:14:32.464621 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:14:32.464537    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:15:00.143494 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.143462    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"]
Jul 22 03:15:00.147042 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.147007    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"
Jul 22 03:15:00.147938 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.147911    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"]
Jul 22 03:15:00.150183 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.150160    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:15:00.151485 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.151464    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"
Jul 22 03:15:00.152719 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.152690    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"]
Jul 22 03:15:00.156134 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.156107    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"
Jul 22 03:15:00.160402 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.160358    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"]
Jul 22 03:15:00.161446 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.161425    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"
Jul 22 03:15:00.163065 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.163038    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"]
Jul 22 03:15:00.170993 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.170970    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"
Jul 22 03:15:00.182685 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.181858    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"]
Jul 22 03:15:00.214952 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.214923    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"
Jul 22 03:15:00.341155 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.341106    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"]
Jul 22 03:15:00.344231 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:15:00.344172    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f03e2ec_1f35_413e_aa52_cea2ae42ad56.slice/crio-bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0 WatchSource:0}: Error finding container bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0: Status 404 returned error can't find the container with id bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0
Jul 22 03:15:00.397954 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.397922    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"]
Jul 22 03:15:00.399743 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:15:00.399712    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3642defe_7258_4c97_b5d7_e1fd9a4a04e1.slice/crio-b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55 WatchSource:0}: Error finding container b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55: Status 404 returned error can't find the container with id b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55
Jul 22 03:15:00.575855 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.575828    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"]
Jul 22 03:15:00.578690 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:15:00.578644    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75eeef3_70f6_4248_b754_9ab459bca974.slice/crio-d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5 WatchSource:0}: Error finding container d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5: Status 404 returned error can't find the container with id d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5
Jul 22 03:15:00.736177 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.736105    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr" event={"ID":"4f03e2ec-1f35-413e-aa52-cea2ae42ad56","Type":"ContainerStarted","Data":"d8797195ce6c39172fca0fdf6ce5f80796908754320d18d9086a27ae5ffe85c2"}
Jul 22 03:15:00.736341 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.736191    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr" event={"ID":"4f03e2ec-1f35-413e-aa52-cea2ae42ad56","Type":"ContainerStarted","Data":"bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0"}
Jul 22 03:15:00.737562 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.737532    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp" event={"ID":"3642defe-7258-4c97-b5d7-e1fd9a4a04e1","Type":"ContainerStarted","Data":"b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55"}
Jul 22 03:15:00.738895 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.738873    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz" event={"ID":"a75eeef3-70f6-4248-b754-9ab459bca974","Type":"ContainerStarted","Data":"d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5"}
Jul 22 03:15:00.753393 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:00.753343    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr" podStartSLOduration=0.75332505 podStartE2EDuration="753.32505ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:15:00.752283668 +0000 UTC m=+2269.213674423" watchObservedRunningTime="2026-07-22 03:15:00.75332505 +0000 UTC m=+2269.214715787"
Jul 22 03:15:01.745682 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.745648    2523 generic.go:356] "Generic (PLEG): container finished" podID="4f03e2ec-1f35-413e-aa52-cea2ae42ad56" containerID="d8797195ce6c39172fca0fdf6ce5f80796908754320d18d9086a27ae5ffe85c2" exitCode=0
Jul 22 03:15:01.746210 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.745743    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr" event={"ID":"4f03e2ec-1f35-413e-aa52-cea2ae42ad56","Type":"ContainerDied","Data":"d8797195ce6c39172fca0fdf6ce5f80796908754320d18d9086a27ae5ffe85c2"}
Jul 22 03:15:01.747397 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.747372    2523 generic.go:356] "Generic (PLEG): container finished" podID="3642defe-7258-4c97-b5d7-e1fd9a4a04e1" containerID="c419c2fc839875bc7a831cfdccbfdaaf669f4c538c315d485e904178e55ed836" exitCode=0
Jul 22 03:15:01.747498 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.747444    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp" event={"ID":"3642defe-7258-4c97-b5d7-e1fd9a4a04e1","Type":"ContainerDied","Data":"c419c2fc839875bc7a831cfdccbfdaaf669f4c538c315d485e904178e55ed836"}
Jul 22 03:15:01.748999 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.748962    2523 generic.go:356] "Generic (PLEG): container finished" podID="a75eeef3-70f6-4248-b754-9ab459bca974" containerID="fca0f0248979958feacb0c408a79c0967f8a38972ca0fc94c1eae451415f1f4e" exitCode=0
Jul 22 03:15:01.749119 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:01.748996    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz" event={"ID":"a75eeef3-70f6-4248-b754-9ab459bca974","Type":"ContainerDied","Data":"fca0f0248979958feacb0c408a79c0967f8a38972ca0fc94c1eae451415f1f4e"}
Jul 22 03:15:02.946026 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:02.945998    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"
Jul 22 03:15:02.949212 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:02.949188    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"
Jul 22 03:15:02.952803 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:02.952782    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"
Jul 22 03:15:03.643739 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.643705    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:15:03.644221 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644203    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a75eeef3-70f6-4248-b754-9ab459bca974" containerName="cleanup"
Jul 22 03:15:03.644326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644223    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="a75eeef3-70f6-4248-b754-9ab459bca974" containerName="cleanup"
Jul 22 03:15:03.644326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644241    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f03e2ec-1f35-413e-aa52-cea2ae42ad56" containerName="cleanup"
Jul 22 03:15:03.644326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644248    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f03e2ec-1f35-413e-aa52-cea2ae42ad56" containerName="cleanup"
Jul 22 03:15:03.644326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644266    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3642defe-7258-4c97-b5d7-e1fd9a4a04e1" containerName="cleanup"
Jul 22 03:15:03.644326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644274    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="3642defe-7258-4c97-b5d7-e1fd9a4a04e1" containerName="cleanup"
Jul 22 03:15:03.644572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644370    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="3642defe-7258-4c97-b5d7-e1fd9a4a04e1" containerName="cleanup"
Jul 22 03:15:03.644572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644386    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="a75eeef3-70f6-4248-b754-9ab459bca974" containerName="cleanup"
Jul 22 03:15:03.644572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.644402    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f03e2ec-1f35-413e-aa52-cea2ae42ad56" containerName="cleanup"
Jul 22 03:15:03.647549 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.647526    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.650207 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.650178    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fec108\"/\"kube-root-ca.crt\""
Jul 22 03:15:03.650354 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.650238    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fec108\"/\"test-model-fec108-kserve-self-signed-certs\""
Jul 22 03:15:03.650354 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.650178    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fec108\"/\"openshift-service-ca.crt\""
Jul 22 03:15:03.650354 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.650185    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fec108\"/\"default-dockercfg-fw46d\""
Jul 22 03:15:03.660133 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.660103    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:15:03.760951 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.760918    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp"
Jul 22 03:15:03.760951 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.760936    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744835-kfqrp" event={"ID":"3642defe-7258-4c97-b5d7-e1fd9a4a04e1","Type":"ContainerDied","Data":"b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55"}
Jul 22 03:15:03.761230 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.760984    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b577ebf477fef870d0d927a4863fe0e20a796f7ca16462e70aad92f59c19bc55"
Jul 22 03:15:03.762411 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.762388    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"
Jul 22 03:15:03.762411 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.762395    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz" event={"ID":"a75eeef3-70f6-4248-b754-9ab459bca974","Type":"ContainerDied","Data":"d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5"}
Jul 22 03:15:03.762597 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.762452    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d156660d27e199efc35b8e68ad1e79694a0d68f93d039bc76d8b43fb00ffa7a5"
Jul 22 03:15:03.763742 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.763725    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"
Jul 22 03:15:03.763848 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.763719    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr" event={"ID":"4f03e2ec-1f35-413e-aa52-cea2ae42ad56","Type":"ContainerDied","Data":"bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0"}
Jul 22 03:15:03.763899 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.763856    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf4320df12dcf71f7f91229f94fe7b428453db0bf1a15bbe9a3c72870450b2a0"
Jul 22 03:15:03.782475 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782432    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.782655 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782491    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.782655 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782599    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.782753 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782654    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.782753 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782700    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrtj\" (UniqueName: \"kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.782753 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.782736    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883523 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883485    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883523 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883531    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883767 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883564    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrtj\" (UniqueName: \"kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883767 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883607    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883767 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883644    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.883926 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883790    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.884021 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.883999    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.884081 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.884032    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.884175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.884097    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.885918 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.885899    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.886292 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.886274    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.892455 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.892435    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrtj\" (UniqueName: \"kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj\") pod \"test-model-fec108-kserve-6d56b8f4c5-7sr2g\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") " pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:03.957541 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:03.957459    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:04.109750 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:04.109713    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:15:04.112306 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:15:04.112276    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda04b93a_0fad_4518_bb39_248c229be6c6.slice/crio-8a619913de7473a7b7ab571ace08a1b6c73b79b69c516f63376cd73723c95958 WatchSource:0}: Error finding container 8a619913de7473a7b7ab571ace08a1b6c73b79b69c516f63376cd73723c95958: Status 404 returned error can't find the container with id 8a619913de7473a7b7ab571ace08a1b6c73b79b69c516f63376cd73723c95958
Jul 22 03:15:04.771380 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:04.771342    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" event={"ID":"da04b93a-0fad-4518-bb39-248c229be6c6","Type":"ContainerStarted","Data":"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"}
Jul 22 03:15:04.771567 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:04.771392    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" event={"ID":"da04b93a-0fad-4518-bb39-248c229be6c6","Type":"ContainerStarted","Data":"8a619913de7473a7b7ab571ace08a1b6c73b79b69c516f63376cd73723c95958"}
Jul 22 03:15:04.791533 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:04.791473    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" podStartSLOduration=1.791455472 podStartE2EDuration="1.791455472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:15:04.789622557 +0000 UTC m=+2273.251013295" watchObservedRunningTime="2026-07-22 03:15:04.791455472 +0000 UTC m=+2273.252846210"
Jul 22 03:15:07.849706 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:07.849665    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:15:13.958425 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:13.958396    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:13.958425 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:13.958441    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:13.972182 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:13.972124    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:14.838647 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:14.838610    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:15:21.257088 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:21.257042    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:15:49.561950 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:49.561914    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:15:50.558536 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.558487    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:15:50.677857 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.677811    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"]
Jul 22 03:15:50.681516 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.681487    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:50.683650 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.683626    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:15:50.683816 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.683626    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:15:50.688669 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.688632    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"]
Jul 22 03:15:50.821645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.821529    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m\" (UID: \"82accda3-130c-43a9-9cd6-331f1b48dd64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:50.922170 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.922106    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m\" (UID: \"82accda3-130c-43a9-9cd6-331f1b48dd64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:50.922776 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.922754    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m\" (UID: \"82accda3-130c-43a9-9cd6-331f1b48dd64\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:50.994735 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:50.994693    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:51.147083 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:51.147037    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"]
Jul 22 03:15:51.150888 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:15:51.150841    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82accda3_130c_43a9_9cd6_331f1b48dd64.slice/crio-04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428 WatchSource:0}: Error finding container 04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428: Status 404 returned error can't find the container with id 04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428
Jul 22 03:15:52.027101 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:52.027063    2523 generic.go:356] "Generic (PLEG): container finished" podID="82accda3-130c-43a9-9cd6-331f1b48dd64" containerID="fec20f080b9d86832cb5ef426059070e9761c832a3623f6207f82d46aa3cec89" exitCode=0
Jul 22 03:15:52.027545 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:52.027187    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m" event={"ID":"82accda3-130c-43a9-9cd6-331f1b48dd64","Type":"ContainerDied","Data":"fec20f080b9d86832cb5ef426059070e9761c832a3623f6207f82d46aa3cec89"}
Jul 22 03:15:52.027545 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:52.027246    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m" event={"ID":"82accda3-130c-43a9-9cd6-331f1b48dd64","Type":"ContainerStarted","Data":"04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428"}
Jul 22 03:15:53.173023 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:53.172988    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:53.243807 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:53.243764    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca\") pod \"82accda3-130c-43a9-9cd6-331f1b48dd64\" (UID: \"82accda3-130c-43a9-9cd6-331f1b48dd64\") "
Jul 22 03:15:53.244194 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:53.244169    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "82accda3-130c-43a9-9cd6-331f1b48dd64" (UID: "82accda3-130c-43a9-9cd6-331f1b48dd64"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:15:53.344488 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:53.344389    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/82accda3-130c-43a9-9cd6-331f1b48dd64-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:15:53.958553 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:53.958504    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:15:54.039487 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:54.039458    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"
Jul 22 03:15:54.039681 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:54.039450    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m" event={"ID":"82accda3-130c-43a9-9cd6-331f1b48dd64","Type":"ContainerDied","Data":"04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428"}
Jul 22 03:15:54.039681 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:15:54.039585    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04f326572627ce304e82f04930dc4ae27aa4d93241c1f05c013fc10c6d417428"
Jul 22 03:16:01.092440 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:01.092391    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"]
Jul 22 03:16:01.094997 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:01.094969    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-9ded6d-29744835-x5qvz"]
Jul 22 03:16:01.956697 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:01.956641    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a75eeef3-70f6-4248-b754-9ab459bca974" path="/var/lib/kubelet/pods/a75eeef3-70f6-4248-b754-9ab459bca974/volumes"
Jul 22 03:16:04.583767 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.583689    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" podUID="ead02283-4c16-4cf4-915c-7034ef9062f4" containerName="main" containerID="cri-o://14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a" gracePeriod=45
Jul 22 03:16:04.849681 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.849604    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:16:04.952230 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952190    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952244    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952281    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952299    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952325    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mq8g\" (UniqueName: \"kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952409    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home\") pod \"ead02283-4c16-4cf4-915c-7034ef9062f4\" (UID: \"ead02283-4c16-4cf4-915c-7034ef9062f4\") "
Jul 22 03:16:04.952705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952546    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache" (OuterVolumeSpecName: "model-cache") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:04.952705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952605    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:04.952705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952682    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:04.952822 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952722    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:04.952822 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.952757    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home" (OuterVolumeSpecName: "home") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:04.954728 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.954702    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm" (OuterVolumeSpecName: "dshm") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:04.955113 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.955091    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:16:04.955113 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:04.955101    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g" (OuterVolumeSpecName: "kube-api-access-4mq8g") pod "ead02283-4c16-4cf4-915c-7034ef9062f4" (UID: "ead02283-4c16-4cf4-915c-7034ef9062f4"). InnerVolumeSpecName "kube-api-access-4mq8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:05.053896 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.053846    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mq8g\" (UniqueName: \"kubernetes.io/projected/ead02283-4c16-4cf4-915c-7034ef9062f4-kube-api-access-4mq8g\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.053896 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.053889    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.053896 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.053905    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead02283-4c16-4cf4-915c-7034ef9062f4-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.054235 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.053918    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead02283-4c16-4cf4-915c-7034ef9062f4-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.101547 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.101440    2523 generic.go:356] "Generic (PLEG): container finished" podID="ead02283-4c16-4cf4-915c-7034ef9062f4" containerID="14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a" exitCode=0
Jul 22 03:16:05.101547 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.101490    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"
Jul 22 03:16:05.101547 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.101523    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" event={"ID":"ead02283-4c16-4cf4-915c-7034ef9062f4","Type":"ContainerDied","Data":"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"}
Jul 22 03:16:05.101819 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.101579    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m" event={"ID":"ead02283-4c16-4cf4-915c-7034ef9062f4","Type":"ContainerDied","Data":"c865e6f8a5745a289b2ae06f763d4f9dc851ca06b7c66df4bb3857589704f89e"}
Jul 22 03:16:05.101819 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.101598    2523 scope.go:117] "RemoveContainer" containerID="14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"
Jul 22 03:16:05.112465 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.112443    2523 scope.go:117] "RemoveContainer" containerID="14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"
Jul 22 03:16:05.112807 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:16:05.112780    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a\": container with ID starting with 14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a not found: ID does not exist" containerID="14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"
Jul 22 03:16:05.112910 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.112815    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a"} err="failed to get container status \"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a\": rpc error: code = NotFound desc = could not find container \"14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a\": container with ID starting with 14f45be1250564c618502f3ff3368e75ca0788fad3a0fad7db6942979cac872a not found: ID does not exist"
Jul 22 03:16:05.122524 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.122485    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:16:05.132820 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.128000    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9ded6d/test-model-9ded6d-kserve-65c84b98b5-x775m"]
Jul 22 03:16:05.580110 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.580059    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" podUID="da04b93a-0fad-4518-bb39-248c229be6c6" containerName="main" containerID="cri-o://952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530" gracePeriod=45
Jul 22 03:16:05.750999 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.750961    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"]
Jul 22 03:16:05.754421 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.754389    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ded6d-w7l6m"]
Jul 22 03:16:05.844547 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.844461    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:16:05.957488 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.957453    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82accda3-130c-43a9-9cd6-331f1b48dd64" path="/var/lib/kubelet/pods/82accda3-130c-43a9-9cd6-331f1b48dd64/volumes"
Jul 22 03:16:05.957867 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.957854    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead02283-4c16-4cf4-915c-7034ef9062f4" path="/var/lib/kubelet/pods/ead02283-4c16-4cf4-915c-7034ef9062f4/volumes"
Jul 22 03:16:05.963080 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963043    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmrtj\" (UniqueName: \"kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963269 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963101    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963269 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963205    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963269 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963247    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963466 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963282    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963466 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963324    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs\") pod \"da04b93a-0fad-4518-bb39-248c229be6c6\" (UID: \"da04b93a-0fad-4518-bb39-248c229be6c6\") "
Jul 22 03:16:05.963466 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963450    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home" (OuterVolumeSpecName: "home") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:05.963617 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963501    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:05.963617 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963590    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:05.963720 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963694    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.963720 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963718    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.963822 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.963729    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:05.965772 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.965744    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:16:05.965913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.965875    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm" (OuterVolumeSpecName: "dshm") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:16:05.965913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:05.965893    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj" (OuterVolumeSpecName: "kube-api-access-zmrtj") pod "da04b93a-0fad-4518-bb39-248c229be6c6" (UID: "da04b93a-0fad-4518-bb39-248c229be6c6"). InnerVolumeSpecName "kube-api-access-zmrtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:06.064740 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.064678    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmrtj\" (UniqueName: \"kubernetes.io/projected/da04b93a-0fad-4518-bb39-248c229be6c6-kube-api-access-zmrtj\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:06.064740 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.064729    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da04b93a-0fad-4518-bb39-248c229be6c6-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:06.064740 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.064740    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da04b93a-0fad-4518-bb39-248c229be6c6-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:06.110087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.109980    2523 generic.go:356] "Generic (PLEG): container finished" podID="da04b93a-0fad-4518-bb39-248c229be6c6" containerID="952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530" exitCode=0
Jul 22 03:16:06.110087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.110034    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"
Jul 22 03:16:06.110377 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.110075    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" event={"ID":"da04b93a-0fad-4518-bb39-248c229be6c6","Type":"ContainerDied","Data":"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"}
Jul 22 03:16:06.110377 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.110133    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g" event={"ID":"da04b93a-0fad-4518-bb39-248c229be6c6","Type":"ContainerDied","Data":"8a619913de7473a7b7ab571ace08a1b6c73b79b69c516f63376cd73723c95958"}
Jul 22 03:16:06.110377 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.110174    2523 scope.go:117] "RemoveContainer" containerID="952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"
Jul 22 03:16:06.120801 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.120777    2523 scope.go:117] "RemoveContainer" containerID="952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"
Jul 22 03:16:06.121122 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:16:06.121098    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530\": container with ID starting with 952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530 not found: ID does not exist" containerID="952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"
Jul 22 03:16:06.121247 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.121131    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530"} err="failed to get container status \"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530\": rpc error: code = NotFound desc = could not find container \"952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530\": container with ID starting with 952631b120e0d8c254c92294756feaa063decbe5206c7f531f6643f61622b530 not found: ID does not exist"
Jul 22 03:16:06.131702 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.131664    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:16:06.137431 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.137394    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fec108/test-model-fec108-kserve-6d56b8f4c5-7sr2g"]
Jul 22 03:16:06.345639 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:06.345600    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:16:07.956834 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:07.956797    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da04b93a-0fad-4518-bb39-248c229be6c6" path="/var/lib/kubelet/pods/da04b93a-0fad-4518-bb39-248c229be6c6/volumes"
Jul 22 03:16:12.228285 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.228245    2523 scope.go:117] "RemoveContainer" containerID="33c8fa7aea0535fef6351a81996c3d3f1a999debe8f42996d4b5f2d885bc3565"
Jul 22 03:16:12.872461 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872424    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"]
Jul 22 03:16:12.872861 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872847    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da04b93a-0fad-4518-bb39-248c229be6c6" containerName="main"
Jul 22 03:16:12.872913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872866    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="da04b93a-0fad-4518-bb39-248c229be6c6" containerName="main"
Jul 22 03:16:12.872913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872875    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead02283-4c16-4cf4-915c-7034ef9062f4" containerName="main"
Jul 22 03:16:12.872913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872881    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead02283-4c16-4cf4-915c-7034ef9062f4" containerName="main"
Jul 22 03:16:12.872913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872889    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82accda3-130c-43a9-9cd6-331f1b48dd64" containerName="revoke-keys"
Jul 22 03:16:12.872913 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872896    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="82accda3-130c-43a9-9cd6-331f1b48dd64" containerName="revoke-keys"
Jul 22 03:16:12.873069 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872957    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="82accda3-130c-43a9-9cd6-331f1b48dd64" containerName="revoke-keys"
Jul 22 03:16:12.873069 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872967    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="da04b93a-0fad-4518-bb39-248c229be6c6" containerName="main"
Jul 22 03:16:12.873069 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.872973    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead02283-4c16-4cf4-915c-7034ef9062f4" containerName="main"
Jul 22 03:16:12.877840 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.877813    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:12.880497 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.880470    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:16:12.880691 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.880551    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:16:12.892642 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.892609    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"]
Jul 22 03:16:12.926282 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:12.926242    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx\" (UID: \"a55ae49e-2417-4fdf-86cd-eae3a35936ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:13.027747 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:13.027699    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx\" (UID: \"a55ae49e-2417-4fdf-86cd-eae3a35936ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:13.028464 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:13.028443    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx\" (UID: \"a55ae49e-2417-4fdf-86cd-eae3a35936ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:13.189907 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:13.189797    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:13.349038 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:13.349011    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"]
Jul 22 03:16:13.351827 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:16:13.351797    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55ae49e_2417_4fdf_86cd_eae3a35936ff.slice/crio-9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c WatchSource:0}: Error finding container 9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c: Status 404 returned error can't find the container with id 9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c
Jul 22 03:16:14.155845 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:14.155807    2523 generic.go:356] "Generic (PLEG): container finished" podID="a55ae49e-2417-4fdf-86cd-eae3a35936ff" containerID="b13babd1a0f05d04bbb55595007f7d9585bc636d20bdd455e56b6c6764fbbcd6" exitCode=0
Jul 22 03:16:14.156027 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:14.155894    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx" event={"ID":"a55ae49e-2417-4fdf-86cd-eae3a35936ff","Type":"ContainerDied","Data":"b13babd1a0f05d04bbb55595007f7d9585bc636d20bdd455e56b6c6764fbbcd6"}
Jul 22 03:16:14.156027 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:14.155948    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx" event={"ID":"a55ae49e-2417-4fdf-86cd-eae3a35936ff","Type":"ContainerStarted","Data":"9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c"}
Jul 22 03:16:15.302478 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:15.302438    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:15.449763 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:15.449658    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca\") pod \"a55ae49e-2417-4fdf-86cd-eae3a35936ff\" (UID: \"a55ae49e-2417-4fdf-86cd-eae3a35936ff\") "
Jul 22 03:16:15.450073 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:15.450047    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a55ae49e-2417-4fdf-86cd-eae3a35936ff" (UID: "a55ae49e-2417-4fdf-86cd-eae3a35936ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:16:15.550550 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:15.550508    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55ae49e-2417-4fdf-86cd-eae3a35936ff-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:16:16.168536 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:16.168504    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"
Jul 22 03:16:16.168536 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:16.168519    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx" event={"ID":"a55ae49e-2417-4fdf-86cd-eae3a35936ff","Type":"ContainerDied","Data":"9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c"}
Jul 22 03:16:16.168797 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:16.168566    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9adbd5a289915ef1394f08b9b2899c0fddd32300f61d7a3e3ee4a45d47cc6d4c"
Jul 22 03:16:23.271283 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:23.271241    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"]
Jul 22 03:16:23.276325 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:23.276286    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-fec108-29744835-gfpfr"]
Jul 22 03:16:23.963302 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:23.963263    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f03e2ec-1f35-413e-aa52-cea2ae42ad56" path="/var/lib/kubelet/pods/4f03e2ec-1f35-413e-aa52-cea2ae42ad56/volumes"
Jul 22 03:16:26.044277 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:26.044232    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:16:27.930630 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:27.930590    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"]
Jul 22 03:16:27.937665 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:27.937635    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fec108-xk2mx"]
Jul 22 03:16:27.957649 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:27.957602    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55ae49e-2417-4fdf-86cd-eae3a35936ff" path="/var/lib/kubelet/pods/a55ae49e-2417-4fdf-86cd-eae3a35936ff/volumes"
Jul 22 03:16:44.254627 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:44.254583    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:16:59.336135 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.336098    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"]
Jul 22 03:16:59.336584 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.336496    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a55ae49e-2417-4fdf-86cd-eae3a35936ff" containerName="revoke-keys"
Jul 22 03:16:59.336584 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.336509    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55ae49e-2417-4fdf-86cd-eae3a35936ff" containerName="revoke-keys"
Jul 22 03:16:59.336658 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.336586    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="a55ae49e-2417-4fdf-86cd-eae3a35936ff" containerName="revoke-keys"
Jul 22 03:16:59.339946 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.339925    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:16:59.342001 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.341977    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:16:59.342172 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.341976    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:16:59.346991 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.346964    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"]
Jul 22 03:16:59.462429 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.462367    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-34fcb8-tml75\" (UID: \"2712698c-7701-4cd2-acaf-359d3287ff6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:16:59.563434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.563394    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-34fcb8-tml75\" (UID: \"2712698c-7701-4cd2-acaf-359d3287ff6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:16:59.564013 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.563994    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-34fcb8-tml75\" (UID: \"2712698c-7701-4cd2-acaf-359d3287ff6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:16:59.653077 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.652985    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:16:59.808496 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:16:59.808447    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"]
Jul 22 03:16:59.811400 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:16:59.811368    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2712698c_7701_4cd2_acaf_359d3287ff6b.slice/crio-c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba WatchSource:0}: Error finding container c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba: Status 404 returned error can't find the container with id c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba
Jul 22 03:17:00.418242 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:00.418119    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75" event={"ID":"2712698c-7701-4cd2-acaf-359d3287ff6b","Type":"ContainerStarted","Data":"a031fc521bcdd4450306be0570371d5842a389ac2f452efbc57b94005a865316"}
Jul 22 03:17:00.418242 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:00.418202    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75" event={"ID":"2712698c-7701-4cd2-acaf-359d3287ff6b","Type":"ContainerStarted","Data":"c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba"}
Jul 22 03:17:00.434182 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:00.434100    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75" podStartSLOduration=1.4340797809999999 podStartE2EDuration="1.434079781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:00.431758791 +0000 UTC m=+2388.893149556" watchObservedRunningTime="2026-07-22 03:17:00.434079781 +0000 UTC m=+2388.895470518"
Jul 22 03:17:01.425619 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:01.425577    2523 generic.go:356] "Generic (PLEG): container finished" podID="2712698c-7701-4cd2-acaf-359d3287ff6b" containerID="a031fc521bcdd4450306be0570371d5842a389ac2f452efbc57b94005a865316" exitCode=0
Jul 22 03:17:01.426048 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:01.425664    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75" event={"ID":"2712698c-7701-4cd2-acaf-359d3287ff6b","Type":"ContainerDied","Data":"a031fc521bcdd4450306be0570371d5842a389ac2f452efbc57b94005a865316"}
Jul 22 03:17:01.458887 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:01.458843    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:17:02.578210 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:02.578180    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:17:02.695311 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:02.695201    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca\") pod \"2712698c-7701-4cd2-acaf-359d3287ff6b\" (UID: \"2712698c-7701-4cd2-acaf-359d3287ff6b\") "
Jul 22 03:17:02.695556 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:02.695531    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2712698c-7701-4cd2-acaf-359d3287ff6b" (UID: "2712698c-7701-4cd2-acaf-359d3287ff6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:17:02.795894 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:02.795853    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2712698c-7701-4cd2-acaf-359d3287ff6b-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:17:03.437968 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:03.437933    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"
Jul 22 03:17:03.438177 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:03.437965    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75" event={"ID":"2712698c-7701-4cd2-acaf-359d3287ff6b","Type":"ContainerDied","Data":"c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba"}
Jul 22 03:17:03.438177 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:03.438021    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3de252f08b8880090d7e2b69e86eb587f4a9c04b52d3b7ccdfb58e2789ce3ba"
Jul 22 03:17:12.130113 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:12.130076    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:17:12.133116 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:12.133085    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:17:12.135416 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:12.135391    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:17:12.138315 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:12.138292    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:17:19.047252 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:19.047210    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:17:19.404956 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:19.404851    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"]
Jul 22 03:17:19.407297 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:19.407261    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-34fcb8-tml75"]
Jul 22 03:17:19.957507 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:19.957463    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2712698c-7701-4cd2-acaf-359d3287ff6b" path="/var/lib/kubelet/pods/2712698c-7701-4cd2-acaf-359d3287ff6b/volumes"
Jul 22 03:17:26.595011 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.594968    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"]
Jul 22 03:17:26.595443 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.595380    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2712698c-7701-4cd2-acaf-359d3287ff6b" containerName="revoke-keys"
Jul 22 03:17:26.595443 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.595392    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="2712698c-7701-4cd2-acaf-359d3287ff6b" containerName="revoke-keys"
Jul 22 03:17:26.595520 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.595471    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="2712698c-7701-4cd2-acaf-359d3287ff6b" containerName="revoke-keys"
Jul 22 03:17:26.598813 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.598787    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:26.601612 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.601590    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:17:26.605816 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.605583    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:17:26.612923 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.612890    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4\" (UID: \"ef001a2c-89ca-45d1-a24b-912511e7093a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:26.615847 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.615819    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"]
Jul 22 03:17:26.713981 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.713938    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4\" (UID: \"ef001a2c-89ca-45d1-a24b-912511e7093a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:26.714636 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.714612    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4\" (UID: \"ef001a2c-89ca-45d1-a24b-912511e7093a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:26.909104 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:26.908989    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:27.059742 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:27.059709    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"]
Jul 22 03:17:27.062131 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:17:27.062093    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef001a2c_89ca_45d1_a24b_912511e7093a.slice/crio-345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91 WatchSource:0}: Error finding container 345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91: Status 404 returned error can't find the container with id 345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91
Jul 22 03:17:27.573254 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:27.573121    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4" event={"ID":"ef001a2c-89ca-45d1-a24b-912511e7093a","Type":"ContainerStarted","Data":"9e182fd7e7c83667b0dbce874381889757f426e89adc89c7c176e2ec22553009"}
Jul 22 03:17:27.573254 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:27.573237    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4" event={"ID":"ef001a2c-89ca-45d1-a24b-912511e7093a","Type":"ContainerStarted","Data":"345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91"}
Jul 22 03:17:27.587835 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:27.587776    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4" podStartSLOduration=1.58775665 podStartE2EDuration="1.58775665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:27.586881787 +0000 UTC m=+2416.048272530" watchObservedRunningTime="2026-07-22 03:17:27.58775665 +0000 UTC m=+2416.049147367"
Jul 22 03:17:28.579955 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:28.579915    2523 generic.go:356] "Generic (PLEG): container finished" podID="ef001a2c-89ca-45d1-a24b-912511e7093a" containerID="9e182fd7e7c83667b0dbce874381889757f426e89adc89c7c176e2ec22553009" exitCode=0
Jul 22 03:17:28.580427 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:28.580004    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4" event={"ID":"ef001a2c-89ca-45d1-a24b-912511e7093a","Type":"ContainerDied","Data":"9e182fd7e7c83667b0dbce874381889757f426e89adc89c7c176e2ec22553009"}
Jul 22 03:17:29.730763 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:29.730725    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:29.840531 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:29.840429    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca\") pod \"ef001a2c-89ca-45d1-a24b-912511e7093a\" (UID: \"ef001a2c-89ca-45d1-a24b-912511e7093a\") "
Jul 22 03:17:29.840808 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:29.840784    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef001a2c-89ca-45d1-a24b-912511e7093a" (UID: "ef001a2c-89ca-45d1-a24b-912511e7093a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:17:29.941520 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:29.941479    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef001a2c-89ca-45d1-a24b-912511e7093a-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:17:30.599970 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:30.599935    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"
Jul 22 03:17:30.600178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:30.599970    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4" event={"ID":"ef001a2c-89ca-45d1-a24b-912511e7093a","Type":"ContainerDied","Data":"345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91"}
Jul 22 03:17:30.600178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:30.600058    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="345701701c03bafc8e2f8bdec6aceaea13d86cad23eb4066501ac6204e543c91"
Jul 22 03:17:46.742387 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:46.742296    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"]
Jul 22 03:17:46.744752 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:46.744725    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-8dba71-mkfx4"]
Jul 22 03:17:46.754811 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:46.754774    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:17:47.957234 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:17:47.957192    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef001a2c-89ca-45d1-a24b-912511e7093a" path="/var/lib/kubelet/pods/ef001a2c-89ca-45d1-a24b-912511e7093a/volumes"
Jul 22 03:18:04.756464 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:04.756420    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:18:12.269344 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:12.269311    2523 scope.go:117] "RemoveContainer" containerID="ddcd81589186360ad9072569a91d2761aebd53eaa623536bca0741fb60aadc19"
Jul 22 03:18:18.755921 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:18.755880    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:18:20.954704 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.954669    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:18:20.955103 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.955046    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef001a2c-89ca-45d1-a24b-912511e7093a" containerName="revoke-keys"
Jul 22 03:18:20.955103 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.955056    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef001a2c-89ca-45d1-a24b-912511e7093a" containerName="revoke-keys"
Jul 22 03:18:20.955206 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.955151    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef001a2c-89ca-45d1-a24b-912511e7093a" containerName="revoke-keys"
Jul 22 03:18:20.958324 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.958306    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:20.961098 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.961069    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72501c\"/\"kube-root-ca.crt\""
Jul 22 03:18:20.961314 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.961069    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-72501c\"/\"openshift-service-ca.crt\""
Jul 22 03:18:20.961314 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.961069    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72501c\"/\"auth-test-model-72501c-kserve-self-signed-certs\""
Jul 22 03:18:20.961314 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.961069    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-72501c\"/\"default-dockercfg-k5gzz\""
Jul 22 03:18:20.970312 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:20.970285    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:18:21.015855 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.015809    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.015855 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.015849    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjlk\" (UniqueName: \"kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.016161 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.015884    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.016161 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.016015    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.016287 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.016134    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.016358 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.016338    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.117907 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.117865    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.117907 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.117911    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjlk\" (UniqueName: \"kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118265 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118102    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118265 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118133    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118265 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118219    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118433 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118282    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118541 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118524    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118605 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118574    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.118605 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.118594    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.120558 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.120534    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.120845 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.120826    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.128042 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.128008    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjlk\" (UniqueName: \"kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk\") pod \"auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") " pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.268397 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.268358    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:21.418067 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.418034    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:18:21.420946 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:18:21.420912    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e9203aa_d3fd_4703_9442_3d77c7e82d45.slice/crio-f1c1e9d4e3f07b4f8b9e3750bb76ef676c7ccca8c620f99095f6bbe97d95bdb6 WatchSource:0}: Error finding container f1c1e9d4e3f07b4f8b9e3750bb76ef676c7ccca8c620f99095f6bbe97d95bdb6: Status 404 returned error can't find the container with id f1c1e9d4e3f07b4f8b9e3750bb76ef676c7ccca8c620f99095f6bbe97d95bdb6
Jul 22 03:18:21.891885 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.891838    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" event={"ID":"2e9203aa-d3fd-4703-9442-3d77c7e82d45","Type":"ContainerStarted","Data":"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"}
Jul 22 03:18:21.892078 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.891896    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" event={"ID":"2e9203aa-d3fd-4703-9442-3d77c7e82d45","Type":"ContainerStarted","Data":"f1c1e9d4e3f07b4f8b9e3750bb76ef676c7ccca8c620f99095f6bbe97d95bdb6"}
Jul 22 03:18:21.911612 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:21.911539    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" podStartSLOduration=1.91151853 podStartE2EDuration="1.91151853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:21.910405833 +0000 UTC m=+2470.371796596" watchObservedRunningTime="2026-07-22 03:18:21.91151853 +0000 UTC m=+2470.372909268"
Jul 22 03:18:27.656572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:27.656522    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:18:31.269535 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:31.269493    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:31.270023 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:31.269554    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:31.282924 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:31.282897    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:31.965686 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:31.965652    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:18:49.170966 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.170927    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:18:49.174421 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.174398    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.177389 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.177356    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"openshift-service-ca.crt\""
Jul 22 03:18:49.177389 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.177356    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"kube-root-ca.crt\""
Jul 22 03:18:49.177605 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.177356    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"auth-test-model-e9ef33-kserve-self-signed-certs\""
Jul 22 03:18:49.177605 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.177410    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"default-dockercfg-clb7k\""
Jul 22 03:18:49.186916 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.186880    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:18:49.283321 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283273    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.283321 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283322    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rbbb\" (UniqueName: \"kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.283572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283405    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.283572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283460    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.283572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283486    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.283572 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.283510    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384048 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384008    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384064    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rbbb\" (UniqueName: \"kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384112    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384204    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384230    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384257    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384591 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384512    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384647 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384627    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.384688 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.384646    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.386777 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.386755    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.386959 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.386938    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.394034 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.393994    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rbbb\" (UniqueName: \"kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb\") pod \"auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") " pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.484762 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.484723    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:49.636827 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:49.636795    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:18:49.638536 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:18:49.638503    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1d57950_1da3_4709_9f95_9fb10d7285bc.slice/crio-cfe25facaba101d126519dea9d5ca84821cd5246b97f7b885700bb235dacdf2c WatchSource:0}: Error finding container cfe25facaba101d126519dea9d5ca84821cd5246b97f7b885700bb235dacdf2c: Status 404 returned error can't find the container with id cfe25facaba101d126519dea9d5ca84821cd5246b97f7b885700bb235dacdf2c
Jul 22 03:18:50.048714 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:50.048670    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" event={"ID":"d1d57950-1da3-4709-9f95-9fb10d7285bc","Type":"ContainerStarted","Data":"2616546eb1f865851c0c893e1893b5ccb141f70a9ed923766d739bf748dda8fc"}
Jul 22 03:18:50.048714 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:50.048720    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" event={"ID":"d1d57950-1da3-4709-9f95-9fb10d7285bc","Type":"ContainerStarted","Data":"cfe25facaba101d126519dea9d5ca84821cd5246b97f7b885700bb235dacdf2c"}
Jul 22 03:18:50.072927 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:50.072867    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" podStartSLOduration=1.072833104 podStartE2EDuration="1.072833104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:50.069649223 +0000 UTC m=+2498.531039960" watchObservedRunningTime="2026-07-22 03:18:50.072833104 +0000 UTC m=+2498.534223844"
Jul 22 03:18:52.654286 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:52.654247    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:18:59.485771 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:59.485722    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:59.485771 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:59.485783    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:18:59.498823 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:18:59.498791    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:19:00.114556 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:19:00.114520    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:19:06.453637 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:19:06.453593    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:19:24.065103 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:19:24.065059    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:19:41.752084 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:19:41.752029    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:19:58.051183 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:19:58.051128    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:20:13.445220 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:13.445182    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:20:30.944251 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:30.944200    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:20:44.475997 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:44.475904    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:20:45.582697 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:45.582656    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:20:48.662351 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:48.662314    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:20:59.497223 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.497137    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" podUID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" containerName="main" containerID="cri-o://5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43" gracePeriod=45
Jul 22 03:20:59.753937 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.753863    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:20:59.783490 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.783449    2523 generic.go:356] "Generic (PLEG): container finished" podID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" containerID="5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43" exitCode=0
Jul 22 03:20:59.783695 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.783508    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"
Jul 22 03:20:59.783695 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.783503    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" event={"ID":"2e9203aa-d3fd-4703-9442-3d77c7e82d45","Type":"ContainerDied","Data":"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"}
Jul 22 03:20:59.783825 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.783698    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4" event={"ID":"2e9203aa-d3fd-4703-9442-3d77c7e82d45","Type":"ContainerDied","Data":"f1c1e9d4e3f07b4f8b9e3750bb76ef676c7ccca8c620f99095f6bbe97d95bdb6"}
Jul 22 03:20:59.783825 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.783728    2523 scope.go:117] "RemoveContainer" containerID="5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"
Jul 22 03:20:59.794367 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.794333    2523 scope.go:117] "RemoveContainer" containerID="5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"
Jul 22 03:20:59.794722 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:20:59.794697    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43\": container with ID starting with 5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43 not found: ID does not exist" containerID="5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"
Jul 22 03:20:59.794781 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.794736    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43"} err="failed to get container status \"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43\": rpc error: code = NotFound desc = could not find container \"5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43\": container with ID starting with 5975b53f38a9fbe93ebb586b8a4408249ec5d02ecfa442736b7d16dbafb16e43 not found: ID does not exist"
Jul 22 03:20:59.935945 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.935900    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.935956    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.935981    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936017    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936046    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpjlk\" (UniqueName: \"kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936175 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936087    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir\") pod \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\" (UID: \"2e9203aa-d3fd-4703-9442-3d77c7e82d45\") "
Jul 22 03:20:59.936446 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936293    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home" (OuterVolumeSpecName: "home") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:20:59.936446 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936306    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:20:59.936446 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936422    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:20:59.936446 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936441    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:20:59.936607 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.936443    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:20:59.938584 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.938552    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm" (OuterVolumeSpecName: "dshm") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:20:59.938700 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.938605    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:20:59.938700 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:20:59.938607    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk" (OuterVolumeSpecName: "kube-api-access-kpjlk") pod "2e9203aa-d3fd-4703-9442-3d77c7e82d45" (UID: "2e9203aa-d3fd-4703-9442-3d77c7e82d45"). InnerVolumeSpecName "kube-api-access-kpjlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:21:00.037418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.037322    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:00.037418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.037355    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpjlk\" (UniqueName: \"kubernetes.io/projected/2e9203aa-d3fd-4703-9442-3d77c7e82d45-kube-api-access-kpjlk\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:00.037418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.037366    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:00.037418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.037375    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e9203aa-d3fd-4703-9442-3d77c7e82d45-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:00.101060 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.101020    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:21:00.105985 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.105945    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-72501c/auth-test-model-72501c-kserve-5f56c4fdd7-pmmn4"]
Jul 22 03:21:00.604211 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.604166    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" podUID="d1d57950-1da3-4709-9f95-9fb10d7285bc" containerName="main" containerID="cri-o://2616546eb1f865851c0c893e1893b5ccb141f70a9ed923766d739bf748dda8fc" gracePeriod=45
Jul 22 03:21:00.804134 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.804102    2523 generic.go:356] "Generic (PLEG): container finished" podID="d1d57950-1da3-4709-9f95-9fb10d7285bc" containerID="2616546eb1f865851c0c893e1893b5ccb141f70a9ed923766d739bf748dda8fc" exitCode=0
Jul 22 03:21:00.804326 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.804193    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" event={"ID":"d1d57950-1da3-4709-9f95-9fb10d7285bc","Type":"ContainerDied","Data":"2616546eb1f865851c0c893e1893b5ccb141f70a9ed923766d739bf748dda8fc"}
Jul 22 03:21:00.868480 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:00.868399    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:21:01.047833 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.047790    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.047846    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.047931    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048003    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048040    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rbbb\" (UniqueName: \"kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048063    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm\") pod \"d1d57950-1da3-4709-9f95-9fb10d7285bc\" (UID: \"d1d57950-1da3-4709-9f95-9fb10d7285bc\") "
Jul 22 03:21:01.048090 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048061    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:01.048454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048246    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home" (OuterVolumeSpecName: "home") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:01.048454 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048324    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:01.048909 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048885    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.049001 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048913    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.049001 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.048931    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.050323 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.050301    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:21:01.050907 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.050885    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb" (OuterVolumeSpecName: "kube-api-access-5rbbb") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "kube-api-access-5rbbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:21:01.050907 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.050889    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm" (OuterVolumeSpecName: "dshm") pod "d1d57950-1da3-4709-9f95-9fb10d7285bc" (UID: "d1d57950-1da3-4709-9f95-9fb10d7285bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:21:01.150092 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.150010    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rbbb\" (UniqueName: \"kubernetes.io/projected/d1d57950-1da3-4709-9f95-9fb10d7285bc-kube-api-access-5rbbb\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.150092 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.150040    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1d57950-1da3-4709-9f95-9fb10d7285bc-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.150092 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.150052    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1d57950-1da3-4709-9f95-9fb10d7285bc-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:21:01.460635 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.460603    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:21:01.811266 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.811180    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"
Jul 22 03:21:01.811266 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.811204    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd" event={"ID":"d1d57950-1da3-4709-9f95-9fb10d7285bc","Type":"ContainerDied","Data":"cfe25facaba101d126519dea9d5ca84821cd5246b97f7b885700bb235dacdf2c"}
Jul 22 03:21:01.811266 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.811253    2523 scope.go:117] "RemoveContainer" containerID="2616546eb1f865851c0c893e1893b5ccb141f70a9ed923766d739bf748dda8fc"
Jul 22 03:21:01.835079 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.835044    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:21:01.842467 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.842440    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/auth-test-model-e9ef33-kserve-6cd8f5c78c-45psd"]
Jul 22 03:21:01.958565 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.958528    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" path="/var/lib/kubelet/pods/2e9203aa-d3fd-4703-9442-3d77c7e82d45/volumes"
Jul 22 03:21:01.958908 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:01.958894    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d57950-1da3-4709-9f95-9fb10d7285bc" path="/var/lib/kubelet/pods/d1d57950-1da3-4709-9f95-9fb10d7285bc/volumes"
Jul 22 03:21:12.312193 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:12.312159    2523 scope.go:117] "RemoveContainer" containerID="fca0f0248979958feacb0c408a79c0967f8a38972ca0fc94c1eae451415f1f4e"
Jul 22 03:21:12.321440 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:12.321414    2523 scope.go:117] "RemoveContainer" containerID="d8797195ce6c39172fca0fdf6ce5f80796908754320d18d9086a27ae5ffe85c2"
Jul 22 03:21:43.766691 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.766649    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:21:43.767344 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767255    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d57950-1da3-4709-9f95-9fb10d7285bc" containerName="main"
Jul 22 03:21:43.767344 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767276    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d57950-1da3-4709-9f95-9fb10d7285bc" containerName="main"
Jul 22 03:21:43.767344 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767299    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" containerName="main"
Jul 22 03:21:43.767344 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767310    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" containerName="main"
Jul 22 03:21:43.767568 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767416    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e9203aa-d3fd-4703-9442-3d77c7e82d45" containerName="main"
Jul 22 03:21:43.767568 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.767429    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d57950-1da3-4709-9f95-9fb10d7285bc" containerName="main"
Jul 22 03:21:43.770631 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.770606    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.773798 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.773765    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"default-dockercfg-clb7k\""
Jul 22 03:21:43.773945 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.773820    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"kube-root-ca.crt\""
Jul 22 03:21:43.774087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.774070    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"openshift-service-ca.crt\""
Jul 22 03:21:43.774375 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.774358    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"sub-test-model-e9ef33-kserve-self-signed-certs\""
Jul 22 03:21:43.783636 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.783603    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:21:43.937209 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937171    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.937422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937228    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.937422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937253    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.937422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937299    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.937422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937351    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6868\" (UniqueName: \"kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:43.937422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:43.937388    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.038852 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038742    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.038852 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038811    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.038852 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038844    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038861    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038882    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039178 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.038914    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6868\" (UniqueName: \"kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039362 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.039236    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039362 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.039268    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.039362 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.039346    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.041484 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.041451    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.041634 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.041618    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.048239 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.048207    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6868\" (UniqueName: \"kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868\") pod \"sub-test-model-e9ef33-kserve-776c988bfc-xt4pp\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") " pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.081134 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.081091    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:44.232787 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:44.232755    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:21:44.235486 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:21:44.235454    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f64a98a_51e1_41b5_982d_9ccac7cb7442.slice/crio-e67c3e66dba6bc62d76be29e22809e919f980e4c626e69cbd97f7d652b791520 WatchSource:0}: Error finding container e67c3e66dba6bc62d76be29e22809e919f980e4c626e69cbd97f7d652b791520: Status 404 returned error can't find the container with id e67c3e66dba6bc62d76be29e22809e919f980e4c626e69cbd97f7d652b791520
Jul 22 03:21:45.042012 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:45.041971    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" event={"ID":"2f64a98a-51e1-41b5-982d-9ccac7cb7442","Type":"ContainerStarted","Data":"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"}
Jul 22 03:21:45.042573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:45.042030    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" event={"ID":"2f64a98a-51e1-41b5-982d-9ccac7cb7442","Type":"ContainerStarted","Data":"e67c3e66dba6bc62d76be29e22809e919f980e4c626e69cbd97f7d652b791520"}
Jul 22 03:21:45.063745 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:45.063681    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" podStartSLOduration=2.063660629 podStartE2EDuration="2.063660629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:21:45.062953122 +0000 UTC m=+2673.524344065" watchObservedRunningTime="2026-07-22 03:21:45.063660629 +0000 UTC m=+2673.525051370"
Jul 22 03:21:47.454228 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:47.454187    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:21:54.081449 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:54.081405    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:54.082219 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:54.081482    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:54.095040 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:54.095009    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:21:55.110026 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:21:55.109990    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:22:12.166418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:12.166388    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:22:12.169450 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:12.169423    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:22:12.172948 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:12.172908    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:22:12.175869 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:12.175845    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcmfl_c2721fa4-1f2a-4f54-9799-61163c9e7148/ovn-acl-logging/0.log"
Jul 22 03:22:12.355078 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:12.355042    2523 scope.go:117] "RemoveContainer" containerID="fec20f080b9d86832cb5ef426059070e9761c832a3623f6207f82d46aa3cec89"
Jul 22 03:22:17.885659 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:17.885618    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:22:35.790618 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:35.790578    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:22:39.294262 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:39.294210    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:22:49.600638 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:49.600599    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:22:50.811607 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:50.811539    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" podUID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" containerName="main" containerID="cri-o://54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0" gracePeriod=45
Jul 22 03:22:51.071371 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.071298    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:22:51.160242 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160196    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160426 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160254    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160426 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160303    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160426 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160371    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160426 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160398    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160622 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160458    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6868\" (UniqueName: \"kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868\") pod \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\" (UID: \"2f64a98a-51e1-41b5-982d-9ccac7cb7442\") "
Jul 22 03:22:51.160622 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160538    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:22:51.160738 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160656    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home" (OuterVolumeSpecName: "home") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:22:51.160793 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160783    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.160852 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160798    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.160981 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.160940    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache" (OuterVolumeSpecName: "model-cache") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:22:51.162631 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.162594    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:22:51.162723 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.162652    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm" (OuterVolumeSpecName: "dshm") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:22:51.162881 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.162854    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868" (OuterVolumeSpecName: "kube-api-access-r6868") pod "2f64a98a-51e1-41b5-982d-9ccac7cb7442" (UID: "2f64a98a-51e1-41b5-982d-9ccac7cb7442"). InnerVolumeSpecName "kube-api-access-r6868". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:22:51.261809 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.261758    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6868\" (UniqueName: \"kubernetes.io/projected/2f64a98a-51e1-41b5-982d-9ccac7cb7442-kube-api-access-r6868\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.261809 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.261799    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f64a98a-51e1-41b5-982d-9ccac7cb7442-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.261809 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.261811    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.262069 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.261824    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f64a98a-51e1-41b5-982d-9ccac7cb7442-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:22:51.415546 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.415453    2523 generic.go:356] "Generic (PLEG): container finished" podID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" containerID="54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0" exitCode=0
Jul 22 03:22:51.415546 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.415497    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"
Jul 22 03:22:51.415546 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.415506    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" event={"ID":"2f64a98a-51e1-41b5-982d-9ccac7cb7442","Type":"ContainerDied","Data":"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"}
Jul 22 03:22:51.415546 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.415538    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp" event={"ID":"2f64a98a-51e1-41b5-982d-9ccac7cb7442","Type":"ContainerDied","Data":"e67c3e66dba6bc62d76be29e22809e919f980e4c626e69cbd97f7d652b791520"}
Jul 22 03:22:51.415847 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.415556    2523 scope.go:117] "RemoveContainer" containerID="54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"
Jul 22 03:22:51.425054 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.425031    2523 scope.go:117] "RemoveContainer" containerID="54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"
Jul 22 03:22:51.425386 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:22:51.425365    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0\": container with ID starting with 54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0 not found: ID does not exist" containerID="54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"
Jul 22 03:22:51.425434 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.425395    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0"} err="failed to get container status \"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0\": rpc error: code = NotFound desc = could not find container \"54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0\": container with ID starting with 54df1b71b3da37ee69d0410e98cf152221aa9ff1409d28bd77806a02884920d0 not found: ID does not exist"
Jul 22 03:22:51.447271 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.447234    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:22:51.456567 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.456538    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/sub-test-model-e9ef33-kserve-776c988bfc-xt4pp"]
Jul 22 03:22:51.956769 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:22:51.956731    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" path="/var/lib/kubelet/pods/2f64a98a-51e1-41b5-982d-9ccac7cb7442/volumes"
Jul 22 03:23:12.377439 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:12.377404    2523 scope.go:117] "RemoveContainer" containerID="a031fc521bcdd4450306be0570371d5842a389ac2f452efbc57b94005a865316"
Jul 22 03:23:12.386662 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:12.386629    2523 scope.go:117] "RemoveContainer" containerID="b13babd1a0f05d04bbb55595007f7d9585bc636d20bdd455e56b6c6764fbbcd6"
Jul 22 03:23:14.375914 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.375873    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:23:14.376306 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.376271    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" containerName="main"
Jul 22 03:23:14.376306 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.376283    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" containerName="main"
Jul 22 03:23:14.376378 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.376365    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f64a98a-51e1-41b5-982d-9ccac7cb7442" containerName="main"
Jul 22 03:23:14.381005 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.380977    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.383515 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.383480    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"kube-root-ca.crt\""
Jul 22 03:23:14.384306 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.384283    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"rate-test-model-e9ef33-kserve-self-signed-certs\""
Jul 22 03:23:14.384439 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.384306    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"default-dockercfg-clb7k\""
Jul 22 03:23:14.384512 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.384472    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-e9ef33\"/\"openshift-service-ca.crt\""
Jul 22 03:23:14.400026 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.399995    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:23:14.470585 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470548    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.470768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470599    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.470768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470644    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.470768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470734    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.470768 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470757    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmn8\" (UniqueName: \"kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.470909 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.470783    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571287 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571241    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571287 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571288    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571538 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571365    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571538 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571395    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmn8\" (UniqueName: \"kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571538 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571434    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571538 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571478    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571805 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571781    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571872 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571821    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.571872 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.571857    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.573818 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.573793    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.574057 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.574038    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.581901 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.581871    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmn8\" (UniqueName: \"kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8\") pod \"rate-test-model-e9ef33-kserve-5b6db84499-cm6cm\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") " pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.691115 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.691018    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:14.845320 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:14.845292    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:23:14.847576 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:23:14.847528    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod749e967e_8fa0_48fd_b567_ce460c95134b.slice/crio-a9d945fd8bf02cb64c5d44dff9c5f96ed669dbf9ad88908db057838e4c37691b WatchSource:0}: Error finding container a9d945fd8bf02cb64c5d44dff9c5f96ed669dbf9ad88908db057838e4c37691b: Status 404 returned error can't find the container with id a9d945fd8bf02cb64c5d44dff9c5f96ed669dbf9ad88908db057838e4c37691b
Jul 22 03:23:15.548970 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:15.548917    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" event={"ID":"749e967e-8fa0-48fd-b567-ce460c95134b","Type":"ContainerStarted","Data":"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"}
Jul 22 03:23:15.548970 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:15.548985    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" event={"ID":"749e967e-8fa0-48fd-b567-ce460c95134b","Type":"ContainerStarted","Data":"a9d945fd8bf02cb64c5d44dff9c5f96ed669dbf9ad88908db057838e4c37691b"}
Jul 22 03:23:15.576718 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:15.576659    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" podStartSLOduration=1.5766418089999998 podStartE2EDuration="1.576641809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:23:15.574828991 +0000 UTC m=+2764.036219732" watchObservedRunningTime="2026-07-22 03:23:15.576641809 +0000 UTC m=+2764.038032547"
Jul 22 03:23:18.160392 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:18.160352    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:23:24.691443 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:24.691395    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:24.691908 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:24.691459    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:24.704909 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:24.704873    2523 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:25.614516 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:25.614484    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:23:32.061886 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:32.061837    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:23:48.382364 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:48.382327    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:23:49.304393 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.304325    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711620912"]
Jul 22 03:23:49.309202 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.309133    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:49.311934 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.311895    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tkzd7\""
Jul 22 03:23:49.314453 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.314401    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711620912"]
Jul 22 03:23:49.383735 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.383676    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8j5x\" (UniqueName: \"kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x\") pod \"test-curl-7404-139812711620912\" (UID: \"6d2f26cc-f7e0-4242-91b4-e277ae2873db\") " pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:49.484934 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.484888    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8j5x\" (UniqueName: \"kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x\") pod \"test-curl-7404-139812711620912\" (UID: \"6d2f26cc-f7e0-4242-91b4-e277ae2873db\") " pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:49.494218 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.494182    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8j5x\" (UniqueName: \"kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x\") pod \"test-curl-7404-139812711620912\" (UID: \"6d2f26cc-f7e0-4242-91b4-e277ae2873db\") " pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:49.624591 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.624497    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:49.774524 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.774488    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711620912"]
Jul 22 03:23:49.778413 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:23:49.778378    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d2f26cc_f7e0_4242_91b4_e277ae2873db.slice/crio-ac583bf5be153ae3cf7ebebd02e3d69b59c9ec007a5947d1a1a32894a0f1eb1e WatchSource:0}: Error finding container ac583bf5be153ae3cf7ebebd02e3d69b59c9ec007a5947d1a1a32894a0f1eb1e: Status 404 returned error can't find the container with id ac583bf5be153ae3cf7ebebd02e3d69b59c9ec007a5947d1a1a32894a0f1eb1e
Jul 22 03:23:49.779753 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:49.779733    2523 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:23:50.754229 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:50.754109    2523 generic.go:356] "Generic (PLEG): container finished" podID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" containerID="ea91be1ca16ea2c7f3eb5f7c58316b60c57b0834f008c01ff47c5f8ea1e01b1b" exitCode=0
Jul 22 03:23:50.754229 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:50.754190    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711620912" event={"ID":"6d2f26cc-f7e0-4242-91b4-e277ae2873db","Type":"ContainerDied","Data":"ea91be1ca16ea2c7f3eb5f7c58316b60c57b0834f008c01ff47c5f8ea1e01b1b"}
Jul 22 03:23:50.754684 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:50.754244    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711620912" event={"ID":"6d2f26cc-f7e0-4242-91b4-e277ae2873db","Type":"ContainerStarted","Data":"ac583bf5be153ae3cf7ebebd02e3d69b59c9ec007a5947d1a1a32894a0f1eb1e"}
Jul 22 03:23:51.255087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:51.255023    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:23:51.906236 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:51.906199    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:51.962432 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:51.962396    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711620912_6d2f26cc-f7e0-4242-91b4-e277ae2873db/test-curl-7404-139812711620912/0.log"
Jul 22 03:23:51.993199 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:51.993159    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711620912"]
Jul 22 03:23:51.996423 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:51.996384    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711620912"]
Jul 22 03:23:52.010698 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.010609    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8j5x\" (UniqueName: \"kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x\") pod \"6d2f26cc-f7e0-4242-91b4-e277ae2873db\" (UID: \"6d2f26cc-f7e0-4242-91b4-e277ae2873db\") "
Jul 22 03:23:52.013162 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.013119    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x" (OuterVolumeSpecName: "kube-api-access-t8j5x") pod "6d2f26cc-f7e0-4242-91b4-e277ae2873db" (UID: "6d2f26cc-f7e0-4242-91b4-e277ae2873db"). InnerVolumeSpecName "kube-api-access-t8j5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:23:52.112477 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.112437    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8j5x\" (UniqueName: \"kubernetes.io/projected/6d2f26cc-f7e0-4242-91b4-e277ae2873db-kube-api-access-t8j5x\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:23:52.120269 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.120229    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711621680"]
Jul 22 03:23:52.120638 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.120623    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" containerName="test-curl-7404-139812711620912"
Jul 22 03:23:52.120689 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.120640    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" containerName="test-curl-7404-139812711620912"
Jul 22 03:23:52.120725 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.120721    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" containerName="test-curl-7404-139812711620912"
Jul 22 03:23:52.123705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.123686    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:52.131734 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.131707    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711621680"]
Jul 22 03:23:52.213807 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.213762    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7r5\" (UniqueName: \"kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5\") pod \"test-curl-7404-139812711621680\" (UID: \"7275a513-ffce-4645-91c4-076780c797be\") " pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:52.315211 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.315096    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7r5\" (UniqueName: \"kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5\") pod \"test-curl-7404-139812711621680\" (UID: \"7275a513-ffce-4645-91c4-076780c797be\") " pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:52.323723 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.323680    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7r5\" (UniqueName: \"kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5\") pod \"test-curl-7404-139812711621680\" (UID: \"7275a513-ffce-4645-91c4-076780c797be\") " pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:52.434149 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.434109    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:52.582772 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.582738    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711621680"]
Jul 22 03:23:52.585729 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:23:52.585698    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7275a513_ffce_4645_91c4_076780c797be.slice/crio-04b3e8f760a3036a5fe0f60ed5ab630962edb035baca8cca9c5ac262043d9d9f WatchSource:0}: Error finding container 04b3e8f760a3036a5fe0f60ed5ab630962edb035baca8cca9c5ac262043d9d9f: Status 404 returned error can't find the container with id 04b3e8f760a3036a5fe0f60ed5ab630962edb035baca8cca9c5ac262043d9d9f
Jul 22 03:23:52.774241 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.774177    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac583bf5be153ae3cf7ebebd02e3d69b59c9ec007a5947d1a1a32894a0f1eb1e"
Jul 22 03:23:52.774241 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.774216    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:52.775676 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:52.775640    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711621680" event={"ID":"7275a513-ffce-4645-91c4-076780c797be","Type":"ContainerStarted","Data":"04b3e8f760a3036a5fe0f60ed5ab630962edb035baca8cca9c5ac262043d9d9f"}
Jul 22 03:23:52.786392 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:23:52.786352    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711620912\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:53.782595 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:53.782555    2523 generic.go:356] "Generic (PLEG): container finished" podID="7275a513-ffce-4645-91c4-076780c797be" containerID="2d0d13fdfa0b15058718a8635d1bf01be628a40876974d1c6b2d0f0c49fbaca3" exitCode=0
Jul 22 03:23:53.783034 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:53.782638    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711621680" event={"ID":"7275a513-ffce-4645-91c4-076780c797be","Type":"ContainerDied","Data":"2d0d13fdfa0b15058718a8635d1bf01be628a40876974d1c6b2d0f0c49fbaca3"}
Jul 22 03:23:53.784798 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:23:53.784765    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711620912\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" pod="opendatahub/test-curl-7404-139812711620912"
Jul 22 03:23:53.957154 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:53.957113    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d2f26cc-f7e0-4242-91b4-e277ae2873db" path="/var/lib/kubelet/pods/6d2f26cc-f7e0-4242-91b4-e277ae2873db/volumes"
Jul 22 03:23:54.929523 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:54.929485    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:54.951016 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:54.950976    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711621680_7275a513-ffce-4645-91c4-076780c797be/test-curl-7404-139812711621680/0.log"
Jul 22 03:23:54.975936 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:54.975893    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711621680"]
Jul 22 03:23:54.979470 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:54.979439    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711621680"]
Jul 22 03:23:55.041849 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.041741    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p7r5\" (UniqueName: \"kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5\") pod \"7275a513-ffce-4645-91c4-076780c797be\" (UID: \"7275a513-ffce-4645-91c4-076780c797be\") "
Jul 22 03:23:55.044196 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.044160    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5" (OuterVolumeSpecName: "kube-api-access-9p7r5") pod "7275a513-ffce-4645-91c4-076780c797be" (UID: "7275a513-ffce-4645-91c4-076780c797be"). InnerVolumeSpecName "kube-api-access-9p7r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:23:55.140648 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.140604    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:55.141042 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.141028    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7275a513-ffce-4645-91c4-076780c797be" containerName="test-curl-7404-139812711621680"
Jul 22 03:23:55.141091 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.141044    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="7275a513-ffce-4645-91c4-076780c797be" containerName="test-curl-7404-139812711621680"
Jul 22 03:23:55.141196 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.141110    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="7275a513-ffce-4645-91c4-076780c797be" containerName="test-curl-7404-139812711621680"
Jul 22 03:23:55.142856 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.142833    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p7r5\" (UniqueName: \"kubernetes.io/projected/7275a513-ffce-4645-91c4-076780c797be-kube-api-access-9p7r5\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:23:55.144305 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.144289    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:55.152888 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.152861    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:55.244250 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.244202    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mhvn\" (UniqueName: \"kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn\") pod \"test-curl-7404-139812711571792\" (UID: \"eadbcea0-609e-43e6-992d-517fbbbda405\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:55.345663 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.345562    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mhvn\" (UniqueName: \"kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn\") pod \"test-curl-7404-139812711571792\" (UID: \"eadbcea0-609e-43e6-992d-517fbbbda405\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:55.353834 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.353792    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mhvn\" (UniqueName: \"kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn\") pod \"test-curl-7404-139812711571792\" (UID: \"eadbcea0-609e-43e6-992d-517fbbbda405\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:55.455347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.455308    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:55.607937 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.607893    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:55.610982 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:23:55.610955    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeadbcea0_609e_43e6_992d_517fbbbda405.slice/crio-d709286f418e2a9ef41f2e26f03ebc84ec80882cec6e35ae02d80542fc0b5c4f WatchSource:0}: Error finding container d709286f418e2a9ef41f2e26f03ebc84ec80882cec6e35ae02d80542fc0b5c4f: Status 404 returned error can't find the container with id d709286f418e2a9ef41f2e26f03ebc84ec80882cec6e35ae02d80542fc0b5c4f
Jul 22 03:23:55.794651 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.794608    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711571792" event={"ID":"eadbcea0-609e-43e6-992d-517fbbbda405","Type":"ContainerStarted","Data":"d709286f418e2a9ef41f2e26f03ebc84ec80882cec6e35ae02d80542fc0b5c4f"}
Jul 22 03:23:55.796043 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.796011    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:55.796230 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.796013    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04b3e8f760a3036a5fe0f60ed5ab630962edb035baca8cca9c5ac262043d9d9f"
Jul 22 03:23:55.806391 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:23:55.806356    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711621680\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="7275a513-ffce-4645-91c4-076780c797be" pod="opendatahub/test-curl-7404-139812711621680"
Jul 22 03:23:55.957698 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:55.957659    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7275a513-ffce-4645-91c4-076780c797be" path="/var/lib/kubelet/pods/7275a513-ffce-4645-91c4-076780c797be/volumes"
Jul 22 03:23:56.802689 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:56.802650    2523 generic.go:356] "Generic (PLEG): container finished" podID="eadbcea0-609e-43e6-992d-517fbbbda405" containerID="81dd3b683f57e11d27bce88fb9526b2108b982eb2f50f519d9f68a5e398be1cd" exitCode=0
Jul 22 03:23:56.802881 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:56.802744    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711571792" event={"ID":"eadbcea0-609e-43e6-992d-517fbbbda405","Type":"ContainerDied","Data":"81dd3b683f57e11d27bce88fb9526b2108b982eb2f50f519d9f68a5e398be1cd"}
Jul 22 03:23:57.946752 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:57.946724    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:57.968163 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:57.968124    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711571792_eadbcea0-609e-43e6-992d-517fbbbda405/test-curl-7404-139812711571792/0.log"
Jul 22 03:23:57.992094 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:57.992010    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:57.994007 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:57.993977    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:58.073533 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.073416    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mhvn\" (UniqueName: \"kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn\") pod \"eadbcea0-609e-43e6-992d-517fbbbda405\" (UID: \"eadbcea0-609e-43e6-992d-517fbbbda405\") "
Jul 22 03:23:58.075921 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.075883    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn" (OuterVolumeSpecName: "kube-api-access-6mhvn") pod "eadbcea0-609e-43e6-992d-517fbbbda405" (UID: "eadbcea0-609e-43e6-992d-517fbbbda405"). InnerVolumeSpecName "kube-api-access-6mhvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:23:58.114596 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.114551    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:58.114966 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.114948    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eadbcea0-609e-43e6-992d-517fbbbda405" containerName="test-curl-7404-139812711571792"
Jul 22 03:23:58.115037 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.114968    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="eadbcea0-609e-43e6-992d-517fbbbda405" containerName="test-curl-7404-139812711571792"
Jul 22 03:23:58.115073 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.115050    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="eadbcea0-609e-43e6-992d-517fbbbda405" containerName="test-curl-7404-139812711571792"
Jul 22 03:23:58.118229 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.118190    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.124405 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.124369    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:58.175041 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.174984    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mhvn\" (UniqueName: \"kubernetes.io/projected/eadbcea0-609e-43e6-992d-517fbbbda405-kube-api-access-6mhvn\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:23:58.276512 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.276464    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjvs\" (UniqueName: \"kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs\") pod \"test-curl-7404-139812711571792\" (UID: \"105ab9f3-1f86-4852-b02f-e1fc27a55070\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.377617 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.377507    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjvs\" (UniqueName: \"kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs\") pod \"test-curl-7404-139812711571792\" (UID: \"105ab9f3-1f86-4852-b02f-e1fc27a55070\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.387063 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.387025    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjvs\" (UniqueName: \"kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs\") pod \"test-curl-7404-139812711571792\" (UID: \"105ab9f3-1f86-4852-b02f-e1fc27a55070\") " pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.429777 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.429738    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.576404 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.576350    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:23:58.578798 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:23:58.578757    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod105ab9f3_1f86_4852_b02f_e1fc27a55070.slice/crio-fcc7d576f45c719b2008091468dfe27e6d46611511307d707e23bbcd80c8412b WatchSource:0}: Error finding container fcc7d576f45c719b2008091468dfe27e6d46611511307d707e23bbcd80c8412b: Status 404 returned error can't find the container with id fcc7d576f45c719b2008091468dfe27e6d46611511307d707e23bbcd80c8412b
Jul 22 03:23:58.815649 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.815606    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711571792" event={"ID":"105ab9f3-1f86-4852-b02f-e1fc27a55070","Type":"ContainerStarted","Data":"fcc7d576f45c719b2008091468dfe27e6d46611511307d707e23bbcd80c8412b"}
Jul 22 03:23:58.816942 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.816919    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:23:58.816942 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.816932    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d709286f418e2a9ef41f2e26f03ebc84ec80882cec6e35ae02d80542fc0b5c4f"
Jul 22 03:23:58.828992 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:58.828918    2523 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7404-139812711571792" oldPodUID="eadbcea0-609e-43e6-992d-517fbbbda405" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070"
Jul 22 03:23:59.823625 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:59.823585    2523 generic.go:356] "Generic (PLEG): container finished" podID="105ab9f3-1f86-4852-b02f-e1fc27a55070" containerID="5ef27e5c64b97fc5746b36a111bb04d796e7cf859736825309218e384ad5d213" exitCode=0
Jul 22 03:23:59.824099 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:59.823676    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711571792" event={"ID":"105ab9f3-1f86-4852-b02f-e1fc27a55070","Type":"ContainerDied","Data":"5ef27e5c64b97fc5746b36a111bb04d796e7cf859736825309218e384ad5d213"}
Jul 22 03:23:59.957119 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:23:59.957075    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eadbcea0-609e-43e6-992d-517fbbbda405" path="/var/lib/kubelet/pods/eadbcea0-609e-43e6-992d-517fbbbda405/volumes"
Jul 22 03:24:00.968708 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:00.968674    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:24:00.993194 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:00.993157    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711571792_105ab9f3-1f86-4852-b02f-e1fc27a55070/test-curl-7404-139812711571792/0.log"
Jul 22 03:24:01.017976 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.017934    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:24:01.021899 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.021862    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711571792"]
Jul 22 03:24:01.104371 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.104280    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pjvs\" (UniqueName: \"kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs\") pod \"105ab9f3-1f86-4852-b02f-e1fc27a55070\" (UID: \"105ab9f3-1f86-4852-b02f-e1fc27a55070\") "
Jul 22 03:24:01.106627 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.106601    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs" (OuterVolumeSpecName: "kube-api-access-8pjvs") pod "105ab9f3-1f86-4852-b02f-e1fc27a55070" (UID: "105ab9f3-1f86-4852-b02f-e1fc27a55070"). InnerVolumeSpecName "kube-api-access-8pjvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:01.145985 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.145944    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:01.146408 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.146390    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" containerName="test-curl-7404-139812711571792"
Jul 22 03:24:01.146408 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.146409    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" containerName="test-curl-7404-139812711571792"
Jul 22 03:24:01.146599 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.146481    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" containerName="test-curl-7404-139812711571792"
Jul 22 03:24:01.149697 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.149664    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:01.155616 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.155578    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:01.205432 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.205386    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pjvs\" (UniqueName: \"kubernetes.io/projected/105ab9f3-1f86-4852-b02f-e1fc27a55070-kube-api-access-8pjvs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:01.306883 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.306841    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnt42\" (UniqueName: \"kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42\") pod \"test-curl-7404-139812711575248\" (UID: \"dae4da03-1a8b-4216-8504-b2be4550dfc7\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:01.407628 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.407530    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnt42\" (UniqueName: \"kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42\") pod \"test-curl-7404-139812711575248\" (UID: \"dae4da03-1a8b-4216-8504-b2be4550dfc7\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:01.416539 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.416505    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnt42\" (UniqueName: \"kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42\") pod \"test-curl-7404-139812711575248\" (UID: \"dae4da03-1a8b-4216-8504-b2be4550dfc7\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:01.462497 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.462452    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:01.609520 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.609474    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:01.612838 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:24:01.612808    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddae4da03_1a8b_4216_8504_b2be4550dfc7.slice/crio-d03c81fdc6e4f83377518120f1768855bf8c7c3855ee0fe66f33e87a2056ed41 WatchSource:0}: Error finding container d03c81fdc6e4f83377518120f1768855bf8c7c3855ee0fe66f33e87a2056ed41: Status 404 returned error can't find the container with id d03c81fdc6e4f83377518120f1768855bf8c7c3855ee0fe66f33e87a2056ed41
Jul 22 03:24:01.839299 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.839256    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711575248" event={"ID":"dae4da03-1a8b-4216-8504-b2be4550dfc7","Type":"ContainerStarted","Data":"d03c81fdc6e4f83377518120f1768855bf8c7c3855ee0fe66f33e87a2056ed41"}
Jul 22 03:24:01.840604 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.840577    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:24:01.840751 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.840619    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fcc7d576f45c719b2008091468dfe27e6d46611511307d707e23bbcd80c8412b"
Jul 22 03:24:01.853348 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:24:01.853311    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711571792\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:24:01.957245 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:24:01.957201    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711571792\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" pod="opendatahub/test-curl-7404-139812711571792"
Jul 22 03:24:01.957890 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:01.957860    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="105ab9f3-1f86-4852-b02f-e1fc27a55070" path="/var/lib/kubelet/pods/105ab9f3-1f86-4852-b02f-e1fc27a55070/volumes"
Jul 22 03:24:02.847859 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:02.847818    2523 generic.go:356] "Generic (PLEG): container finished" podID="dae4da03-1a8b-4216-8504-b2be4550dfc7" containerID="0636f033289436100b7319fa666d6409b3032e23caaab9f566d5ec6129875427" exitCode=0
Jul 22 03:24:02.848290 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:02.847899    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711575248" event={"ID":"dae4da03-1a8b-4216-8504-b2be4550dfc7","Type":"ContainerDied","Data":"0636f033289436100b7319fa666d6409b3032e23caaab9f566d5ec6129875427"}
Jul 22 03:24:03.404091 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.404041    2523 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" podUID="749e967e-8fa0-48fd-b567-ce460c95134b" containerName="main" containerID="cri-o://0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559" gracePeriod=45
Jul 22 03:24:03.674911 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.674881    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:24:03.830411 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830371    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830592 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830435    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkmn8\" (UniqueName: \"kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830592 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830461    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830592 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830492    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830592 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830525    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830818 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830598    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir\") pod \"749e967e-8fa0-48fd-b567-ce460c95134b\" (UID: \"749e967e-8fa0-48fd-b567-ce460c95134b\") "
Jul 22 03:24:03.830818 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830739    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache" (OuterVolumeSpecName: "model-cache") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:24:03.830818 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830763    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home" (OuterVolumeSpecName: "home") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:24:03.830983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830917    2523 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-home\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.830983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830914    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:24:03.830983 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.830932    2523 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-model-cache\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.832944 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.832909    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm" (OuterVolumeSpecName: "dshm") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:24:03.832944 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.832925    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8" (OuterVolumeSpecName: "kube-api-access-lkmn8") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "kube-api-access-lkmn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:03.832944 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.832909    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "749e967e-8fa0-48fd-b567-ce460c95134b" (UID: "749e967e-8fa0-48fd-b567-ce460c95134b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:24:03.854132 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.854094    2523 generic.go:356] "Generic (PLEG): container finished" podID="749e967e-8fa0-48fd-b567-ce460c95134b" containerID="0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559" exitCode=0
Jul 22 03:24:03.854573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.854169    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"
Jul 22 03:24:03.854573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.854177    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" event={"ID":"749e967e-8fa0-48fd-b567-ce460c95134b","Type":"ContainerDied","Data":"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"}
Jul 22 03:24:03.854573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.854225    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm" event={"ID":"749e967e-8fa0-48fd-b567-ce460c95134b","Type":"ContainerDied","Data":"a9d945fd8bf02cb64c5d44dff9c5f96ed669dbf9ad88908db057838e4c37691b"}
Jul 22 03:24:03.854573 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.854247    2523 scope.go:117] "RemoveContainer" containerID="0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"
Jul 22 03:24:03.866080 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.866054    2523 scope.go:117] "RemoveContainer" containerID="0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"
Jul 22 03:24:03.866481 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:24:03.866460    2523 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559\": container with ID starting with 0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559 not found: ID does not exist" containerID="0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"
Jul 22 03:24:03.866556 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.866491    2523 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559"} err="failed to get container status \"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559\": rpc error: code = NotFound desc = could not find container \"0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559\": container with ID starting with 0fbe5b7a0e25dc6cd6601afd70fa788cc62313c52ef7f9a37100690a8042f559 not found: ID does not exist"
Jul 22 03:24:03.876705 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.876667    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:24:03.878778 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.878748    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-e9ef33/rate-test-model-e9ef33-kserve-5b6db84499-cm6cm"]
Jul 22 03:24:03.931805 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.931769    2523 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-tmp-dir\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.931805 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.931801    2523 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/749e967e-8fa0-48fd-b567-ce460c95134b-dshm\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.932023 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.931814    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkmn8\" (UniqueName: \"kubernetes.io/projected/749e967e-8fa0-48fd-b567-ce460c95134b-kube-api-access-lkmn8\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.932023 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.931827    2523 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/749e967e-8fa0-48fd-b567-ce460c95134b-tls-certs\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:03.958249 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.958211    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="749e967e-8fa0-48fd-b567-ce460c95134b" path="/var/lib/kubelet/pods/749e967e-8fa0-48fd-b567-ce460c95134b/volumes"
Jul 22 03:24:03.992621 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:03.992587    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.016311 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.016278    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711575248_dae4da03-1a8b-4216-8504-b2be4550dfc7/test-curl-7404-139812711575248/0.log"
Jul 22 03:24:04.047619 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.047566    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:04.059562 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.059525    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:04.133871 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.133746    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnt42\" (UniqueName: \"kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42\") pod \"dae4da03-1a8b-4216-8504-b2be4550dfc7\" (UID: \"dae4da03-1a8b-4216-8504-b2be4550dfc7\") "
Jul 22 03:24:04.157691 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.136233    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42" (OuterVolumeSpecName: "kube-api-access-cnt42") pod "dae4da03-1a8b-4216-8504-b2be4550dfc7" (UID: "dae4da03-1a8b-4216-8504-b2be4550dfc7"). InnerVolumeSpecName "kube-api-access-cnt42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:04.192101 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192008    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:04.192441 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192425    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae4da03-1a8b-4216-8504-b2be4550dfc7" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:04.192484 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192442    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae4da03-1a8b-4216-8504-b2be4550dfc7" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:04.192484 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192457    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="749e967e-8fa0-48fd-b567-ce460c95134b" containerName="main"
Jul 22 03:24:04.192484 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192464    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="749e967e-8fa0-48fd-b567-ce460c95134b" containerName="main"
Jul 22 03:24:04.192586 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192524    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae4da03-1a8b-4216-8504-b2be4550dfc7" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:04.192586 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.192537    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="749e967e-8fa0-48fd-b567-ce460c95134b" containerName="main"
Jul 22 03:24:04.195554 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.195534    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.205892 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.205862    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:04.234740 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.234705    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnt42\" (UniqueName: \"kubernetes.io/projected/dae4da03-1a8b-4216-8504-b2be4550dfc7-kube-api-access-cnt42\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:04.335249 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.335195    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9shn9\" (UniqueName: \"kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9\") pod \"test-curl-7404-139812711575248\" (UID: \"eae771c1-650d-4cca-a940-fde379d0cb29\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.436208 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.436128    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9shn9\" (UniqueName: \"kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9\") pod \"test-curl-7404-139812711575248\" (UID: \"eae771c1-650d-4cca-a940-fde379d0cb29\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.445478 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.445406    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9shn9\" (UniqueName: \"kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9\") pod \"test-curl-7404-139812711575248\" (UID: \"eae771c1-650d-4cca-a940-fde379d0cb29\") " pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.506611 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.506568    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.653060 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.653028    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:04.655830 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:24:04.655800    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeae771c1_650d_4cca_a940_fde379d0cb29.slice/crio-89e8b52bf2e6050f4d72250fb1e8f7d8a4afcc22d0ef79dfa02d7418e9d8810e WatchSource:0}: Error finding container 89e8b52bf2e6050f4d72250fb1e8f7d8a4afcc22d0ef79dfa02d7418e9d8810e: Status 404 returned error can't find the container with id 89e8b52bf2e6050f4d72250fb1e8f7d8a4afcc22d0ef79dfa02d7418e9d8810e
Jul 22 03:24:04.861786 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.861738    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711575248" event={"ID":"eae771c1-650d-4cca-a940-fde379d0cb29","Type":"ContainerStarted","Data":"89e8b52bf2e6050f4d72250fb1e8f7d8a4afcc22d0ef79dfa02d7418e9d8810e"}
Jul 22 03:24:04.863137 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.863110    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:04.863310 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.863178    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03c81fdc6e4f83377518120f1768855bf8c7c3855ee0fe66f33e87a2056ed41"
Jul 22 03:24:04.875278 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:04.875245    2523 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7404-139812711575248" oldPodUID="dae4da03-1a8b-4216-8504-b2be4550dfc7" podUID="eae771c1-650d-4cca-a940-fde379d0cb29"
Jul 22 03:24:05.871778 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:05.871743    2523 generic.go:356] "Generic (PLEG): container finished" podID="eae771c1-650d-4cca-a940-fde379d0cb29" containerID="27ae0fdfe4b07f1cf550b85ee8fd77f5d04ffadf71fc0fa76c28c9c0d81f2c30" exitCode=0
Jul 22 03:24:05.872240 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:05.871834    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7404-139812711575248" event={"ID":"eae771c1-650d-4cca-a940-fde379d0cb29","Type":"ContainerDied","Data":"27ae0fdfe4b07f1cf550b85ee8fd77f5d04ffadf71fc0fa76c28c9c0d81f2c30"}
Jul 22 03:24:05.957338 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:05.957300    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae4da03-1a8b-4216-8504-b2be4550dfc7" path="/var/lib/kubelet/pods/dae4da03-1a8b-4216-8504-b2be4550dfc7/volumes"
Jul 22 03:24:07.025159 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.025097    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:07.051422 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.051361    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7404-139812711575248_eae771c1-650d-4cca-a940-fde379d0cb29/test-curl-7404-139812711575248/0.log"
Jul 22 03:24:07.075518 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.075475    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:07.080673 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.080643    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7404-139812711575248"]
Jul 22 03:24:07.164256 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.164133    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9shn9\" (UniqueName: \"kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9\") pod \"eae771c1-650d-4cca-a940-fde379d0cb29\" (UID: \"eae771c1-650d-4cca-a940-fde379d0cb29\") "
Jul 22 03:24:07.166550 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.166522    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9" (OuterVolumeSpecName: "kube-api-access-9shn9") pod "eae771c1-650d-4cca-a940-fde379d0cb29" (UID: "eae771c1-650d-4cca-a940-fde379d0cb29"). InnerVolumeSpecName "kube-api-access-9shn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:24:07.265837 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.265792    2523 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9shn9\" (UniqueName: \"kubernetes.io/projected/eae771c1-650d-4cca-a940-fde379d0cb29-kube-api-access-9shn9\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:07.287160 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.287113    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"]
Jul 22 03:24:07.287536 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.287523    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae771c1-650d-4cca-a940-fde379d0cb29" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:07.287592 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.287538    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae771c1-650d-4cca-a940-fde379d0cb29" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:07.287632 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.287623    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae771c1-650d-4cca-a940-fde379d0cb29" containerName="test-curl-7404-139812711575248"
Jul 22 03:24:07.290827 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.290807    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:07.293376 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.293350    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:24:07.293563 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.293545    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:24:07.300328 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.300300    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"]
Jul 22 03:24:07.467121 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.467082    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq\" (UID: \"2cf5ed78-3298-4dff-9153-7baabd3f775e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:07.568188 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.568105    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq\" (UID: \"2cf5ed78-3298-4dff-9153-7baabd3f775e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:07.568840 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.568816    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq\" (UID: \"2cf5ed78-3298-4dff-9153-7baabd3f775e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:07.603298 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.603255    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:07.751984 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.751897    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"]
Jul 22 03:24:07.755346 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:24:07.755316    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf5ed78_3298_4dff_9153_7baabd3f775e.slice/crio-be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6 WatchSource:0}: Error finding container be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6: Status 404 returned error can't find the container with id be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6
Jul 22 03:24:07.885324 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.885278    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:07.885548 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.885291    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89e8b52bf2e6050f4d72250fb1e8f7d8a4afcc22d0ef79dfa02d7418e9d8810e"
Jul 22 03:24:07.886928 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.886899    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq" event={"ID":"2cf5ed78-3298-4dff-9153-7baabd3f775e","Type":"ContainerStarted","Data":"be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6"}
Jul 22 03:24:07.895353 ip-10-0-130-119 kubenswrapper[2523]: E0722 03:24:07.895320    2523 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7404-139812711575248\" is forbidden: User \"system:node:ip-10-0-130-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-119.ec2.internal' and this object" podUID="eae771c1-650d-4cca-a940-fde379d0cb29" pod="opendatahub/test-curl-7404-139812711575248"
Jul 22 03:24:07.958531 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:07.958496    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae771c1-650d-4cca-a940-fde379d0cb29" path="/var/lib/kubelet/pods/eae771c1-650d-4cca-a940-fde379d0cb29/volumes"
Jul 22 03:24:08.894937 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:08.894897    2523 generic.go:356] "Generic (PLEG): container finished" podID="2cf5ed78-3298-4dff-9153-7baabd3f775e" containerID="4542e6f2f8d5e259811da6646e46019f30e6aa1c70a97d2899263519e3c69788" exitCode=0
Jul 22 03:24:08.895452 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:08.894986    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq" event={"ID":"2cf5ed78-3298-4dff-9153-7baabd3f775e","Type":"ContainerDied","Data":"4542e6f2f8d5e259811da6646e46019f30e6aa1c70a97d2899263519e3c69788"}
Jul 22 03:24:10.058332 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.058305    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:10.194540 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.194426    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca\") pod \"2cf5ed78-3298-4dff-9153-7baabd3f775e\" (UID: \"2cf5ed78-3298-4dff-9153-7baabd3f775e\") "
Jul 22 03:24:10.194841 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.194812    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2cf5ed78-3298-4dff-9153-7baabd3f775e" (UID: "2cf5ed78-3298-4dff-9153-7baabd3f775e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:24:10.295654 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.295596    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf5ed78-3298-4dff-9153-7baabd3f775e-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:10.906819 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.906779    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq" event={"ID":"2cf5ed78-3298-4dff-9153-7baabd3f775e","Type":"ContainerDied","Data":"be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6"}
Jul 22 03:24:10.907009 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.906823    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"
Jul 22 03:24:10.907009 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:10.906832    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be36c883450884900b7be9bc169ba0d5ff1cf62189bb6551ad975025ee1965b6"
Jul 22 03:24:12.417676 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:12.417640    2523 scope.go:117] "RemoveContainer" containerID="9e182fd7e7c83667b0dbce874381889757f426e89adc89c7c176e2ec22553009"
Jul 22 03:24:20.653976 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:20.653935    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:24:22.372739 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:22.372699    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"]
Jul 22 03:24:22.377728 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:22.377662    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-72501c-2mkpq"]
Jul 22 03:24:23.957354 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:23.957306    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cf5ed78-3298-4dff-9153-7baabd3f775e" path="/var/lib/kubelet/pods/2cf5ed78-3298-4dff-9153-7baabd3f775e/volumes"
Jul 22 03:24:29.796008 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.795966    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"]
Jul 22 03:24:29.796486 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.796397    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf5ed78-3298-4dff-9153-7baabd3f775e" containerName="revoke-keys"
Jul 22 03:24:29.796486 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.796409    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf5ed78-3298-4dff-9153-7baabd3f775e" containerName="revoke-keys"
Jul 22 03:24:29.796486 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.796475    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf5ed78-3298-4dff-9153-7baabd3f775e" containerName="revoke-keys"
Jul 22 03:24:29.801726 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.801698    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:29.804022 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.803982    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cx2qd\""
Jul 22 03:24:29.804206 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.804028    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:24:29.807837 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.807806    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"]
Jul 22 03:24:29.877591 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.877545    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr\" (UID: \"e4a4666c-9601-4717-a7bc-6108f6a5c00d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:29.978418 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.978372    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr\" (UID: \"e4a4666c-9601-4717-a7bc-6108f6a5c00d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:29.979016 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:29.978991    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr\" (UID: \"e4a4666c-9601-4717-a7bc-6108f6a5c00d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:30.114833 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:30.114727    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:30.265800 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:30.265771    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"]
Jul 22 03:24:30.267909 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:24:30.267875    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a4666c_9601_4717_a7bc_6108f6a5c00d.slice/crio-c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27 WatchSource:0}: Error finding container c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27: Status 404 returned error can't find the container with id c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27
Jul 22 03:24:31.030670 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:31.030630    2523 generic.go:356] "Generic (PLEG): container finished" podID="e4a4666c-9601-4717-a7bc-6108f6a5c00d" containerID="8db7ca6dd8ec4b5c55ece747bbfb2ca3e706ebdfe01433b24e9f41106e96a15d" exitCode=0
Jul 22 03:24:31.031073 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:31.030717    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr" event={"ID":"e4a4666c-9601-4717-a7bc-6108f6a5c00d","Type":"ContainerDied","Data":"8db7ca6dd8ec4b5c55ece747bbfb2ca3e706ebdfe01433b24e9f41106e96a15d"}
Jul 22 03:24:31.031073 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:31.030773    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr" event={"ID":"e4a4666c-9601-4717-a7bc-6108f6a5c00d","Type":"ContainerStarted","Data":"c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27"}
Jul 22 03:24:32.182322 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:32.182286    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:32.299941 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:32.299845    2523 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca\") pod \"e4a4666c-9601-4717-a7bc-6108f6a5c00d\" (UID: \"e4a4666c-9601-4717-a7bc-6108f6a5c00d\") "
Jul 22 03:24:32.300271 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:32.300244    2523 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4a4666c-9601-4717-a7bc-6108f6a5c00d" (UID: "e4a4666c-9601-4717-a7bc-6108f6a5c00d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:24:32.400867 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:32.400820    2523 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a4666c-9601-4717-a7bc-6108f6a5c00d-maas-api-service-ca\") on node \"ip-10-0-130-119.ec2.internal\" DevicePath \"\""
Jul 22 03:24:33.043070 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:33.043041    2523 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"
Jul 22 03:24:33.043274 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:33.043069    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr" event={"ID":"e4a4666c-9601-4717-a7bc-6108f6a5c00d","Type":"ContainerDied","Data":"c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27"}
Jul 22 03:24:33.043274 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:33.043114    2523 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6c8e33a92db71257c513d0873818e88847f3800830f08ad240dddfc18592c27"
Jul 22 03:24:43.262414 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:43.262371    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7gfc2"]
Jul 22 03:24:44.876978 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:44.876937    2523 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"]
Jul 22 03:24:44.880887 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:44.880847    2523 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-e9ef33-c7gpr"]
Jul 22 03:24:45.957030 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:45.956991    2523 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a4666c-9601-4717-a7bc-6108f6a5c00d" path="/var/lib/kubelet/pods/e4a4666c-9601-4717-a7bc-6108f6a5c00d/volumes"
Jul 22 03:24:52.747767 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:52.747730    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbf4cddc6-7qzj7_33ad0a82-57c6-43c6-80f9-30c6abbb5193/authorino/0.log"
Jul 22 03:24:58.714159 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:58.714102    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tjqzt_c608980f-c004-4d54-a4dd-d2a1b9d3a60a/manager/0.log"
Jul 22 03:24:58.832402 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:58.832376    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-827vs_bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2/copy-manifests/0.log"
Jul 22 03:24:58.839665 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:58.839632    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-827vs_bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2/manager/0.log"
Jul 22 03:24:59.560324 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:59.560291    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744820-krg29_917af1d0-d3d6-458f-abd6-382a545fd192/cleanup/0.log"
Jul 22 03:24:59.667996 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:24:59.667962    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744835-kfqrp_3642defe-7258-4c97-b5d7-e1fd9a4a04e1/cleanup/0.log"
Jul 22 03:25:01.087814 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:01.087781    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbf4cddc6-7qzj7_33ad0a82-57c6-43c6-80f9-30c6abbb5193/authorino/0.log"
Jul 22 03:25:01.801193 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:01.801166    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7gfc2_6ab174d8-5fa8-488c-b04e-d643d34aeabe/limitador/0.log"
Jul 22 03:25:02.552277 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:02.552175    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7885ddc578-7j5xw_257e062f-5cca-4f4f-8e43-59e15ceab0cd/kube-auth-proxy/0.log"
Jul 22 03:25:03.151268 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:03.151239    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8fd84546-rmjqk_23fae3d4-4606-4d8a-beff-6969e8742139/router/0.log"
Jul 22 03:25:09.198801 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.198758    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzxjk/must-gather-hjnbz"]
Jul 22 03:25:09.199233 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.199165    2523 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a4666c-9601-4717-a7bc-6108f6a5c00d" containerName="revoke-keys"
Jul 22 03:25:09.199233 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.199176    2523 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a4666c-9601-4717-a7bc-6108f6a5c00d" containerName="revoke-keys"
Jul 22 03:25:09.199323 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.199257    2523 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a4666c-9601-4717-a7bc-6108f6a5c00d" containerName="revoke-keys"
Jul 22 03:25:09.202456 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.202437    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.205087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.205058    2523 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gzxjk\"/\"default-dockercfg-k4hhd\""
Jul 22 03:25:09.205087 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.205084    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzxjk\"/\"kube-root-ca.crt\""
Jul 22 03:25:09.205561 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.205545    2523 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gzxjk\"/\"openshift-service-ca.crt\""
Jul 22 03:25:09.214898 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.214865    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/must-gather-hjnbz"]
Jul 22 03:25:09.237941 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.237891    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87xdp\" (UniqueName: \"kubernetes.io/projected/11f98122-0efb-46e7-acf0-fab598392929-kube-api-access-87xdp\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.238128 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.237989    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f98122-0efb-46e7-acf0-fab598392929-must-gather-output\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.338732 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.338685    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f98122-0efb-46e7-acf0-fab598392929-must-gather-output\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.338941 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.338786    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87xdp\" (UniqueName: \"kubernetes.io/projected/11f98122-0efb-46e7-acf0-fab598392929-kube-api-access-87xdp\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.339049 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.339028    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/11f98122-0efb-46e7-acf0-fab598392929-must-gather-output\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.349463 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.349426    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87xdp\" (UniqueName: \"kubernetes.io/projected/11f98122-0efb-46e7-acf0-fab598392929-kube-api-access-87xdp\") pod \"must-gather-hjnbz\" (UID: \"11f98122-0efb-46e7-acf0-fab598392929\") " pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.513007 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.512967    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/must-gather-hjnbz"
Jul 22 03:25:09.663389 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:09.663360    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/must-gather-hjnbz"]
Jul 22 03:25:09.665411 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:25:09.665380    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f98122_0efb_46e7_acf0_fab598392929.slice/crio-f1caf5ba0e5b95975a6cd6836f8645f40d9ee3d082ef50bee6fe36f2c96225b4 WatchSource:0}: Error finding container f1caf5ba0e5b95975a6cd6836f8645f40d9ee3d082ef50bee6fe36f2c96225b4: Status 404 returned error can't find the container with id f1caf5ba0e5b95975a6cd6836f8645f40d9ee3d082ef50bee6fe36f2c96225b4
Jul 22 03:25:10.258629 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:10.258590    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/must-gather-hjnbz" event={"ID":"11f98122-0efb-46e7-acf0-fab598392929","Type":"ContainerStarted","Data":"f1caf5ba0e5b95975a6cd6836f8645f40d9ee3d082ef50bee6fe36f2c96225b4"}
Jul 22 03:25:11.267207 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:11.267172    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/must-gather-hjnbz" event={"ID":"11f98122-0efb-46e7-acf0-fab598392929","Type":"ContainerStarted","Data":"72074ab6c70ab29f7507cbeedf69f53c6121b4839ee35ffeee51562f510dc1ba"}
Jul 22 03:25:11.267207 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:11.267217    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/must-gather-hjnbz" event={"ID":"11f98122-0efb-46e7-acf0-fab598392929","Type":"ContainerStarted","Data":"e62d11d51b6aa8de1478e60619a6aad2b7107ef7282d608c13d4d7f8e6fa793f"}
Jul 22 03:25:11.286769 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:11.286699    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzxjk/must-gather-hjnbz" podStartSLOduration=1.370073709 podStartE2EDuration="2.286671005s" totalImagesPullingTime="916.597296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:25:11.283775592 +0000 UTC m=+2879.745166332" watchObservedRunningTime="2026-07-22 03:25:11.286671005 +0000 UTC m=+2879.748061744"
Jul 22 03:25:12.453113 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:12.453058    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxj8k_7b54765c-d92b-43f8-9c98-8c83e4a06d8c/global-pull-secret-syncer/0.log"
Jul 22 03:25:12.653663 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:12.653631    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fb9fv_1e0f73e9-0f3b-4e9a-b734-786d7a6cadab/konnectivity-agent/0.log"
Jul 22 03:25:12.680083 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:12.680039    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-119.ec2.internal_d0229793d07a73dce520e9f7cfb97506/haproxy/0.log"
Jul 22 03:25:18.597169 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:18.597038    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bbf4cddc6-7qzj7_33ad0a82-57c6-43c6-80f9-30c6abbb5193/authorino/0.log"
Jul 22 03:25:18.982670 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:18.982632    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7gfc2_6ab174d8-5fa8-488c-b04e-d643d34aeabe/limitador/0.log"
Jul 22 03:25:20.744871 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.744813    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/alertmanager/0.log"
Jul 22 03:25:20.770595 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.770558    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/config-reloader/0.log"
Jul 22 03:25:20.801236 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.801200    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/kube-rbac-proxy-web/0.log"
Jul 22 03:25:20.824136 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.824102    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/kube-rbac-proxy/0.log"
Jul 22 03:25:20.856880 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.856832    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/kube-rbac-proxy-metric/0.log"
Jul 22 03:25:20.881684 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.881651    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/prom-label-proxy/0.log"
Jul 22 03:25:20.911500 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.911453    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0248a432-05b2-45cc-91af-4f4c6542141e/init-config-reloader/0.log"
Jul 22 03:25:20.968035 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:20.967994    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-wdclm_203c8baf-e3f7-4837-af89-6de37a159dc7/cluster-monitoring-operator/0.log"
Jul 22 03:25:21.098161 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.098006    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-z65rr_d50ac9e4-cd56-471c-8fe7-b202277a02d8/monitoring-plugin/0.log"
Jul 22 03:25:21.298652 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.298603    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkbqb_0634b6b1-6105-4ba6-b2eb-e5a8de523bbb/node-exporter/0.log"
Jul 22 03:25:21.326110 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.326086    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkbqb_0634b6b1-6105-4ba6-b2eb-e5a8de523bbb/kube-rbac-proxy/0.log"
Jul 22 03:25:21.352005 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.351915    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zkbqb_0634b6b1-6105-4ba6-b2eb-e5a8de523bbb/init-textfile/0.log"
Jul 22 03:25:21.636721 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.636623    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m56b7_7238ac19-a00b-4fb2-bc36-bf566d53ffd8/prometheus-operator/0.log"
Jul 22 03:25:21.659859 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.659828    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-m56b7_7238ac19-a00b-4fb2-bc36-bf566d53ffd8/kube-rbac-proxy/0.log"
Jul 22 03:25:21.705674 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.705638    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-dlsfk_a2d7871f-4c2c-40f4-a23a-772b55b8f341/prometheus-operator-admission-webhook/0.log"
Jul 22 03:25:21.736308 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.736264    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f7fbbb9f-kbdk2_72dfb696-fc54-4245-abcc-da987587b214/telemeter-client/0.log"
Jul 22 03:25:21.762498 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.762461    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f7fbbb9f-kbdk2_72dfb696-fc54-4245-abcc-da987587b214/reload/0.log"
Jul 22 03:25:21.796927 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.796891    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84f7fbbb9f-kbdk2_72dfb696-fc54-4245-abcc-da987587b214/kube-rbac-proxy/0.log"
Jul 22 03:25:21.829616 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.829569    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/thanos-query/0.log"
Jul 22 03:25:21.855542 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.855512    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/kube-rbac-proxy-web/0.log"
Jul 22 03:25:21.886549 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.886523    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/kube-rbac-proxy/0.log"
Jul 22 03:25:21.909466 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.909373    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/prom-label-proxy/0.log"
Jul 22 03:25:21.935641 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.935603    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/kube-rbac-proxy-rules/0.log"
Jul 22 03:25:21.960578 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:21.960544    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f8d874fd5-wb9xk_2dada40f-9e9d-4193-aacc-663dda148ea5/kube-rbac-proxy-metrics/0.log"
Jul 22 03:25:23.370920 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.370878    2523 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"]
Jul 22 03:25:23.379569 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.379539    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.383490 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.383455    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"]
Jul 22 03:25:23.512668 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.512626    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-sys\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.512897 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.512772    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-podres\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.512897 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.512830    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-proc\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.513021 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.512904    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6p4\" (UniqueName: \"kubernetes.io/projected/218aee4a-7fed-4c1c-b27f-58cb0db453e6-kube-api-access-bx6p4\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.513021 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.512962    2523 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-lib-modules\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.614264 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.614219    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-podres\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.614520 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.614489    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-podres\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.614667 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.614651    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-proc\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.614780 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.614767    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6p4\" (UniqueName: \"kubernetes.io/projected/218aee4a-7fed-4c1c-b27f-58cb0db453e6-kube-api-access-bx6p4\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.614890 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.614877    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-lib-modules\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.615013 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.615001    2523 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-sys\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.615206 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.615190    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-sys\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.615347 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.615333    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-proc\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.615881 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.615859    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/218aee4a-7fed-4c1c-b27f-58cb0db453e6-lib-modules\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.625324 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.625246    2523 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6p4\" (UniqueName: \"kubernetes.io/projected/218aee4a-7fed-4c1c-b27f-58cb0db453e6-kube-api-access-bx6p4\") pod \"perf-node-gather-daemonset-tdmcs\" (UID: \"218aee4a-7fed-4c1c-b27f-58cb0db453e6\") " pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.694445 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.694398    2523 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:23.901828 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.901792    2523 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"]
Jul 22 03:25:23.904420 ip-10-0-130-119 kubenswrapper[2523]: W0722 03:25:23.904357    2523 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod218aee4a_7fed_4c1c_b27f_58cb0db453e6.slice/crio-844a8d081c9c83ee9fbe014943700abb639f413a31631d619472366017cc3475 WatchSource:0}: Error finding container 844a8d081c9c83ee9fbe014943700abb639f413a31631d619472366017cc3475: Status 404 returned error can't find the container with id 844a8d081c9c83ee9fbe014943700abb639f413a31631d619472366017cc3475
Jul 22 03:25:23.904672 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.904643    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/1.log"
Jul 22 03:25:23.920875 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:23.920846    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-959ds_37b1fe9b-0de7-4c27-a50a-cd3dd63f53f1/console-operator/2.log"
Jul 22 03:25:24.383115 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:24.382288    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs" event={"ID":"218aee4a-7fed-4c1c-b27f-58cb0db453e6","Type":"ContainerStarted","Data":"b6ce1874af2f0ca9ec42f69fe98395e6aaa250a8773ca2b63e0b5c340d4cd2fe"}
Jul 22 03:25:24.383115 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:24.383033    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:24.383115 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:24.383058    2523 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs" event={"ID":"218aee4a-7fed-4c1c-b27f-58cb0db453e6","Type":"ContainerStarted","Data":"844a8d081c9c83ee9fbe014943700abb639f413a31631d619472366017cc3475"}
Jul 22 03:25:24.405945 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:24.405864    2523 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs" podStartSLOduration=1.4058383970000001 podStartE2EDuration="1.405838397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:25:24.402723668 +0000 UTC m=+2892.864114425" watchObservedRunningTime="2026-07-22 03:25:24.405838397 +0000 UTC m=+2892.867229139"
Jul 22 03:25:24.528261 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:24.528225    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-vxzpl_2a5dfe8f-9222-423d-9ad8-3ef3bae5cd28/download-server/0.log"
Jul 22 03:25:25.176947 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:25.176908    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-h66vm_04e3d544-bbf5-42ba-aac7-3a222e1df0fb/volume-data-source-validator/0.log"
Jul 22 03:25:26.334717 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:26.334687    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhvjp_807688ad-af8a-43a7-b3ec-3334d9aa5eea/dns/0.log"
Jul 22 03:25:26.358805 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:26.358775    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhvjp_807688ad-af8a-43a7-b3ec-3334d9aa5eea/kube-rbac-proxy/0.log"
Jul 22 03:25:26.553483 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:26.553436    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h4zgv_ddf0b081-b5c8-49fe-8526-462cbe0745e7/dns-node-resolver/0.log"
Jul 22 03:25:27.275459 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:27.275425    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-skdmt_54edb804-d925-4d24-b532-2e0c2feca0bb/node-ca/0.log"
Jul 22 03:25:28.649552 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:28.649514    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7885ddc578-7j5xw_257e062f-5cca-4f4f-8e43-59e15ceab0cd/kube-auth-proxy/0.log"
Jul 22 03:25:28.927510 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:28.927417    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8fd84546-rmjqk_23fae3d4-4606-4d8a-beff-6969e8742139/router/0.log"
Jul 22 03:25:29.735821 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:29.735773    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6bqkn_62f97af3-4226-44b8-bb9e-15433e2d248e/serve-healthcheck-canary/0.log"
Jul 22 03:25:30.298510 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.298473    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tzw5k_b1a60811-090e-48aa-8abc-3572429356b5/insights-operator/1.log"
Jul 22 03:25:30.298966 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.298949    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-tzw5k_b1a60811-090e-48aa-8abc-3572429356b5/insights-operator/0.log"
Jul 22 03:25:30.403605 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.403559    2523 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gzxjk/perf-node-gather-daemonset-tdmcs"
Jul 22 03:25:30.471328 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.471297    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v56dt_291863b8-dfa2-474c-97ae-e67c79aebef2/kube-rbac-proxy/0.log"
Jul 22 03:25:30.492364 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.492330    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v56dt_291863b8-dfa2-474c-97ae-e67c79aebef2/exporter/0.log"
Jul 22 03:25:30.515360 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:30.515315    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v56dt_291863b8-dfa2-474c-97ae-e67c79aebef2/extractor/0.log"
Jul 22 03:25:33.641132 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:33.641094    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tjqzt_c608980f-c004-4d54-a4dd-d2a1b9d3a60a/manager/0.log"
Jul 22 03:25:33.674645 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:33.674604    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-827vs_bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2/manager/0.log"
Jul 22 03:25:33.696663 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:33.696628    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b96c6dbc5-827vs_bd0e8c97-d5e4-44a1-8117-c6f4c3901cc2/copy-manifests/0.log"
Jul 22 03:25:34.586234 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:34.586201    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7885ddc578-7j5xw_257e062f-5cca-4f4f-8e43-59e15ceab0cd/kube-auth-proxy/0.log"
Jul 22 03:25:34.737103 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:34.737073    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8fd84546-rmjqk_23fae3d4-4606-4d8a-beff-6969e8742139/router/0.log"
Jul 22 03:25:35.195336 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:35.195307    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d897679c6-5dmvv_859c2523-c57a-4eb3-9d2a-7afaa8681909/manager/0.log"
Jul 22 03:25:35.247487 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:35.247459    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q4558_50bf192d-1f2b-411d-a582-160645e621f2/openshift-lws-operator/0.log"
Jul 22 03:25:36.227216 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:36.227189    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7885ddc578-7j5xw_257e062f-5cca-4f4f-8e43-59e15ceab0cd/kube-auth-proxy/0.log"
Jul 22 03:25:36.393483 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:36.393443    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8fd84546-rmjqk_23fae3d4-4606-4d8a-beff-6969e8742139/router/0.log"
Jul 22 03:25:40.831132 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:40.831098    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h7kgk_c4908d57-875b-463c-8120-03ba5e42a17a/kube-storage-version-migrator-operator/1.log"
Jul 22 03:25:40.833089 ip-10-0-130-119 kubenswrapper[2523]: I0722 03:25:40.833060    2523 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h7kgk_c4908d57-875b-463c-8120-03ba5e42a17a/kube-storage-version-migrator-operator/0.log"