Jul 08 22:47:08.290944 ip-10-0-128-122 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.190060    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193353    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193362    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193365    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193369    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193372    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193375    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193377    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.220042 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193380    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193382    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193385    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193387    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193389    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193391    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193394    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193396    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193398    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193401    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193403    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193405    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193408    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193410    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193413    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193415    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193422    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193424    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193427    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.230527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193430    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193435    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193438    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193441    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193444    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193446    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193449    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193451    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193454    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193456    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193459    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193462    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193464    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193467    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193469    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193472    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193474    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193476    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193478    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193481    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.231688 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193483    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193485    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193488    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193490    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193492    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193494    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193497    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193499    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193501    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193503    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193506    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193508    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193510    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193512    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193515    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193518    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193520    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193522    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193524    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193527    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.232435 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193529    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193531    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193534    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193536    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193539    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193541    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193543    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193545    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193548    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193550    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193552    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193554    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193557    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193560    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193563    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193567    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193570    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193573    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.233957 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193576    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193579    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193582    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193584    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193586    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193589    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193591    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193601    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193604    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193607    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193609    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193611    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193614    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193616    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.193618    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194258    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194265    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194268    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194271    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194273    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.234811 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194277    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194279    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194282    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194284    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194286    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194289    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194291    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194294    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194296    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194298    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194301    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194303    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194305    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194308    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194310    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194312    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194315    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194317    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194319    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194321    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.236119 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194324    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194326    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194328    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194330    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194332    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194335    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194337    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194339    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194342    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194346    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194349    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194352    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194356    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194359    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194364    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194367    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194370    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194373    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.236867 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194376    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194378    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194381    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194383    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194386    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194388    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194391    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194393    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194396    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194398    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194401    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194403    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194405    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194407    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194409    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194412    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194414    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194416    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194418    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194421    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.238260 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194423    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194425    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194428    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194430    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194432    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194434    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194437    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194439    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194444    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194446    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194448    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194451    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194453    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194455    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194459    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194461    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194463    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194466    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194468    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194470    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.334468 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194472    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.255812 ip-10-0-128-122 systemd[1]: Started Kubernetes Kubelet.
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194475    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194477    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194479    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194481    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194483    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194486    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194488    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194490    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194492    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194494    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194497    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194499    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194502    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194504    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194507    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194862    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194867    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194871    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194873    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.335280 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194879    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194881    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194883    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194886    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194888    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194891    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194893    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194895    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194897    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194900    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194902    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194904    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194907    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194909    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194911    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194914    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194916    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194918    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194920    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194923    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.335816 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194925    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194927    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194930    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194932    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194934    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194940    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194942    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194945    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194947    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194949    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194951    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194954    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194957    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194960    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194962    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194966    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194970    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194973    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194975    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.336310 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194978    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194980    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194983    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194985    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194988    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194990    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194993    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194995    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.194998    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195000    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195002    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195004    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195007    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195010    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195012    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195014    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195016    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195019    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195022    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195025    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.336801 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195027    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195030    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195033    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195035    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195038    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195042    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195044    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195047    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195049    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195051    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195054    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195057    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195059    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195061    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195064    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195066    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195068    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195070    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195073    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195075    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.337266 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195078    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195080    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195082    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195084    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195087    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195090    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195093    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195096    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195098    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195101    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195105    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195108    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195110    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195112    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195115    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195117    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195180    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195187    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195191    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195195    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 22:47:09.337764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195199    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195202    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195206    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195209    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195212    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195215    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195218    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195221    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195223    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195226    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195229    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195232    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195234    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195237    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195240    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195243    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195245    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195248    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195251    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195254    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195257    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195260    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195264    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195267    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 22:47:09.338197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195270    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195272    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195275    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195278    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195281    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195286    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195289    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195292    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195294    2571 flags.go:64] FLAG: --enable-server="true"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195298    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195302    2571 flags.go:64] FLAG: --event-burst="100"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195304    2571 flags.go:64] FLAG: --event-qps="50"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195307    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195310    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195312    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195315    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195318    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195321    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195323    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195326    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195328    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195331    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195334    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195336    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195339    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 22:47:09.338765 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195341    2571 flags.go:64] FLAG: --feature-gates=""
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195345    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195347    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195350    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195353    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195357    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195360    2571 flags.go:64] FLAG: --help="false"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195362    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195365    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195368    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195371    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195374    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195378    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195381    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195383    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195386    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195388    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195391    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195394    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195397    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195400    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195402    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195405    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195407    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 22:47:09.339306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195410    2571 flags.go:64] FLAG: --lock-file=""
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195413    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195415    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195418    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195423    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195425    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195427    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195430    2571 flags.go:64] FLAG: --logging-format="text"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195432    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195435    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195438    2571 flags.go:64] FLAG: --manifest-url=""
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195440    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195444    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195448    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195452    2571 flags.go:64] FLAG: --max-pods="110"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195454    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195457    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195460    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195462    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195465    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195469    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195472    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195478    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195481    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195483    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 22:47:09.339865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195486    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195489    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195494    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195497    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195500    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195502    2571 flags.go:64] FLAG: --port="10250"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195505    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195508    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f68c296d498a31e"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195511    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195513    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195516    2571 flags.go:64] FLAG: --register-node="true"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195518    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195521    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195524    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195526    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195529    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195532    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195535    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195538    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195540    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195544    2571 flags.go:64] FLAG: --runonce="false"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195546    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195549    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195552    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195555    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 22:47:09.340403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195557    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195560    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195562    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195566    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195569    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195571    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195574    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195576    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195579    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195582    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195585    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195589    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195592    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195601    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195604    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195607    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195609    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195612    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195615    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195617    2571 flags.go:64] FLAG: --v="2"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195621    2571 flags.go:64] FLAG: --version="false"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195624    2571 flags.go:64] FLAG: --vmodule=""
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195627    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.195630    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 22:47:09.340994 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195743    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195748    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195752    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195756    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195758    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195761    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195764    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195766    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195769    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195772    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195775    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195779    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195781    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195783    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195786    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195788    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195791    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195793    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195796    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.341529 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195798    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195801    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195803    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195806    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195808    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195811    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195813    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195816    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195818    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195820    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195823    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195825    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195827    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195830    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195832    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195834    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195838    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195840    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195843    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195845    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.342003 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195847    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195849    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195852    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195854    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195858    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195860    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195862    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195865    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195867    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195869    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195873    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195889    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195893    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195897    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195899    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195902    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195905    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195907    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195910    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.342437 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195913    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195915    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195918    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195920    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195923    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195925    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195927    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195930    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195932    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195936    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195938    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195941    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195943    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195945    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195948    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195950    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195952    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195956    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195958    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195960    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.343165 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195963    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195965    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195968    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195970    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195972    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195975    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195978    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195980    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195982    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195985    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195987    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195990    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195992    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195994    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195996    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.195999    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.196001    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.196004    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.196006    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.196008    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.343856 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.196010    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.196557    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.203289    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.203305    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.203323    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.203328    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203383    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203387    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203390    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203393    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203395    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203397    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203399    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203402    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.344313 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203404    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203407    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203409    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203412    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203414    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203417    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203420    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203423    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203426    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203428    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203430    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203433    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203435    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203438    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203440    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203442    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203445    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203448    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203450    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203453    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.344641 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203455    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203463    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203466    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203468    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203470    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203473    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203475    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203477    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203479    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203482    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203484    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203486    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203489    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203491    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203493    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203496    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203498    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203500    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203502    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.345152 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203504    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203507    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203510    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203512    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203515    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203517    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203519    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203521    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203524    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203526    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203531    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203533    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203535    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203538    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203540    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203547    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203549    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203553    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203556    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.345788 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203559    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203562    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203564    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203566    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203569    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203571    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203574    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203576    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203578    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203581    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203583    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203585    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203587    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203591    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203602    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203606    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203608    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203611    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203613    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.346246 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203616    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203618    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203622    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203624    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203628    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203630    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203633    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203635    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203637    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203639    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203647    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203650    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203652    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203654    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.203659    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203815    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 22:47:09.346699 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203820    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203822    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203825    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203827    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203829    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203832    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203834    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203836    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203838    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203840    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203843    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203845    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203847    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203849    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203852    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203854    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203857    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203859    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203863    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203865    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 22:47:09.347070 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203868    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203878    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203880    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203882    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203885    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203887    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203889    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203897    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203899    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203901    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203904    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203906    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203908    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203911    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203913    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203915    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203918    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203920    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203922    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203925    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 22:47:09.347511 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203927    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203929    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203932    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203934    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203936    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203938    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203941    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203943    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203945    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203948    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203951    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203953    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203955    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203959    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203961    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203964    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203966    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203969    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203971    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203973    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 22:47:09.348010 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203980    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203983    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203985    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203987    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203990    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203992    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.203996    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204000    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204002    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204005    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204007    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204010    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204012    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204014    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204017    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204019    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204021    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204023    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204025    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 22:47:09.348449 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204028    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204030    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204032    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204036    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204039    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204041    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204045    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204047    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204050    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204053    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204056    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204059    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204062    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204064    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204072    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204075    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204077    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204081    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 22:47:09.348905 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:09.204084    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.204089    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.204191    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.209033    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.210218    2571 server.go:1019] "Starting client certificate rotation"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.210313    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.210341    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.212190    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.213244    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.226489    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.228391    2571 log.go:25] "Validated CRI v1 image API"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.229762    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 22:47:09.349299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.231852    2571 fs.go:135] Filesystem UUIDs: map[50dd17a7-178a-4f36-889b-36f2cd278e84:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 fafcf82c-9b9e-4ebf-8cb1-1511807d18fe:/dev/nvme0n1p4]
Jul 08 22:47:09.349571 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.231870    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 22:47:09.349571 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.234392    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.236773    2571 manager.go:216] Machine: {Timestamp:2026-07-08 22:47:09.236323954 +0000 UTC m=+0.837155082 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096029 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21c62f6b2dcb991e682dd04ddce0db SystemUUID:ec21c62f-6b2d-cb99-1e68-2dd04ddce0db BootID:f956a75d-e59f-4252-b2b5-066056a77f51 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:4e:34:59:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:4e:34:59:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:9f:a3:ba:eb:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.236863    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.236944    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.240829    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.240987    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-122.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.241585    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.241600    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.241608    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.241618    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.242968    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245705    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245808    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245832    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245844    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245856    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245865    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.245873    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 22:47:09.349634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.246155    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.246173    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.247950    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.249734    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.249759    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250712    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250724    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzrns"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250731    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250776    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250782    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250790    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250795    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250803    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250808    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250813    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250819    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250826    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.250830    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.252238    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.252244    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.255128    2571 server.go:1268] "Started kubelet"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.255223    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.255270    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.256125    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.256794    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.257025    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xzrns"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.257894    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.259085    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.259099    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.259186    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-122.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.259169    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-122.ec2.internal.18c07207909a8e59  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-122.ec2.internal,UID:ip-10-0-128-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-122.ec2.internal,},FirstTimestamp:2026-07-08 22:47:09.255102041 +0000 UTC m=+0.855933169,LastTimestamp:2026-07-08 22:47:09.255102041 +0000 UTC m=+0.855933169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-122.ec2.internal,}"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.260464    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.262306    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.262306    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.262505    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.262971    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.262973    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263006    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263132    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263143    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 22:47:09.350368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263300    2571 factory.go:55] Registering systemd factory
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263311    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263813    2571 factory.go:153] Registering CRI-O factory
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263831    2571 factory.go:223] Registration of the crio container factory successfully
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263876    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263922    2571 factory.go:103] Registering Raw factory
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.263940    2571 manager.go:1196] Started watching for new ooms in manager
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.264254    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.264304    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.264341    2571 manager.go:349] Starting recovery of all containers
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.274477    2571 manager.go:354] Recovery completed
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.278154    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.279725    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.279751    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.279765    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.280219    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.280228    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.280233    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.280241    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343142    2571 policy_none.go:49] "None policy: Start"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343157    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343167    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343799    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343824    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.343833    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.352117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.344097    2571 policy_none.go:47] "Start"
Jul 08 22:47:09.362694 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.362576    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.388188 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388174    2571 manager.go:337] "Starting Device Plugin manager"
Jul 08 22:47:09.388244 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.388205    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 22:47:09.388244 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388214    2571 server.go:87] "Starting device plugin registration server"
Jul 08 22:47:09.388381 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388371    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 22:47:09.388433 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388384    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 22:47:09.388483 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388466    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 22:47:09.388557 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388541    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 22:47:09.388557 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.388555    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 22:47:09.389048 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.389031    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 22:47:09.389115 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.389072    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.456511 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.456474    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 22:47:09.458200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.457541    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 22:47:09.458200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.457571    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 22:47:09.458200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.457589    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 22:47:09.458200 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.457627    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 22:47:09.459203 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.459187    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:09.468895 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.468880    2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-122.ec2.internal\" not found" node="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.488974 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.488933    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.489629 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.489608    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.489724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.489637    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.489724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.489660    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.489724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.489708    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.495905 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.495893    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.495970 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.495910    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-122.ec2.internal\": node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.508150 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.508134    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.558320 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.558295    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"]
Jul 08 22:47:09.558384 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.558356    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.560124 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.560112    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.560193 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.560136    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.560193 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.560144    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.562039 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562028    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.562137 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.562173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562150    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.562700 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562673    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.562750 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562713    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.562750 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562723    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.562804 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562671    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.562804 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562781    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.562804 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.562793    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.564180 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.564160    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.564180 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.564180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.564284 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.564194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b0df211eddea4aae4780970deea189-config\") pod \"kube-apiserver-proxy-ip-10-0-128-122.ec2.internal\" (UID: \"f9b0df211eddea4aae4780970deea189\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.564651 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.564639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.564700 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.564664    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 22:47:09.565248 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.565236    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 22:47:09.565304 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.565259    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 22:47:09.565304 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.565267    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeHasSufficientPID"
Jul 08 22:47:09.588171 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.588156    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-122.ec2.internal\" not found" node="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.591850 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.591837    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-122.ec2.internal\" not found" node="ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.608627 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.608612    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.664318 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.664388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b0df211eddea4aae4780970deea189-config\") pod \"kube-apiserver-proxy-ip-10-0-128-122.ec2.internal\" (UID: \"f9b0df211eddea4aae4780970deea189\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.664388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.664388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664381    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.664388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664385    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f99d8e2c569a2b3d59f0023c611ef5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal\" (UID: \"a1f99d8e2c569a2b3d59f0023c611ef5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.664503 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.664398    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9b0df211eddea4aae4780970deea189-config\") pod \"kube-apiserver-proxy-ip-10-0-128-122.ec2.internal\" (UID: \"f9b0df211eddea4aae4780970deea189\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.709406 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.709387    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.810024 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.809970    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:09.891354 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.891329    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.894388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:09.894373    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:09.910068 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:09.910046    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:10.011033 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.011006    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:10.111401 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.111335    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-122.ec2.internal\" not found"
Jul 08 22:47:10.135261 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.135243    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:10.162748 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.162724    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:10.171944 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.171927    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:47:10.173455 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.173444    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal"
Jul 08 22:47:10.180383 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.180368    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 22:47:10.209477 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.209446    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 22:47:10.209594 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.209575    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:47:10.209629 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.209608    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 22:47:10.237205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.237184    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:10.243525 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.243508    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:10.246256 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.246238    2571 apiserver.go:52] "Watching apiserver"
Jul 08 22:47:10.252403 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.252386    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 22:47:10.253211 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.253194    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-cc2dz","openshift-ovn-kubernetes/ovnkube-node-svpgw","kube-system/global-pull-secret-syncer-5kbnf","kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal","openshift-image-registry/node-ca-6zp5j","openshift-multus/multus-additional-cni-plugins-pq8z7","openshift-network-diagnostics/network-check-target-f7txl","openshift-network-operator/iptables-alerter-vdc8b","kube-system/konnectivity-agent-nlsrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56","openshift-cluster-node-tuning-operator/tuned-tm6b7","openshift-dns/node-resolver-rqt8q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal","openshift-multus/multus-2fmss"]
Jul 08 22:47:10.255547 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.255531    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.257396 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.257379    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.257874 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.257858    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.258051 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.258036    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.258108 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.258053    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bqfgf\""
Jul 08 22:47:10.258108 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.258092    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 22:47:10.259550 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.259527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.259620 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.259598    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:10.259713 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.259697    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.259764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.259733    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q4rfx\""
Jul 08 22:47:10.259764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.259752    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.261384 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.261343    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:42:09 +0000 UTC" deadline="2028-04-19 01:47:12.220959992 +0000 UTC"
Jul 08 22:47:10.261384 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.261383    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15603h0m1.95958044s"
Jul 08 22:47:10.262018 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.262005    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.262719 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.262706    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 22:47:10.264017 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.263995    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.264173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.264102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.264173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.264127    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 22:47:10.264272 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.264180    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.264272 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.264262    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4l6bv\""
Jul 08 22:47:10.264391 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.264377    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 22:47:10.266250 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.266236    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 22:47:10.266425 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.266403    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h29sg\""
Jul 08 22:47:10.266494 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.266406    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.266598 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.266585    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.267007 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.266971    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.267757 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-sys-fs\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.267836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8cbz\" (UniqueName: \"kubernetes.io/projected/e7035c0a-5e92-47fc-b424-bad438518082-kube-api-access-l8cbz\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.267836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-kubernetes\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.267836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-lib-modules\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.267966 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-system-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.267966 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267894    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgr5\" (UniqueName: \"kubernetes.io/projected/56b906c9-4b5b-4c0e-a95c-43818f8440fa-kube-api-access-8fgr5\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.267966 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-host\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.267966 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgx4\" (UniqueName: \"kubernetes.io/projected/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-kube-api-access-dcgx4\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.268122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-device-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.268122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.267999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-systemd\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268075    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-tmp\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-serviceca\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.268316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-socket-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.268316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-os-release\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-multus\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-kubelet\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268292    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-daemon-config\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmpq9\" (UniqueName: \"kubernetes.io/projected/aefd4f1a-613e-43da-bc2c-99edf56d731f-kube-api-access-lmpq9\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-kubelet-config\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-registration-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cnibin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268450    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-socket-dir-parent\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysconfig\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268512 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-conf\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cni-binary-copy\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268614    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268635    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-etc-selinux\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-host\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-hostroot\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-modprobe-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-run\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-sys\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-tuned\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-dbus\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.268901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268915    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-k8s-cni-cncf-io\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-netns\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-bin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.268997    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-multus-certs\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-etc-kubernetes\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269050    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-var-lib-kubelet\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269209    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-conf-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.269367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269250    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-69dvr\""
Jul 08 22:47:10.269739 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.269461    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.271924 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.271890    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 22:47:10.271924 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.271894    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 22:47:10.272062 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.271987    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qltsr\""
Jul 08 22:47:10.272459 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.272445    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 22:47:10.272537 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.272525    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.274729 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.274710    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.274920 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.274892    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.275125 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.275107    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 22:47:10.275219 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.275205    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.275256 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.275234    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gf7ql\""
Jul 08 22:47:10.276796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.276781    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 22:47:10.276880 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.276811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.276880 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.276826    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 22:47:10.276880 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.276861    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rk6r5\""
Jul 08 22:47:10.276880 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.276868    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:10.277058 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.276950    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.277316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.277301    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.277375 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.277343    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 22:47:10.277408 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.277376    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 22:47:10.278911 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.278896    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:10.278976 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.278954    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:10.280854 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.280839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.282861 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.282847    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 22:47:10.282925 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.282881    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nffww\""
Jul 08 22:47:10.282962 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.282937    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 22:47:10.289692 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.289663    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqcb2"
Jul 08 22:47:10.296938 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.296923    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqcb2"
Jul 08 22:47:10.363913 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.363865    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 22:47:10.369401 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369381    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-system-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.369480 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgr5\" (UniqueName: \"kubernetes.io/projected/56b906c9-4b5b-4c0e-a95c-43818f8440fa-kube-api-access-8fgr5\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.369480 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-systemd\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.369480 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-tmp\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.369592 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369479    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-system-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.369592 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369505    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-systemd\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.369592 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmpq9\" (UniqueName: \"kubernetes.io/projected/aefd4f1a-613e-43da-bc2c-99edf56d731f-kube-api-access-lmpq9\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.369592 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e6801ab-2e75-4239-9209-ebe83b853323-tmp-dir\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.369800 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-netns\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.369800 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.369800 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-kubelet\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.369800 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369727    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdfl\" (UniqueName: \"kubernetes.io/projected/92324e79-83b5-4257-a58d-11af6e2232bc-kube-api-access-lmdfl\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.369800 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369731    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 22:47:10.369934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzkz\" (UniqueName: \"kubernetes.io/projected/7e6801ab-2e75-4239-9209-ebe83b853323-kube-api-access-zjzkz\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.369934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cnibin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.369934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-socket-dir-parent\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.369934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-conf\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.369934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369889    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-host-slash\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369970    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-socket-dir-parent\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369978    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-conf\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.369990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cni-binary-copy\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-etc-selinux\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370003    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cnibin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-hostroot\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370044    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-hostroot\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-modprobe-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-tuned\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370092    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-etc-selinux\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-dbus\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-etc-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370130 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-k8s-cni-cncf-io\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-multus-certs\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-ovn\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370166    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-modprobe-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370174    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-log-socket\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370191    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-dbus\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370200    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-k8s-cni-cncf-io\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-netd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370216    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-multus-certs\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-config\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-slash\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370278    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjpt\" (UniqueName: \"kubernetes.io/projected/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-kube-api-access-tsjpt\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-sys-fs\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370360    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8cbz\" (UniqueName: \"kubernetes.io/projected/e7035c0a-5e92-47fc-b424-bad438518082-kube-api-access-l8cbz\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370391    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-kubernetes\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370418    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-systemd-units\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.370657 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370426    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-sys-fs\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-cnibin\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370439    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-kubernetes\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6deff622-efef-4f34-9544-fd0cdc07ed52-agent-certs\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370454    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-cni-binary-copy\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-host\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgx4\" (UniqueName: \"kubernetes.io/projected/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-kube-api-access-dcgx4\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-device-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370570    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-device-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370547    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-host\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370629    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysctl-d\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370626    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-iptables-alerter-script\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-serviceca\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-socket-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-os-release\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371334 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370742    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-multus\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-kubelet\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370793    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-os-release\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-multus\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370805    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-kubelet\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-daemon-config\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370843    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-socket-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370845    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-kubelet-config\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370881    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-bin\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370886    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-kubelet-config\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370904    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-registration-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysconfig\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmmvg\" (UniqueName: \"kubernetes.io/projected/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-kube-api-access-lmmvg\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.370991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-os-release\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371006    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-sysconfig\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371035    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.371928 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371065    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-registration-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-host\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371098    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-serviceca\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e6801ab-2e75-4239-9209-ebe83b853323-hosts-file\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-system-cni-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.371164    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371168    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8875\" (UniqueName: \"kubernetes.io/projected/a0be5df2-da64-47df-8501-a19988b61027-kube-api-access-m8875\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-run\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371196    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-host\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371164    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e7035c0a-5e92-47fc-b424-bad438518082-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-sys\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.371243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:10.871211483 +0000 UTC m=+2.472042618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371249    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-sys\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-systemd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371297    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-run\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371296    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-daemon-config\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.372570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371308    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-netns\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-bin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-etc-kubernetes\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371387    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-cni-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-var-lib-kubelet\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371403    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-run-netns\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371429    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-script-lib\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371422    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-host-var-lib-cni-bin\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371442    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-var-lib-kubelet\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371469    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-etc-kubernetes\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371480    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371513    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-conf-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371536    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-var-lib-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371539    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56b906c9-4b5b-4c0e-a95c-43818f8440fa-multus-conf-dir\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371558    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373150 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-env-overrides\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92324e79-83b5-4257-a58d-11af6e2232bc-ovn-node-metrics-cert\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371635    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6deff622-efef-4f34-9544-fd0cdc07ed52-konnectivity-ca\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371739    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-lib-modules\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371771    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-node-log\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371796    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-binary-copy\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.371864    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aefd4f1a-613e-43da-bc2c-99edf56d731f-lib-modules\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.372824    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-etc-tuned\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.373907 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.372886    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aefd4f1a-613e-43da-bc2c-99edf56d731f-tmp\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.376204 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.376179    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgr5\" (UniqueName: \"kubernetes.io/projected/56b906c9-4b5b-4c0e-a95c-43818f8440fa-kube-api-access-8fgr5\") pod \"multus-2fmss\" (UID: \"56b906c9-4b5b-4c0e-a95c-43818f8440fa\") " pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.376531 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.376514    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmpq9\" (UniqueName: \"kubernetes.io/projected/aefd4f1a-613e-43da-bc2c-99edf56d731f-kube-api-access-lmpq9\") pod \"tuned-tm6b7\" (UID: \"aefd4f1a-613e-43da-bc2c-99edf56d731f\") " pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.376952 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.376935    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgx4\" (UniqueName: \"kubernetes.io/projected/3d1b9e84-a731-44eb-a6f8-2fd450664fe5-kube-api-access-dcgx4\") pod \"node-ca-6zp5j\" (UID: \"3d1b9e84-a731-44eb-a6f8-2fd450664fe5\") " pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.377324 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.377309    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8cbz\" (UniqueName: \"kubernetes.io/projected/e7035c0a-5e92-47fc-b424-bad438518082-kube-api-access-l8cbz\") pod \"aws-ebs-csi-driver-node-cxh56\" (UID: \"e7035c0a-5e92-47fc-b424-bad438518082\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.391174 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.391149    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b0df211eddea4aae4780970deea189.slice/crio-2fdc13ee601b3e008b5513638cd9a64ea841de12dc14e29062404e845ae44b2a WatchSource:0}: Error finding container 2fdc13ee601b3e008b5513638cd9a64ea841de12dc14e29062404e845ae44b2a: Status 404 returned error can't find the container with id 2fdc13ee601b3e008b5513638cd9a64ea841de12dc14e29062404e845ae44b2a
Jul 08 22:47:10.391378 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.391362    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f99d8e2c569a2b3d59f0023c611ef5.slice/crio-5585a2444f86d628ffac0d8933a4e6413ee946763744c23a32b949812e3d1979 WatchSource:0}: Error finding container 5585a2444f86d628ffac0d8933a4e6413ee946763744c23a32b949812e3d1979: Status 404 returned error can't find the container with id 5585a2444f86d628ffac0d8933a4e6413ee946763744c23a32b949812e3d1979
Jul 08 22:47:10.395647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.395633    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:47:10.460993 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.460951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal" event={"ID":"a1f99d8e2c569a2b3d59f0023c611ef5","Type":"ContainerStarted","Data":"5585a2444f86d628ffac0d8933a4e6413ee946763744c23a32b949812e3d1979"}
Jul 08 22:47:10.461991 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.461971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal" event={"ID":"f9b0df211eddea4aae4780970deea189","Type":"ContainerStarted","Data":"2fdc13ee601b3e008b5513638cd9a64ea841de12dc14e29062404e845ae44b2a"}
Jul 08 22:47:10.472323 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472302    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-etc-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472390 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472329    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-ovn\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472390 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-log-socket\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472390 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-netd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472388    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-config\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472397    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-etc-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-slash\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472428    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-ovn\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472435    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472460    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjpt\" (UniqueName: \"kubernetes.io/projected/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-kube-api-access-tsjpt\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472487    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-slash\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472494    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-netd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472502    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-log-socket\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-systemd-units\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.472539 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-cnibin\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6deff622-efef-4f34-9544-fd0cdc07ed52-agent-certs\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472575    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-cnibin\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472583    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-systemd-units\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-iptables-alerter-script\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-bin\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmmvg\" (UniqueName: \"kubernetes.io/projected/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-kube-api-access-lmmvg\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-os-release\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472806    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-cni-bin\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e6801ab-2e75-4239-9209-ebe83b853323-hosts-file\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472867    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-os-release\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472870    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-system-cni-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472902    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8875\" (UniqueName: \"kubernetes.io/projected/a0be5df2-da64-47df-8501-a19988b61027-kube-api-access-m8875\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472910    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-system-cni-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472928    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-systemd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473123 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-script-lib\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472970    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-config\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.472963    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e6801ab-2e75-4239-9209-ebe83b853323-hosts-file\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473031    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-systemd\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-var-lib-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473115    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473127    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0be5df2-da64-47df-8501-a19988b61027-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473140    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-env-overrides\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473190    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-var-lib-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92324e79-83b5-4257-a58d-11af6e2232bc-ovn-node-metrics-cert\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473247    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-ovn-kubernetes\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473250    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-iptables-alerter-script\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6deff622-efef-4f34-9544-fd0cdc07ed52-konnectivity-ca\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.473876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473297    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-node-log\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-binary-copy\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.473336    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e6801ab-2e75-4239-9209-ebe83b853323-tmp-dir\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.473388    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:10.973372282 +0000 UTC m=+2.574203407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473407    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-netns\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473417    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-node-log\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473435    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-kubelet\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.473967    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdfl\" (UniqueName: \"kubernetes.io/projected/92324e79-83b5-4257-a58d-11af6e2232bc-kube-api-access-lmdfl\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzkz\" (UniqueName: \"kubernetes.io/projected/7e6801ab-2e75-4239-9209-ebe83b853323-kube-api-access-zjzkz\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-host-slash\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474164    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-host-slash\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474215    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-run-netns\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474263    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-run-openvswitch\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474282    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6deff622-efef-4f34-9544-fd0cdc07ed52-konnectivity-ca\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474309    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/92324e79-83b5-4257-a58d-11af6e2232bc-host-kubelet\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.474670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474367    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-cni-binary-copy\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.475484 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474482    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e6801ab-2e75-4239-9209-ebe83b853323-tmp-dir\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.475484 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474558    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-ovnkube-script-lib\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.475484 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.474724    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/92324e79-83b5-4257-a58d-11af6e2232bc-env-overrides\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.475484 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.475329    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a0be5df2-da64-47df-8501-a19988b61027-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.475660 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.475481    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6deff622-efef-4f34-9544-fd0cdc07ed52-agent-certs\") pod \"konnectivity-agent-nlsrr\" (UID: \"6deff622-efef-4f34-9544-fd0cdc07ed52\") " pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.477471 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.477454    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/92324e79-83b5-4257-a58d-11af6e2232bc-ovn-node-metrics-cert\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.480066 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.480050    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmmvg\" (UniqueName: \"kubernetes.io/projected/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-kube-api-access-lmmvg\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.482335 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.482316    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:10.482335 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.482334    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:10.482408 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.482346    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:10.482408 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.482392    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:10.982378976 +0000 UTC m=+2.583210111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:10.482868 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.482851    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjpt\" (UniqueName: \"kubernetes.io/projected/43423b1c-0c83-4527-b5f3-1bd0e25f6a17-kube-api-access-tsjpt\") pod \"iptables-alerter-vdc8b\" (UID: \"43423b1c-0c83-4527-b5f3-1bd0e25f6a17\") " pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.484793 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.484771    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8875\" (UniqueName: \"kubernetes.io/projected/a0be5df2-da64-47df-8501-a19988b61027-kube-api-access-m8875\") pod \"multus-additional-cni-plugins-pq8z7\" (UID: \"a0be5df2-da64-47df-8501-a19988b61027\") " pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.485148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.485132    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdfl\" (UniqueName: \"kubernetes.io/projected/92324e79-83b5-4257-a58d-11af6e2232bc-kube-api-access-lmdfl\") pod \"ovnkube-node-svpgw\" (UID: \"92324e79-83b5-4257-a58d-11af6e2232bc\") " pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.485148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.485141    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzkz\" (UniqueName: \"kubernetes.io/projected/7e6801ab-2e75-4239-9209-ebe83b853323-kube-api-access-zjzkz\") pod \"node-resolver-rqt8q\" (UID: \"7e6801ab-2e75-4239-9209-ebe83b853323\") " pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.588901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.588874    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56"
Jul 08 22:47:10.598286 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.598267    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7035c0a_5e92_47fc_b424_bad438518082.slice/crio-3dc35593a0971d38075b925b7d110587e721406b353f31a795c69e52223e5a3d WatchSource:0}: Error finding container 3dc35593a0971d38075b925b7d110587e721406b353f31a795c69e52223e5a3d: Status 404 returned error can't find the container with id 3dc35593a0971d38075b925b7d110587e721406b353f31a795c69e52223e5a3d
Jul 08 22:47:10.607833 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.607814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tm6b7"
Jul 08 22:47:10.615114 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.615062    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefd4f1a_613e_43da_bc2c_99edf56d731f.slice/crio-0c87821b7dacc6fb35acd07792d8517577cc672ab7732d88e1572290ec8b80cf WatchSource:0}: Error finding container 0c87821b7dacc6fb35acd07792d8517577cc672ab7732d88e1572290ec8b80cf: Status 404 returned error can't find the container with id 0c87821b7dacc6fb35acd07792d8517577cc672ab7732d88e1572290ec8b80cf
Jul 08 22:47:10.624119 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.624104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2fmss"
Jul 08 22:47:10.631946 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.631920    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b906c9_4b5b_4c0e_a95c_43818f8440fa.slice/crio-cc8d4c3b6fc3a7014ef8ac8ab946a4706e3e519d9825a4c1334b0d8d6cb45d13 WatchSource:0}: Error finding container cc8d4c3b6fc3a7014ef8ac8ab946a4706e3e519d9825a4c1334b0d8d6cb45d13: Status 404 returned error can't find the container with id cc8d4c3b6fc3a7014ef8ac8ab946a4706e3e519d9825a4c1334b0d8d6cb45d13
Jul 08 22:47:10.640594 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.640576    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6zp5j"
Jul 08 22:47:10.649041 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.649016    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1b9e84_a731_44eb_a6f8_2fd450664fe5.slice/crio-f946034d2fb0b3b196aa05ff699a0b25be9efc97d8b909f0ce797dae082a85ba WatchSource:0}: Error finding container f946034d2fb0b3b196aa05ff699a0b25be9efc97d8b909f0ce797dae082a85ba: Status 404 returned error can't find the container with id f946034d2fb0b3b196aa05ff699a0b25be9efc97d8b909f0ce797dae082a85ba
Jul 08 22:47:10.654510 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.654497    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pq8z7"
Jul 08 22:47:10.662124 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.662104    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0be5df2_da64_47df_8501_a19988b61027.slice/crio-f92babf77e7c25e8ae3ee764cf2d2d2adf54415acb4b138347eeb0794188e1ff WatchSource:0}: Error finding container f92babf77e7c25e8ae3ee764cf2d2d2adf54415acb4b138347eeb0794188e1ff: Status 404 returned error can't find the container with id f92babf77e7c25e8ae3ee764cf2d2d2adf54415acb4b138347eeb0794188e1ff
Jul 08 22:47:10.666415 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.666403    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:10.674072 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.674053    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6deff622_efef_4f34_9544_fd0cdc07ed52.slice/crio-e62abe862f5d9bd5dbd95be238aa62ab291ef03d7151813ebaf766089b39bad4 WatchSource:0}: Error finding container e62abe862f5d9bd5dbd95be238aa62ab291ef03d7151813ebaf766089b39bad4: Status 404 returned error can't find the container with id e62abe862f5d9bd5dbd95be238aa62ab291ef03d7151813ebaf766089b39bad4
Jul 08 22:47:10.687912 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.687895    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vdc8b"
Jul 08 22:47:10.693714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.693700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:10.695069 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.695051    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43423b1c_0c83_4527_b5f3_1bd0e25f6a17.slice/crio-b3b2debbd5b3a143c67719b5f6c1b3786841caa81b1271672601d86c6c29a7bb WatchSource:0}: Error finding container b3b2debbd5b3a143c67719b5f6c1b3786841caa81b1271672601d86c6c29a7bb: Status 404 returned error can't find the container with id b3b2debbd5b3a143c67719b5f6c1b3786841caa81b1271672601d86c6c29a7bb
Jul 08 22:47:10.697902 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.697889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rqt8q"
Jul 08 22:47:10.701527 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.701508    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92324e79_83b5_4257_a58d_11af6e2232bc.slice/crio-79993111f25dff021ea50439a8e4279a15af62bb6cd85d5d078e136df9967bfb WatchSource:0}: Error finding container 79993111f25dff021ea50439a8e4279a15af62bb6cd85d5d078e136df9967bfb: Status 404 returned error can't find the container with id 79993111f25dff021ea50439a8e4279a15af62bb6cd85d5d078e136df9967bfb
Jul 08 22:47:10.707328 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:10.707313    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e6801ab_2e75_4239_9209_ebe83b853323.slice/crio-01cf0bef3069bb84aa0729a46edaf3220c2977f1ad257c9a3408b11d05eecc27 WatchSource:0}: Error finding container 01cf0bef3069bb84aa0729a46edaf3220c2977f1ad257c9a3408b11d05eecc27: Status 404 returned error can't find the container with id 01cf0bef3069bb84aa0729a46edaf3220c2977f1ad257c9a3408b11d05eecc27
Jul 08 22:47:10.876281 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.876194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:10.876438 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.876389    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:10.876498 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.876472    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:11.876449072 +0000 UTC m=+3.477280190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:10.977354 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:10.976712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:10.977354 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.976930    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:10.977354 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:10.976991    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:11.976973321 +0000 UTC m=+3.577804444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:11.077268 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.077231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:11.077449 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.077432    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:11.077524 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.077456    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:11.077524 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.077469    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:11.077629 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.077529    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:12.077508969 +0000 UTC m=+3.678340109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:11.185949 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.185875    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:11.300148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.300075    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:42:10 +0000 UTC" deadline="2028-04-15 01:24:31.619998232 +0000 UTC"
Jul 08 22:47:11.300148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.300147    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15506h37m20.319855991s"
Jul 08 22:47:11.459308 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.459229    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:11.459463 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.459354    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:11.485666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.485630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqt8q" event={"ID":"7e6801ab-2e75-4239-9209-ebe83b853323","Type":"ContainerStarted","Data":"01cf0bef3069bb84aa0729a46edaf3220c2977f1ad257c9a3408b11d05eecc27"}
Jul 08 22:47:11.495194 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.495142    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"79993111f25dff021ea50439a8e4279a15af62bb6cd85d5d078e136df9967bfb"}
Jul 08 22:47:11.505126 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.505095    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vdc8b" event={"ID":"43423b1c-0c83-4527-b5f3-1bd0e25f6a17","Type":"ContainerStarted","Data":"b3b2debbd5b3a143c67719b5f6c1b3786841caa81b1271672601d86c6c29a7bb"}
Jul 08 22:47:11.526462 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.526434    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6zp5j" event={"ID":"3d1b9e84-a731-44eb-a6f8-2fd450664fe5","Type":"ContainerStarted","Data":"f946034d2fb0b3b196aa05ff699a0b25be9efc97d8b909f0ce797dae082a85ba"}
Jul 08 22:47:11.536695 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.536658    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56" event={"ID":"e7035c0a-5e92-47fc-b424-bad438518082","Type":"ContainerStarted","Data":"3dc35593a0971d38075b925b7d110587e721406b353f31a795c69e52223e5a3d"}
Jul 08 22:47:11.557865 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.557838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlsrr" event={"ID":"6deff622-efef-4f34-9544-fd0cdc07ed52","Type":"ContainerStarted","Data":"e62abe862f5d9bd5dbd95be238aa62ab291ef03d7151813ebaf766089b39bad4"}
Jul 08 22:47:11.595269 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.595237    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerStarted","Data":"f92babf77e7c25e8ae3ee764cf2d2d2adf54415acb4b138347eeb0794188e1ff"}
Jul 08 22:47:11.616917 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.616879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fmss" event={"ID":"56b906c9-4b5b-4c0e-a95c-43818f8440fa","Type":"ContainerStarted","Data":"cc8d4c3b6fc3a7014ef8ac8ab946a4706e3e519d9825a4c1334b0d8d6cb45d13"}
Jul 08 22:47:11.627889 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.627860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tm6b7" event={"ID":"aefd4f1a-613e-43da-bc2c-99edf56d731f","Type":"ContainerStarted","Data":"0c87821b7dacc6fb35acd07792d8517577cc672ab7732d88e1572290ec8b80cf"}
Jul 08 22:47:11.885181 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.885107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:11.885331 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.885312    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:11.885396 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.885382    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:13.88536345 +0000 UTC m=+5.486194569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:11.986083 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:11.986044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:11.986257 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.986209    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:11.986323 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:11.986272    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:13.986253983 +0000 UTC m=+5.587085102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:12.087578 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.087533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:12.087771 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.087738    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:12.087771 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.087757    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:12.087771 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.087769    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:12.087940 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.087823    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:14.087806196 +0000 UTC m=+5.688637318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:12.301046 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.300931    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:42:10 +0000 UTC" deadline="2028-01-20 10:50:16.226337732 +0000 UTC"
Jul 08 22:47:12.301046 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.300969    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13452h3m3.92537315s"
Jul 08 22:47:12.329019 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.328984    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 22:47:12.457988 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.457961    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:12.458174 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.458081    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:12.458464 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:12.458444    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:12.458564 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:12.458542    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:13.462832 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:13.462801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:13.463266 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:13.462929    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:13.903019 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:13.902661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:13.903019 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:13.902861    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:13.903019 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:13.902922    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:17.902904105 +0000 UTC m=+9.503735223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:14.003627 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:14.003587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:14.003816 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.003742    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:14.003816 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.003809    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:18.003790575 +0000 UTC m=+9.604621695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:14.104167 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:14.104133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:14.104341 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.104318    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:14.104425 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.104344    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:14.104425 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.104357    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:14.104527 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.104441    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:18.104396461 +0000 UTC m=+9.705227585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:14.458549 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:14.458519    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:14.458748 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.458637    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:14.459145 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:14.459011    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:14.459145 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:14.459096    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:15.458106 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:15.458064    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:15.458550 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:15.458215    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:16.458149 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:16.458116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:16.458672 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:16.458130    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:16.458672 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:16.458255    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:16.458672 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:16.458279    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:17.461320 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:17.461291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:17.461756 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:17.461427    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:17.939059 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:17.938981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:17.939214 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:17.939119    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:17.939214 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:17.939177    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:25.939159557 +0000 UTC m=+17.539990676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:18.040350 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:18.040306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:18.040497 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.040447    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:18.040555 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.040511    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:26.040492167 +0000 UTC m=+17.641323290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:18.141062 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:18.141022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:18.141250 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.141214    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:18.141250 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.141241    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:18.141381 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.141256    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:18.141381 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.141322    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:26.141301865 +0000 UTC m=+17.742133001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:18.459033 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:18.458593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:18.459033 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:18.458614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:18.459033 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.458731    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:18.459033 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:18.458769    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:19.459900 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:19.459559    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:19.459900 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:19.459695    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:20.458286 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:20.458244    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:20.458470 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:20.458376    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:20.458470 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:20.458433    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:20.458587 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:20.458529    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:21.458570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:21.458513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:21.459016 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:21.458723    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:22.458531 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:22.458492    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:22.458702 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:22.458609    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:22.458702 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:22.458661    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:22.458985 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:22.458767    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:23.458154 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:23.458117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:23.458323 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:23.458263    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:24.458492 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:24.458449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:24.458492 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:24.458477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:24.459029 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:24.458589    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:24.459029 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:24.458749    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:25.458862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:25.458649    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:25.459280 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:25.458957    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:25.994112 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:25.994080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:25.994326 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:25.994207    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:25.994326 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:25.994263    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:47:41.994248173 +0000 UTC m=+33.595079291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:26.095243 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:26.095202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:26.095415 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.095337    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:26.095415 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.095407    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:42.09538795 +0000 UTC m=+33.696219084 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:26.195989 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:26.195958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:26.196177 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.196116    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:26.196177 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.196139    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:26.196177 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.196151    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:26.196338 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.196211    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:47:42.196193944 +0000 UTC m=+33.797025067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:26.457934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:26.457860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:26.457934 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:26.457902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:26.458202 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.458002    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:26.458202 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:26.458124    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:27.458786 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:27.458756    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:27.459189 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:27.458874    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:28.458859 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:28.458814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:28.459372 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:28.458863    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:28.459372 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:28.458952    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:28.459372 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:28.459102    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:29.459384 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:29.459349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:29.459884 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:29.459449    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:30.458375 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:30.458342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:30.458536 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:30.458450    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:30.458536 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:30.458495    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:30.458619 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:30.458579    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:31.458163 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.458143    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:31.458450 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:31.458240    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:31.674843 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.674626    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal" event={"ID":"f9b0df211eddea4aae4780970deea189","Type":"ContainerStarted","Data":"4075fd09636cb0363f3653918490e871f6bef543a9f586de99816947473afc8e"}
Jul 08 22:47:31.678345 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678329    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:47:31.678654 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678637    2571 generic.go:356] "Generic (PLEG): container finished" podID="92324e79-83b5-4257-a58d-11af6e2232bc" containerID="5e13f58fd271a05523b5b39548570a929f2c21c7df4758fef4e1a011aac9aa46" exitCode=1
Jul 08 22:47:31.678821 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678710    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"4c23e3e6e3aa27d59b356ae95cc2dc94348a01fdd25eb65d6fdb99abbdeeedc5"}
Jul 08 22:47:31.678821 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"b2a8fd47005a33cca587210333a3a1eb5b1759216cb47ccc1c1415177b9fc942"}
Jul 08 22:47:31.678821 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"25f515e3e0af308c8ce16173f039f7a8c9b08406ca997ba140b4b09ddeecd766"}
Jul 08 22:47:31.678960 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerDied","Data":"5e13f58fd271a05523b5b39548570a929f2c21c7df4758fef4e1a011aac9aa46"}
Jul 08 22:47:31.678960 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.678862    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"c0747e61f26eb062a11e6e78b1e5a85ffda9a506c91c6617374ea912216168c9"}
Jul 08 22:47:31.680065 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.680038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2fmss" event={"ID":"56b906c9-4b5b-4c0e-a95c-43818f8440fa","Type":"ContainerStarted","Data":"fd72dd7c10c0530740b73c2066eb4028ff973b27e0925e4d08ad9438ac9b0db8"}
Jul 08 22:47:31.681365 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.681347    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tm6b7" event={"ID":"aefd4f1a-613e-43da-bc2c-99edf56d731f","Type":"ContainerStarted","Data":"c3638258a3df5b6325eca5cfa8ed1c74829fb5f47ebf862f124c88beebfe7c7a"}
Jul 08 22:47:31.689801 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.689745    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-122.ec2.internal" podStartSLOduration=21.689730439 podStartE2EDuration="21.689730439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:31.689181616 +0000 UTC m=+23.290012779" watchObservedRunningTime="2026-07-08 22:47:31.689730439 +0000 UTC m=+23.290561580"
Jul 08 22:47:31.719976 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.719414    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tm6b7" podStartSLOduration=2.5018053719999997 podStartE2EDuration="22.719398379s" totalImagesPullingTime="20.217593007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:31.703719201 +0000 UTC m=+23.304550340" watchObservedRunningTime="2026-07-08 22:47:31.719398379 +0000 UTC m=+23.320229526"
Jul 08 22:47:31.719976 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:31.719706    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2fmss" podStartSLOduration=2.511786822 podStartE2EDuration="22.719697835s" totalImagesPullingTime="20.207911013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:31.719185722 +0000 UTC m=+23.320016858" watchObservedRunningTime="2026-07-08 22:47:31.719697835 +0000 UTC m=+23.320528970"
Jul 08 22:47:32.458260 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.458230    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:32.459077 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:32.458350    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:32.459077 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.458400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:32.459077 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:32.458490    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:32.685367 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.685182    2571 generic.go:356] "Generic (PLEG): container finished" podID="a1f99d8e2c569a2b3d59f0023c611ef5" containerID="5539df52989fc53d1b3f87bf422bf9229ccbb3d05fcb65777cccd89ddf33894d" exitCode=0
Jul 08 22:47:32.685531 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.685275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal" event={"ID":"a1f99d8e2c569a2b3d59f0023c611ef5","Type":"ContainerDied","Data":"5539df52989fc53d1b3f87bf422bf9229ccbb3d05fcb65777cccd89ddf33894d"}
Jul 08 22:47:32.686958 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.686931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlsrr" event={"ID":"6deff622-efef-4f34-9544-fd0cdc07ed52","Type":"ContainerStarted","Data":"2be4d020df551a5183d230effb6e1406881fa408220ec7441259b355d1adc39b"}
Jul 08 22:47:32.688629 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.688608    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="99ec4302c52272bc1ce35b1c6dfb93082799d3baf568151103e82983f10fb9fd" exitCode=0
Jul 08 22:47:32.688760 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.688701    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"99ec4302c52272bc1ce35b1c6dfb93082799d3baf568151103e82983f10fb9fd"}
Jul 08 22:47:32.690293 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.690271    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rqt8q" event={"ID":"7e6801ab-2e75-4239-9209-ebe83b853323","Type":"ContainerStarted","Data":"c3643f9b2a50c5b39cd70bcdfa91933a55c3c17ba2439ec6fb49b9fbb3b57dca"}
Jul 08 22:47:32.693451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.693430    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:47:32.693857 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.693833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"a364b0b9dea3391000031ce13239b08a45dad25035b9fc6052153869cb1e14c0"}
Jul 08 22:47:32.695504 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.695483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vdc8b" event={"ID":"43423b1c-0c83-4527-b5f3-1bd0e25f6a17","Type":"ContainerStarted","Data":"906a35b7d34bad0401430a439b59b7686ce1d600aba20082630aa9d8471496e1"}
Jul 08 22:47:32.697125 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.697106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6zp5j" event={"ID":"3d1b9e84-a731-44eb-a6f8-2fd450664fe5","Type":"ContainerStarted","Data":"95b80111a7eb40bc57de2ed74364e893a4054cdda0c756d1ce12855fe8e2db3e"}
Jul 08 22:47:32.698724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.698703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56" event={"ID":"e7035c0a-5e92-47fc-b424-bad438518082","Type":"ContainerStarted","Data":"72f5a68dd008b8d5c27fc70e030eccfd978351b6e36bca5e07616c93eeb0e611"}
Jul 08 22:47:32.729177 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.729138    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nlsrr" podStartSLOduration=3.572818676 podStartE2EDuration="23.729121218s" totalImagesPullingTime="20.156302542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:32.7288692 +0000 UTC m=+24.329700340" watchObservedRunningTime="2026-07-08 22:47:32.729121218 +0000 UTC m=+24.329952359"
Jul 08 22:47:32.742442 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.742388    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vdc8b" podStartSLOduration=3.60729993 podStartE2EDuration="23.742379627s" totalImagesPullingTime="20.135079697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:32.742019482 +0000 UTC m=+24.342850622" watchObservedRunningTime="2026-07-08 22:47:32.742379627 +0000 UTC m=+24.343210768"
Jul 08 22:47:32.755144 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.755086    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6zp5j" podStartSLOduration=3.573220707 podStartE2EDuration="23.755075077s" totalImagesPullingTime="20.18185437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:32.754790507 +0000 UTC m=+24.355621673" watchObservedRunningTime="2026-07-08 22:47:32.755075077 +0000 UTC m=+24.355906217"
Jul 08 22:47:32.768207 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:32.768177    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rqt8q" podStartSLOduration=3.6454614 podStartE2EDuration="23.768166599s" totalImagesPullingTime="20.122705199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:32.767946864 +0000 UTC m=+24.368778007" watchObservedRunningTime="2026-07-08 22:47:32.768166599 +0000 UTC m=+24.368997739"
Jul 08 22:47:33.111060 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.111033    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 22:47:33.402853 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.402732    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T22:47:33.111055131Z","UUID":"7530834b-40cd-45b4-a2c8-b7cc370595cc","Handler":null,"Name":"","Endpoint":""}
Jul 08 22:47:33.404348 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.404322    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 22:47:33.404460 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.404366    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 22:47:33.458832 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.458802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:33.459179 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:33.458928    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:33.703972 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.703896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56" event={"ID":"e7035c0a-5e92-47fc-b424-bad438518082","Type":"ContainerStarted","Data":"d2f02c765378aa31926fd84c90a92856e7e8337dda40fcd54891e5057ad78088"}
Jul 08 22:47:33.705826 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.705797    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal" event={"ID":"a1f99d8e2c569a2b3d59f0023c611ef5","Type":"ContainerStarted","Data":"d1879ba1861f31503e1ddf40d0684103b77e2782b300e92218b1015560d823df"}
Jul 08 22:47:33.720173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:33.720126    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-122.ec2.internal" podStartSLOduration=23.720109748 podStartE2EDuration="23.720109748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:33.719550882 +0000 UTC m=+25.320382022" watchObservedRunningTime="2026-07-08 22:47:33.720109748 +0000 UTC m=+25.320940888"
Jul 08 22:47:34.458612 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.458585    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:34.458736 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.458621    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:34.458736 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:34.458718    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:34.458844 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:34.458821    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:34.711803 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.711778    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:47:34.712302 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.712197    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"7c68a64a5dca3becfcd3bba167f5cd7c7d44fedf825c0de4d4f24a3a597ba717"}
Jul 08 22:47:34.714470 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.714434    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56" event={"ID":"e7035c0a-5e92-47fc-b424-bad438518082","Type":"ContainerStarted","Data":"02e5973d70ef3bbd51bf05dd238f88456ad6658470b67e4672e470039319b7a2"}
Jul 08 22:47:34.731146 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:34.731102    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cxh56" podStartSLOduration=3.234285779 podStartE2EDuration="25.731086964s" totalImagesPullingTime="22.496801185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:34.729849871 +0000 UTC m=+26.330681023" watchObservedRunningTime="2026-07-08 22:47:34.731086964 +0000 UTC m=+26.331918103"
Jul 08 22:47:35.458875 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:35.458843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:35.459146 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:35.458982    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:36.458107 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:36.458022    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:36.458529 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:36.458151    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:36.458529 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:36.458194    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:36.458529 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:36.458320    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:36.816087 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:36.816017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:36.816622 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:36.816598    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:37.461771 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.461602    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:37.462386 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:37.461851    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:37.723421 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.723399    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:47:37.723796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.723766    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"d4559845100e6509163eebcc079cf189f8c0e72dfad4f70ee133de01ba6618da"}
Jul 08 22:47:37.724026 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.724010    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:37.724094 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.724071    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:37.724223 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.724203    2571 scope.go:117] "RemoveContainer" containerID="5e13f58fd271a05523b5b39548570a929f2c21c7df4758fef4e1a011aac9aa46"
Jul 08 22:47:37.725787 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.725767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"aa9e37858872d83de2b40734825232df56aa30988c2432ef2077b0d4ba239e7b"}
Jul 08 22:47:37.725894 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.725826    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="aa9e37858872d83de2b40734825232df56aa30988c2432ef2077b0d4ba239e7b" exitCode=0
Jul 08 22:47:37.726100 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.726078    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:37.726720 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.726702    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nlsrr"
Jul 08 22:47:37.740823 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:37.740804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:38.458632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.458474    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:38.458939 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.458486    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:38.458939 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:38.458742    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:38.458939 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:38.458770    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:38.732698 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.732655    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:47:38.733965 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.733909    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" event={"ID":"92324e79-83b5-4257-a58d-11af6e2232bc","Type":"ContainerStarted","Data":"7fc0dbad598b854a41aa98c7958c694eee0acf222939e314300e45eb9c0cf81c"}
Jul 08 22:47:38.734087 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.734068    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:38.751007 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.750980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:47:38.761758 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:38.761703    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw" podStartSLOduration=9.412020788 podStartE2EDuration="29.761664388s" totalImagesPullingTime="20.3496436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:38.759353263 +0000 UTC m=+30.360184405" watchObservedRunningTime="2026-07-08 22:47:38.761664388 +0000 UTC m=+30.362495529"
Jul 08 22:47:39.006414 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.006320    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5kbnf"]
Jul 08 22:47:39.006414 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.006415    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:39.006566 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:39.006495    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:39.009796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.009747    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cc2dz"]
Jul 08 22:47:39.009919 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.009885    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:39.010010 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:39.009989    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:39.010382 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.010362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7txl"]
Jul 08 22:47:39.010444 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.010429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:39.010516 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:39.010496    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:39.737239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.737204    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="49806e788513c9ade83bca8ba75c37656961e8d2ba45ac0975a35d5d33756dcf" exitCode=0
Jul 08 22:47:39.737758 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:39.737301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"49806e788513c9ade83bca8ba75c37656961e8d2ba45ac0975a35d5d33756dcf"}
Jul 08 22:47:40.458516 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:40.458491    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:40.458651 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:40.458546    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:40.458651 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:40.458627    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:40.458750 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:40.458656    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:40.458750 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:40.458732    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:40.458833 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:40.458816    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:41.744129 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:41.744098    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="2b9234a2ff00f2ba061cb281f6c6ce4155e3c028552fde87b37ac714a96fde2f" exitCode=0
Jul 08 22:47:41.744600 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:41.744141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"2b9234a2ff00f2ba061cb281f6c6ce4155e3c028552fde87b37ac714a96fde2f"}
Jul 08 22:47:42.021926 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.021854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:42.022058 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.021968    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:42.022058 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.022014    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret podName:fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd nodeName:}" failed. No retries permitted until 2026-07-08 22:48:14.022001058 +0000 UTC m=+65.622832179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret") pod "global-pull-secret-syncer-5kbnf" (UID: "fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd") : object "kube-system"/"original-pull-secret" not registered
Jul 08 22:47:42.122309 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.122277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:42.122478 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.122388    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:42.122478 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.122458    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:14.122438006 +0000 UTC m=+65.723269139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 22:47:42.222867 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.222838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:42.223017 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.222999    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 22:47:42.223053 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.223024    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 22:47:42.223053 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.223034    2571 projected.go:196] Error preparing data for projected volume kube-api-access-nhjh9 for pod openshift-network-diagnostics/network-check-target-f7txl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:42.223122 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.223083    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9 podName:d1cb32f5-6113-4ad1-aef4-a11f06d0d47b nodeName:}" failed. No retries permitted until 2026-07-08 22:48:14.223068475 +0000 UTC m=+65.823899593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhjh9" (UniqueName: "kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9") pod "network-check-target-f7txl" (UID: "d1cb32f5-6113-4ad1-aef4-a11f06d0d47b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 22:47:42.458670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.458636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:42.458670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.458655    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:42.458899 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:42.458699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:42.458899 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.458785    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:42.458899 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.458856    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:42.459058 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:42.458904    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:44.458641 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.458438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:44.459027 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.458438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:44.459027 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.458477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:44.459027 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:44.458804    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5kbnf" podUID="fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd"
Jul 08 22:47:44.459027 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:44.458887    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7txl" podUID="d1cb32f5-6113-4ad1-aef4-a11f06d0d47b"
Jul 08 22:47:44.459027 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:44.458959    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:47:44.720906 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.720826    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-122.ec2.internal" event="NodeReady"
Jul 08 22:47:44.721067 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.720983    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 22:47:44.761231 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.761197    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ljw77"]
Jul 08 22:47:44.764873 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.764840    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z6nbl"]
Jul 08 22:47:44.766188 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.766166    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:44.768390 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.768368    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:44.768883 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.768862    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 22:47:44.769019 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.768997    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 22:47:44.769140 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.769068    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbpb9\""
Jul 08 22:47:44.770909 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.770750    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 22:47:44.771024 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.770956    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 22:47:44.771024 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.770987    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5p5l\""
Jul 08 22:47:44.771223 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.771207    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 22:47:44.772623 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.772604    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljw77"]
Jul 08 22:47:44.776232 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.775282    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6nbl"]
Jul 08 22:47:44.943451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943409    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d17c6cad-9880-43e9-aca9-7a8dbc012823-config-volume\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:44.943637 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w6b2\" (UniqueName: \"kubernetes.io/projected/c0acc643-ac22-487d-ac57-a02a6bd583a0-kube-api-access-5w6b2\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:44.943637 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17c6cad-9880-43e9-aca9-7a8dbc012823-tmp-dir\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:44.943637 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/d17c6cad-9880-43e9-aca9-7a8dbc012823-kube-api-access-gsqsw\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:44.943637 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:44.943889 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:44.943664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0acc643-ac22-487d-ac57-a02a6bd583a0-cert\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.044959 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.044877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d17c6cad-9880-43e9-aca9-7a8dbc012823-config-volume\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.044959 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.044945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w6b2\" (UniqueName: \"kubernetes.io/projected/c0acc643-ac22-487d-ac57-a02a6bd583a0-kube-api-access-5w6b2\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.045171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.044975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17c6cad-9880-43e9-aca9-7a8dbc012823-tmp-dir\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.045171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.045001    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/d17c6cad-9880-43e9-aca9-7a8dbc012823-kube-api-access-gsqsw\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.045171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.045026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.045171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.045068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0acc643-ac22-487d-ac57-a02a6bd583a0-cert\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.045551 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:45.045521    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:45.045667 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:45.045603    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:45.545585036 +0000 UTC m=+37.146416160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:45.045667 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.045598    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d17c6cad-9880-43e9-aca9-7a8dbc012823-config-volume\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.045940 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.045923    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d17c6cad-9880-43e9-aca9-7a8dbc012823-tmp-dir\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.049714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.049690    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0acc643-ac22-487d-ac57-a02a6bd583a0-cert\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.054428 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.054406    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsqsw\" (UniqueName: \"kubernetes.io/projected/d17c6cad-9880-43e9-aca9-7a8dbc012823-kube-api-access-gsqsw\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.054524 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.054507    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w6b2\" (UniqueName: \"kubernetes.io/projected/c0acc643-ac22-487d-ac57-a02a6bd583a0-kube-api-access-5w6b2\") pod \"ingress-canary-z6nbl\" (UID: \"c0acc643-ac22-487d-ac57-a02a6bd583a0\") " pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.086451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.086428    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z6nbl"
Jul 08 22:47:45.549339 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:45.549304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:45.549908 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:45.549421    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:45.549908 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:45.549473    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:46.549459318 +0000 UTC m=+38.150290439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:46.117299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.117130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z6nbl"]
Jul 08 22:47:46.120474 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:47:46.120450    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0acc643_ac22_487d_ac57_a02a6bd583a0.slice/crio-0bba4e8e21b35fdd5c58e116ad048b1e2c610bc99f9a757815e28c6a93a25a1e WatchSource:0}: Error finding container 0bba4e8e21b35fdd5c58e116ad048b1e2c610bc99f9a757815e28c6a93a25a1e: Status 404 returned error can't find the container with id 0bba4e8e21b35fdd5c58e116ad048b1e2c610bc99f9a757815e28c6a93a25a1e
Jul 08 22:47:46.458078 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.458045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:47:46.458238 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.458045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:47:46.458238 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.458045    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:47:46.461315 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.461294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:47:46.461315 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.461300    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:47:46.462655 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.462638    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:47:46.462655 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.462647    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:47:46.462812 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.462661    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48cc2\""
Jul 08 22:47:46.462812 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.462725    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tfqh\""
Jul 08 22:47:46.555650 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.555600    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:46.556098 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:46.555713    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:46.556098 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:46.555777    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:48.555759487 +0000 UTC m=+40.156590625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:46.759641 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.759609    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="ef6f62be6048e5732894db2f94ff5ded25be7cc9a8153f40f9c6949fa55cae8d" exitCode=0
Jul 08 22:47:46.759809 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.759716    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"ef6f62be6048e5732894db2f94ff5ded25be7cc9a8153f40f9c6949fa55cae8d"}
Jul 08 22:47:46.761142 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:46.761121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6nbl" event={"ID":"c0acc643-ac22-487d-ac57-a02a6bd583a0","Type":"ContainerStarted","Data":"0bba4e8e21b35fdd5c58e116ad048b1e2c610bc99f9a757815e28c6a93a25a1e"}
Jul 08 22:47:47.768035 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:47.768004    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0be5df2-da64-47df-8501-a19988b61027" containerID="25f6c96f53990aa1a39137ca36567af461101cde3cf7e022f834a1ae44c6944b" exitCode=0
Jul 08 22:47:47.768442 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:47.768067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerDied","Data":"25f6c96f53990aa1a39137ca36567af461101cde3cf7e022f834a1ae44c6944b"}
Jul 08 22:47:48.569647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:48.569622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:48.569753 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:48.569740    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:48.569800 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:48.569791    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:47:52.569776034 +0000 UTC m=+44.170607171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:47:48.773005 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:48.772974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" event={"ID":"a0be5df2-da64-47df-8501-a19988b61027","Type":"ContainerStarted","Data":"1a167875fa39e928a0622a3915986dc05fd0f65500ded03dd188fb651813f2ef"}
Jul 08 22:47:48.774412 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:48.774385    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z6nbl" event={"ID":"c0acc643-ac22-487d-ac57-a02a6bd583a0","Type":"ContainerStarted","Data":"6c27c8a0af65a8eae941b308da007910b5df753e02678ed29ad32a0b660ba2cb"}
Jul 08 22:47:48.795876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:48.795833    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pq8z7" podStartSLOduration=8.895065482 podStartE2EDuration="39.795818022s" totalImagesPullingTime="30.90075254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:48.793947835 +0000 UTC m=+40.394778974" watchObservedRunningTime="2026-07-08 22:47:48.795818022 +0000 UTC m=+40.396649161"
Jul 08 22:47:48.807917 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:48.807878    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z6nbl" podStartSLOduration=2.476917283 podStartE2EDuration="4.807865607s" totalImagesPullingTime="2.330948324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:47:48.807306326 +0000 UTC m=+40.408137475" watchObservedRunningTime="2026-07-08 22:47:48.807865607 +0000 UTC m=+40.408696746"
Jul 08 22:47:52.596191 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:47:52.596152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:47:52.596588 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:52.596265    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:47:52.596588 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:47:52.596316    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:00.596302498 +0000 UTC m=+52.197133619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:00.651511 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:00.651472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:48:00.651990 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:00.651610    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:48:00.651990 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:00.651674    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:16.651656821 +0000 UTC m=+68.252487939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:10.757215 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:10.757178    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-svpgw"
Jul 08 22:48:14.035483 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.035447    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:48:14.038508 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.038490    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 22:48:14.048801 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.048771    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd-original-pull-secret\") pod \"global-pull-secret-syncer-5kbnf\" (UID: \"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd\") " pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:48:14.073442 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.073417    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5kbnf"
Jul 08 22:48:14.136652 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.136620    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:48:14.139862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.139836    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 22:48:14.147045 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:14.146793    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:48:14.147045 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:14.146865    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:49:18.146841362 +0000 UTC m=+129.747672487 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : secret "metrics-daemon-secret" not found
Jul 08 22:48:14.196550 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.196518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5kbnf"]
Jul 08 22:48:14.199414 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:48:14.199386    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3b8459_6284_4c9e_9cfe_2d9476c1c2bd.slice/crio-4078d4def697fe29e483df8a8bf2a1a1284be280496fcc54a861ad4b5fde2285 WatchSource:0}: Error finding container 4078d4def697fe29e483df8a8bf2a1a1284be280496fcc54a861ad4b5fde2285: Status 404 returned error can't find the container with id 4078d4def697fe29e483df8a8bf2a1a1284be280496fcc54a861ad4b5fde2285
Jul 08 22:48:14.237792 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.237772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:48:14.240514 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.240494    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 22:48:14.250942 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.250928    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 22:48:14.261216 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.261199    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhjh9\" (UniqueName: \"kubernetes.io/projected/d1cb32f5-6113-4ad1-aef4-a11f06d0d47b-kube-api-access-nhjh9\") pod \"network-check-target-f7txl\" (UID: \"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b\") " pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:48:14.380617 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.380551    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tfqh\""
Jul 08 22:48:14.388869 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.388856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:48:14.502270 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.502242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7txl"]
Jul 08 22:48:14.504884 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:48:14.504862    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1cb32f5_6113_4ad1_aef4_a11f06d0d47b.slice/crio-1390e57e4a87b8b048e7f16fd8bd4e88c67903203d7970a8740c56ab4a2448d1 WatchSource:0}: Error finding container 1390e57e4a87b8b048e7f16fd8bd4e88c67903203d7970a8740c56ab4a2448d1: Status 404 returned error can't find the container with id 1390e57e4a87b8b048e7f16fd8bd4e88c67903203d7970a8740c56ab4a2448d1
Jul 08 22:48:14.834022 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.833979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5kbnf" event={"ID":"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd","Type":"ContainerStarted","Data":"4078d4def697fe29e483df8a8bf2a1a1284be280496fcc54a861ad4b5fde2285"}
Jul 08 22:48:14.834855 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:14.834835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7txl" event={"ID":"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b","Type":"ContainerStarted","Data":"1390e57e4a87b8b048e7f16fd8bd4e88c67903203d7970a8740c56ab4a2448d1"}
Jul 08 22:48:16.654593 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:16.654558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:48:16.655036 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:16.654703    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:48:16.655036 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:16.654767    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:48:48.654753059 +0000 UTC m=+100.255584177 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:19.849669 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:19.849624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5kbnf" event={"ID":"fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd","Type":"ContainerStarted","Data":"ed4eb7ce6cb868680cd223e460bddad40af81deaa36e68540f883b002f04bfbe"}
Jul 08 22:48:19.851100 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:19.851080    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7txl" event={"ID":"d1cb32f5-6113-4ad1-aef4-a11f06d0d47b","Type":"ContainerStarted","Data":"70f9c3a969fb21ba31d28aa9369011e8ce57c5a5e0548bde76f7e31a55c8ce3f"}
Jul 08 22:48:19.851237 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:19.851223    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:48:19.864457 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:19.864415    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5kbnf" podStartSLOduration=65.723324402 podStartE2EDuration="1m10.86440427s" totalImagesPullingTime="5.141079868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:19.86406405 +0000 UTC m=+71.464895203" watchObservedRunningTime="2026-07-08 22:48:19.86440427 +0000 UTC m=+71.465235410"
Jul 08 22:48:37.331468 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.331411    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f7txl" podStartSLOduration=83.506452929 podStartE2EDuration="1m28.331393466s" totalImagesPullingTime="4.824940537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:19.877661261 +0000 UTC m=+71.478492401" watchObservedRunningTime="2026-07-08 22:48:37.331393466 +0000 UTC m=+88.932224618"
Jul 08 22:48:37.331926 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.331593    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"]
Jul 08 22:48:37.335621 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.335605    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.338168 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.338146    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 22:48:37.339586 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.339565    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 22:48:37.339663 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.339597    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2vplh\""
Jul 08 22:48:37.339663 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.339599    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 22:48:37.339955 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.339933    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 08 22:48:37.341789 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.341771    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"]
Jul 08 22:48:37.392489 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.392464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkjsd\" (UniqueName: \"kubernetes.io/projected/a8833a0e-b855-4661-a049-01735766b2e3-kube-api-access-lkjsd\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.392580 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.392501    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8833a0e-b855-4661-a049-01735766b2e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.493610 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.493585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkjsd\" (UniqueName: \"kubernetes.io/projected/a8833a0e-b855-4661-a049-01735766b2e3-kube-api-access-lkjsd\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.493714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.493616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8833a0e-b855-4661-a049-01735766b2e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.495983 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.495958    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a8833a0e-b855-4661-a049-01735766b2e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.501818 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.501796    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkjsd\" (UniqueName: \"kubernetes.io/projected/a8833a0e-b855-4661-a049-01735766b2e3-kube-api-access-lkjsd\") pod \"managed-serviceaccount-addon-agent-66d65769d4-mz6pd\" (UID: \"a8833a0e-b855-4661-a049-01735766b2e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.664097 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.664070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"
Jul 08 22:48:37.779875 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.779848    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd"]
Jul 08 22:48:37.783251 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:48:37.783224    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8833a0e_b855_4661_a049_01735766b2e3.slice/crio-7c5e1892314d3aede22686296dd28d14092f81ec34353e8938d2cf970d07ae21 WatchSource:0}: Error finding container 7c5e1892314d3aede22686296dd28d14092f81ec34353e8938d2cf970d07ae21: Status 404 returned error can't find the container with id 7c5e1892314d3aede22686296dd28d14092f81ec34353e8938d2cf970d07ae21
Jul 08 22:48:37.891535 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:37.891504    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd" event={"ID":"a8833a0e-b855-4661-a049-01735766b2e3","Type":"ContainerStarted","Data":"7c5e1892314d3aede22686296dd28d14092f81ec34353e8938d2cf970d07ae21"}
Jul 08 22:48:40.901210 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:40.901172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd" event={"ID":"a8833a0e-b855-4661-a049-01735766b2e3","Type":"ContainerStarted","Data":"ab1d813cfc05366a568c61aedd77194008aa2147a331bd806480db32c92b2c5b"}
Jul 08 22:48:40.914872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:40.914827    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd" podStartSLOduration=1.341984381 podStartE2EDuration="3.914813836s" totalImagesPullingTime="2.572829455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:48:40.914671788 +0000 UTC m=+92.515502926" watchObservedRunningTime="2026-07-08 22:48:40.914813836 +0000 UTC m=+92.515644976"
Jul 08 22:48:48.662200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:48.662156    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:48:48.662507 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:48.662304    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:48:48.662507 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:48:48.662369    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:49:52.662353125 +0000 UTC m=+164.263184243 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:48:50.855714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:48:50.855666    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f7txl"
Jul 08 22:49:18.158241 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:49:18.158201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:49:18.158747 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:18.158314    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:49:18.158747 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:18.158364    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:20.158350938 +0000 UTC m=+251.759182056 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : secret "metrics-daemon-secret" not found
Jul 08 22:49:47.779784 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:47.779737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ljw77" podUID="d17c6cad-9880-43e9-aca9-7a8dbc012823"
Jul 08 22:49:48.055909 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:49:48.055828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:49:49.467267 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:49.467226    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:49:52.688482 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:49:52.688443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:49:52.688876 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:52.688554    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 22:49:52.688876 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:49:52.688614    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls podName:d17c6cad-9880-43e9-aca9-7a8dbc012823 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:54.688599821 +0000 UTC m=+286.289430939 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls") pod "dns-default-ljw77" (UID: "d17c6cad-9880-43e9-aca9-7a8dbc012823") : secret "dns-default-metrics-tls" not found
Jul 08 22:50:03.458643 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:50:03.458568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:50:41.180526 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:50:41.180492    2571 generic.go:356] "Generic (PLEG): container finished" podID="a8833a0e-b855-4661-a049-01735766b2e3" containerID="ab1d813cfc05366a568c61aedd77194008aa2147a331bd806480db32c92b2c5b" exitCode=255
Jul 08 22:50:41.180933 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:50:41.180569    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd" event={"ID":"a8833a0e-b855-4661-a049-01735766b2e3","Type":"ContainerDied","Data":"ab1d813cfc05366a568c61aedd77194008aa2147a331bd806480db32c92b2c5b"}
Jul 08 22:50:41.185762 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:50:41.185746    2571 scope.go:117] "RemoveContainer" containerID="ab1d813cfc05366a568c61aedd77194008aa2147a331bd806480db32c92b2c5b"
Jul 08 22:50:42.185433 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:50:42.185398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66d65769d4-mz6pd" event={"ID":"a8833a0e-b855-4661-a049-01735766b2e3","Type":"ContainerStarted","Data":"ea767c47ab025b695170e06304862fd649c24d5c539e2ddd803c40f2e1535539"}
Jul 08 22:51:08.930809 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.930776    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"]
Jul 08 22:51:08.933659 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.933642    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:08.936102 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.936074    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 08 22:51:08.936213 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.936159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 08 22:51:08.936484 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.936468    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 08 22:51:08.937424 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.937406    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4m594\""
Jul 08 22:51:08.937424 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.937418    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:51:08.946571 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.946549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"]
Jul 08 22:51:08.995124 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.995097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db67385b-d847-4c76-9c5e-67c9376eb2a4-config\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:08.995226 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.995131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkd2j\" (UniqueName: \"kubernetes.io/projected/db67385b-d847-4c76-9c5e-67c9376eb2a4-kube-api-access-gkd2j\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:08.995226 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:08.995162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db67385b-d847-4c76-9c5e-67c9376eb2a4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.027948 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.027924    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8zn2j"]
Jul 08 22:51:09.030650 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.030622    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"]
Jul 08 22:51:09.030769 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.030751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.033079 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.033061    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-854b9fc89c-b2fm6"]
Jul 08 22:51:09.033185 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.033170    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.035431 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.035413    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:51:09.035550 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.035535    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.038042 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.038023    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.049606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049582    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 08 22:51:09.049724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049613    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hw4cn\""
Jul 08 22:51:09.049724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049643    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 08 22:51:09.049724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049619    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 22:51:09.049886 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049725    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 08 22:51:09.049886 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049818    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 08 22:51:09.049987 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.049905    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 22:51:09.050044 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050029    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 08 22:51:09.050096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050045    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 08 22:51:09.050096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050051    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 22:51:09.050096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050084    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 08 22:51:09.050239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050128    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 08 22:51:09.050239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050176    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 22:51:09.050239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050225    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:51:09.050388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050375    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r9rvj\""
Jul 08 22:51:09.050430 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.050422    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 22:51:09.055724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.055707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gjxn9\""
Jul 08 22:51:09.055724 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.055715    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvqzh\""
Jul 08 22:51:09.055862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.055720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 22:51:09.056706 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.056669    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 22:51:09.065939 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.065917    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"]
Jul 08 22:51:09.066634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.066616    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8zn2j"]
Jul 08 22:51:09.070575 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.070558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 08 22:51:09.079580 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.079558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 22:51:09.080361 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.080342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkd2j\" (UniqueName: \"kubernetes.io/projected/db67385b-d847-4c76-9c5e-67c9376eb2a4-kube-api-access-gkd2j\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-snapshots\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db67385b-d847-4c76-9c5e-67c9376eb2a4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-default-certificate\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096525    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6nbs\" (UniqueName: \"kubernetes.io/projected/7a110710-8aa6-4aea-8613-3b044eca90b6-kube-api-access-f6nbs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.096709 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db67385b-d847-4c76-9c5e-67c9376eb2a4-config\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.096670    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-stats-auth\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097339    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-tmp\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff360ba-e55a-46d0-9b15-c7472b5f06da-serving-cert\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097490    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5kq\" (UniqueName: \"kubernetes.io/projected/bff360ba-e55a-46d0-9b15-c7472b5f06da-kube-api-access-nr5kq\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097600    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqk7b\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpcn\" (UniqueName: \"kubernetes.io/projected/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-kube-api-access-zqpcn\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097861    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-854b9fc89c-b2fm6"]
Jul 08 22:51:09.097945 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.097883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.098602 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.098272    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db67385b-d847-4c76-9c5e-67c9376eb2a4-config\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.102193 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.102175    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db67385b-d847-4c76-9c5e-67c9376eb2a4-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.108401 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.108382    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkd2j\" (UniqueName: \"kubernetes.io/projected/db67385b-d847-4c76-9c5e-67c9376eb2a4-kube-api-access-gkd2j\") pod \"service-ca-operator-5d46d9ffd4-9z8jb\" (UID: \"db67385b-d847-4c76-9c5e-67c9376eb2a4\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.199228 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199162    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff360ba-e55a-46d0-9b15-c7472b5f06da-serving-cert\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.199228 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199193    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.199228 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.199402 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199278    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5kq\" (UniqueName: \"kubernetes.io/projected/bff360ba-e55a-46d0-9b15-c7472b5f06da-kube-api-access-nr5kq\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.199402 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.199402 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.199289    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.199349    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:09.699328745 +0000 UTC m=+241.300159879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : configmap references non-existent config key: service-ca.crt
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.199457    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:09.699440727 +0000 UTC m=+241.300271849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : secret "router-metrics-certs-default" not found
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199488    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqk7b\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpcn\" (UniqueName: \"kubernetes.io/projected/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-kube-api-access-zqpcn\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-snapshots\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.199632 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-default-certificate\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6nbs\" (UniqueName: \"kubernetes.io/projected/7a110710-8aa6-4aea-8613-3b044eca90b6-kube-api-access-f6nbs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199872    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.199959    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-stats-auth\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.199985    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.200013 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.200013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.200581 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.200024    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls podName:ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:09.700010051 +0000 UTC m=+241.300841173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zq75v" (UID: "ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0") : secret "samples-operator-tls" not found
Jul 08 22:51:09.200581 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.200213    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-snapshots\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.200581 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.200311    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.201102 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.201079    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bff360ba-e55a-46d0-9b15-c7472b5f06da-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.201189 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.201179    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 22:51:09.201247 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.201192    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74864789d8-tj4mc: secret "image-registry-tls" not found
Jul 08 22:51:09.201247 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.201232    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls podName:5567b590-2a66-4d6e-9ba5-f0571c658d44 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:09.701217072 +0000 UTC m=+241.302048207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls") pod "image-registry-74864789d8-tj4mc" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44") : secret "image-registry-tls" not found
Jul 08 22:51:09.201358 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.201295    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.201528 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.201506    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.201584 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.201565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-tmp\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.201673 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.201650    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bff360ba-e55a-46d0-9b15-c7472b5f06da-tmp\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.202304 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.202273    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bff360ba-e55a-46d0-9b15-c7472b5f06da-serving-cert\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.202467 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.202442    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.202524 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.202488    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.202868 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.202849    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-default-certificate\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.202936 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.202849    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-stats-auth\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.207406 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.207376    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.207796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.207772    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5kq\" (UniqueName: \"kubernetes.io/projected/bff360ba-e55a-46d0-9b15-c7472b5f06da-kube-api-access-nr5kq\") pod \"insights-operator-5c847dcfc4-8zn2j\" (UID: \"bff360ba-e55a-46d0-9b15-c7472b5f06da\") " pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.207796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.207786    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpcn\" (UniqueName: \"kubernetes.io/projected/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-kube-api-access-zqpcn\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.207952 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.207894    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqk7b\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.208112 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.208097    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6nbs\" (UniqueName: \"kubernetes.io/projected/7a110710-8aa6-4aea-8613-3b044eca90b6-kube-api-access-f6nbs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.242216 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.242198    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"
Jul 08 22:51:09.343950 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.343927    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hw4cn\""
Jul 08 22:51:09.351237 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.351217    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j"
Jul 08 22:51:09.360658 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.360640    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb"]
Jul 08 22:51:09.363660 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:09.363631    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb67385b_d847_4c76_9c5e_67c9376eb2a4.slice/crio-2b2eb17a59e492489d7896bb606b08fc8af723d30cf8699a0e2c9ad5d205e2dc WatchSource:0}: Error finding container 2b2eb17a59e492489d7896bb606b08fc8af723d30cf8699a0e2c9ad5d205e2dc: Status 404 returned error can't find the container with id 2b2eb17a59e492489d7896bb606b08fc8af723d30cf8699a0e2c9ad5d205e2dc
Jul 08 22:51:09.470507 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.470446    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-8zn2j"]
Jul 08 22:51:09.473132 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:09.473105    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbff360ba_e55a_46d0_9b15_c7472b5f06da.slice/crio-3ab7d755357c948007d6fa04bf24c53058bfd09b71c6c12404e8a73fe35e062c WatchSource:0}: Error finding container 3ab7d755357c948007d6fa04bf24c53058bfd09b71c6c12404e8a73fe35e062c: Status 404 returned error can't find the container with id 3ab7d755357c948007d6fa04bf24c53058bfd09b71c6c12404e8a73fe35e062c
Jul 08 22:51:09.705366 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.705339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:09.705519 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.705384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.705519 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.705402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:09.705519 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:09.705459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:09.705519 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705490    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 22:51:09.705519 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705508    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74864789d8-tj4mc: secret "image-registry-tls" not found
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705523    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:10.705504158 +0000 UTC m=+242.306335278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : configmap references non-existent config key: service-ca.crt
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705552    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705579    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls podName:5567b590-2a66-4d6e-9ba5-f0571c658d44 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:10.705565243 +0000 UTC m=+242.306396361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls") pod "image-registry-74864789d8-tj4mc" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44") : secret "image-registry-tls" not found
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705579    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705592    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls podName:ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:10.705586154 +0000 UTC m=+242.306417272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zq75v" (UID: "ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0") : secret "samples-operator-tls" not found
Jul 08 22:51:09.705798 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:09.705631    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:10.705617204 +0000 UTC m=+242.306448324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : secret "router-metrics-certs-default" not found
Jul 08 22:51:10.261024 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.260981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j" event={"ID":"bff360ba-e55a-46d0-9b15-c7472b5f06da","Type":"ContainerStarted","Data":"3ab7d755357c948007d6fa04bf24c53058bfd09b71c6c12404e8a73fe35e062c"}
Jul 08 22:51:10.262456 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.262425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb" event={"ID":"db67385b-d847-4c76-9c5e-67c9376eb2a4","Type":"ContainerStarted","Data":"2b2eb17a59e492489d7896bb606b08fc8af723d30cf8699a0e2c9ad5d205e2dc"}
Jul 08 22:51:10.715420 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.715383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:10.715420 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.715421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.715458    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715542    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715546    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715583    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls podName:ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:12.715570516 +0000 UTC m=+244.316401635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zq75v" (UID: "ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0") : secret "samples-operator-tls" not found
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715603    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:12.715597353 +0000 UTC m=+244.316428471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : configmap references non-existent config key: service-ca.crt
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715613    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:12.715607867 +0000 UTC m=+244.316438984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : secret "router-metrics-certs-default" not found
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:10.715623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715703    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 22:51:10.715718 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715711    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74864789d8-tj4mc: secret "image-registry-tls" not found
Jul 08 22:51:10.716108 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:10.715737    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls podName:5567b590-2a66-4d6e-9ba5-f0571c658d44 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:12.715731009 +0000 UTC m=+244.316562126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls") pod "image-registry-74864789d8-tj4mc" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44") : secret "image-registry-tls" not found
Jul 08 22:51:12.271218 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.271120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j" event={"ID":"bff360ba-e55a-46d0-9b15-c7472b5f06da","Type":"ContainerStarted","Data":"4e4d1dd5e1dd2a6d7abab4c52f2d5e63652e70cc91311f9ba6e6a9ffb37f07ab"}
Jul 08 22:51:12.272556 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.272526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb" event={"ID":"db67385b-d847-4c76-9c5e-67c9376eb2a4","Type":"ContainerStarted","Data":"01fbe57d63f4f58c39f60a80f180f5352a2fb97f39e989b7d7c6adadf041db58"}
Jul 08 22:51:12.286202 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.286160    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j" podStartSLOduration=0.850250888 podStartE2EDuration="3.286146633s" totalImagesPullingTime="2.435895745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:12.285392088 +0000 UTC m=+243.886223230" watchObservedRunningTime="2026-07-08 22:51:12.286146633 +0000 UTC m=+243.886977764"
Jul 08 22:51:12.299953 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.299908    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb" podStartSLOduration=1.750978615 podStartE2EDuration="4.299894801s" totalImagesPullingTime="2.548916186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:12.298908843 +0000 UTC m=+243.899739984" watchObservedRunningTime="2026-07-08 22:51:12.299894801 +0000 UTC m=+243.900725980"
Jul 08 22:51:12.599478 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.599406    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kzkvx"]
Jul 08 22:51:12.602784 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.602763    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.605310 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.605288    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 22:51:12.605310 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.605294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gcg7c\""
Jul 08 22:51:12.605491 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.605356    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 22:51:12.612124 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.612106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kzkvx"]
Jul 08 22:51:12.735072 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f83dcff-0d3a-4051-a004-c6b1c66c4210-data-volume\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.735257 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:12.735257 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735130    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.735257 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:12.735257 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735209    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735286    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls podName:ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.735262183 +0000 UTC m=+248.336093307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zq75v" (UID: "ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0") : secret "samples-operator-tls" not found
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f83dcff-0d3a-4051-a004-c6b1c66c4210-crio-socket\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735311    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735328    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74864789d8-tj4mc: secret "image-registry-tls" not found
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735367    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls podName:5567b590-2a66-4d6e-9ba5-f0571c658d44 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.735355202 +0000 UTC m=+248.336186324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls") pod "image-registry-74864789d8-tj4mc" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44") : secret "image-registry-tls" not found
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g99\" (UniqueName: \"kubernetes.io/projected/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-api-access-b7g99\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.735468 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735451    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.735437121 +0000 UTC m=+248.336268245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : configmap references non-existent config key: service-ca.crt
Jul 08 22:51:12.735821 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735488    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 22:51:12.735821 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.735504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.735821 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.735517    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.735509971 +0000 UTC m=+248.336341089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : secret "router-metrics-certs-default" not found
Jul 08 22:51:12.836095 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836229 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f83dcff-0d3a-4051-a004-c6b1c66c4210-crio-socket\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836229 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g99\" (UniqueName: \"kubernetes.io/projected/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-api-access-b7g99\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836229 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836229 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.836214    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:12.836440 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836232    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f83dcff-0d3a-4051-a004-c6b1c66c4210-data-volume\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836440 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836263    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f83dcff-0d3a-4051-a004-c6b1c66c4210-crio-socket\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.836440 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.836276    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:13.336256414 +0000 UTC m=+244.937087538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:12.836440 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.836291    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:12.836440 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:12.836348    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:13.336334191 +0000 UTC m=+244.937165327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:12.836617 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.836495    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f83dcff-0d3a-4051-a004-c6b1c66c4210-data-volume\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:12.846554 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:12.846523    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g99\" (UniqueName: \"kubernetes.io/projected/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-api-access-b7g99\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:13.340401 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:13.340367    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:13.340914 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:13.340464    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:13.340914 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:13.340510    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:14.340497133 +0000 UTC m=+245.941328254 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:13.340914 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:13.340542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:13.340914 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:13.340656    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:13.340914 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:13.340734    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:14.340718164 +0000 UTC m=+245.941549288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.350129 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:14.350096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:14.350580 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:14.350277    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.350580 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:14.350330    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:14.350580 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:14.350281    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:14.350580 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:14.350356    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.350336121 +0000 UTC m=+247.951167240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:14.350580 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:14.350381    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:16.350371399 +0000 UTC m=+247.951202520 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:14.578363 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:14.578334    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqt8q_7e6801ab-2e75-4239-9209-ebe83b853323/dns-node-resolver/0.log"
Jul 08 22:51:15.377220 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.377191    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6zp5j_3d1b9e84-a731-44eb-a6f8-2fd450664fe5/node-ca/0.log"
Jul 08 22:51:15.566720 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.566674    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8m58k"]
Jul 08 22:51:15.569891 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.569876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.572415 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.572395    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-297rc\""
Jul 08 22:51:15.572526 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.572466    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 08 22:51:15.573594 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.573577    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 08 22:51:15.573695 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.573652    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 08 22:51:15.573695 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.573655    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 08 22:51:15.578425 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.578404    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8m58k"]
Jul 08 22:51:15.660292 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.660256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfqr9\" (UniqueName: \"kubernetes.io/projected/ffaf2b81-ebb1-4d71-8247-68d287df48f4-kube-api-access-sfqr9\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.660292 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.660299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-key\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.660521 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.660388    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-cabundle\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.760954 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.760923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-cabundle\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.761108 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.761055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfqr9\" (UniqueName: \"kubernetes.io/projected/ffaf2b81-ebb1-4d71-8247-68d287df48f4-kube-api-access-sfqr9\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.761108 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.761085    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-key\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.761564 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.761544    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-cabundle\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.763369 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.763348    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ffaf2b81-ebb1-4d71-8247-68d287df48f4-signing-key\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.768573 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.768555    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfqr9\" (UniqueName: \"kubernetes.io/projected/ffaf2b81-ebb1-4d71-8247-68d287df48f4-kube-api-access-sfqr9\") pod \"service-ca-758f599c5-8m58k\" (UID: \"ffaf2b81-ebb1-4d71-8247-68d287df48f4\") " pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.879693 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.879638    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-8m58k"
Jul 08 22:51:15.997931 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:15.997895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-8m58k"]
Jul 08 22:51:16.000492 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:16.000466    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffaf2b81_ebb1_4d71_8247_68d287df48f4.slice/crio-b8c04416630f60a1b279ee549ef46060c1a89ae6183f0726835c0acf9ca954bc WatchSource:0}: Error finding container b8c04416630f60a1b279ee549ef46060c1a89ae6183f0726835c0acf9ca954bc: Status 404 returned error can't find the container with id b8c04416630f60a1b279ee549ef46060c1a89ae6183f0726835c0acf9ca954bc
Jul 08 22:51:16.289967 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.289876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-8m58k" event={"ID":"ffaf2b81-ebb1-4d71-8247-68d287df48f4","Type":"ContainerStarted","Data":"3f5bf4adbafc82d9e7b0203c582fe63d3e544596d0ac5309805aa6bed170479d"}
Jul 08 22:51:16.289967 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.289926    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-8m58k" event={"ID":"ffaf2b81-ebb1-4d71-8247-68d287df48f4","Type":"ContainerStarted","Data":"b8c04416630f60a1b279ee549ef46060c1a89ae6183f0726835c0acf9ca954bc"}
Jul 08 22:51:16.307389 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.307331    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-8m58k" podStartSLOduration=1.307310628 podStartE2EDuration="1.307310628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:16.305940574 +0000 UTC m=+247.906771715" watchObservedRunningTime="2026-07-08 22:51:16.307310628 +0000 UTC m=+247.908141770"
Jul 08 22:51:16.366489 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.366459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:16.366637 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.366563    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:16.366637 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.366622    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:20.366603998 +0000 UTC m=+251.967435117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:16.366750 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.366669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:16.366843 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.366831    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:16.366880 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.366868    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:20.366857161 +0000 UTC m=+251.967688279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:16.578527 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.578442    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z6nbl_c0acc643-ac22-487d-ac57-a02a6bd583a0/serve-healthcheck-canary/0.log"
Jul 08 22:51:16.770691 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.770647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:16.770847 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.770730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:16.770847 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.770775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:16.770847 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770783    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 08 22:51:16.770847 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:16.770802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770856    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls podName:ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:24.770829451 +0000 UTC m=+256.371660579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-zq75v" (UID: "ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0") : secret "samples-operator-tls" not found
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770887    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770908    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74864789d8-tj4mc: secret "image-registry-tls" not found
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770922    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:24.770904529 +0000 UTC m=+256.371735661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : configmap references non-existent config key: service-ca.crt
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770953    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls podName:5567b590-2a66-4d6e-9ba5-f0571c658d44 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:24.770937622 +0000 UTC m=+256.371768752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls") pod "image-registry-74864789d8-tj4mc" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44") : secret "image-registry-tls" not found
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770890    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 08 22:51:16.771032 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:16.770988    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs podName:7a110710-8aa6-4aea-8613-3b044eca90b6 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:24.770978952 +0000 UTC m=+256.371810084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs") pod "router-default-854b9fc89c-b2fm6" (UID: "7a110710-8aa6-4aea-8613-3b044eca90b6") : secret "router-metrics-certs-default" not found
Jul 08 22:51:20.201821 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:20.201786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:51:20.202204 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.201896    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 08 22:51:20.202204 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.201946    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs podName:1f1a2e6f-05a7-4eaf-8d84-47700cd51905 nodeName:}" failed. No retries permitted until 2026-07-08 22:53:22.201932526 +0000 UTC m=+373.802763645 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs") pod "network-metrics-daemon-cc2dz" (UID: "1f1a2e6f-05a7-4eaf-8d84-47700cd51905") : secret "metrics-daemon-secret" not found
Jul 08 22:51:20.403729 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:20.403694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:20.403896 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:20.403755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:20.403896 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.403876    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 22:51:20.403969 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.403919    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:20.403969 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.403963    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:28.403940887 +0000 UTC m=+260.004772009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : configmap "kube-rbac-proxy" not found
Jul 08 22:51:20.404041 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:20.403984    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls podName:7f83dcff-0d3a-4051-a004-c6b1c66c4210 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:28.403970378 +0000 UTC m=+260.004801495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kzkvx" (UID: "7f83dcff-0d3a-4051-a004-c6b1c66c4210") : secret "insights-runtime-extractor-tls" not found
Jul 08 22:51:24.841617 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.841585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:24.842147 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.841633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:24.842147 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.841653    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:24.842147 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.841722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:24.842351 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.842325    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a110710-8aa6-4aea-8613-3b044eca90b6-service-ca-bundle\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:24.844179 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.844152    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-zq75v\" (UID: \"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:24.844522 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.844502    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a110710-8aa6-4aea-8613-3b044eca90b6-metrics-certs\") pod \"router-default-854b9fc89c-b2fm6\" (UID: \"7a110710-8aa6-4aea-8613-3b044eca90b6\") " pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:24.844563 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.844509    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"image-registry-74864789d8-tj4mc\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") " pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:24.948850 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.948828    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gjxn9\""
Jul 08 22:51:24.954335 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.954307    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r9rvj\""
Jul 08 22:51:24.956668 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.956640    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"
Jul 08 22:51:24.958692 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.958657    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cvqzh\""
Jul 08 22:51:24.962840 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.962820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:24.966731 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:24.966712    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:25.107240 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:25.107166    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v"]
Jul 08 22:51:25.319081 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:25.319045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v" event={"ID":"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0","Type":"ContainerStarted","Data":"673074db0ac5fc83866cdb6ba45f571385cf6e64e70b6481c2311ce64bea9736"}
Jul 08 22:51:25.335251 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:25.335138    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-854b9fc89c-b2fm6"]
Jul 08 22:51:25.337912 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:25.337835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:51:25.338166 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:25.338143    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a110710_8aa6_4aea_8613_3b044eca90b6.slice/crio-05ee7a298807f4d19f7adb775977e6111e548724f7e70a91b437b35ac5db8526 WatchSource:0}: Error finding container 05ee7a298807f4d19f7adb775977e6111e548724f7e70a91b437b35ac5db8526: Status 404 returned error can't find the container with id 05ee7a298807f4d19f7adb775977e6111e548724f7e70a91b437b35ac5db8526
Jul 08 22:51:25.342797 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:25.342726    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5567b590_2a66_4d6e_9ba5_f0571c658d44.slice/crio-28f55f6f195645f66c021316a5fc420437f783ef9aee9166d5b6129f02a8c106 WatchSource:0}: Error finding container 28f55f6f195645f66c021316a5fc420437f783ef9aee9166d5b6129f02a8c106: Status 404 returned error can't find the container with id 28f55f6f195645f66c021316a5fc420437f783ef9aee9166d5b6129f02a8c106
Jul 08 22:51:26.328451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.328391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" event={"ID":"5567b590-2a66-4d6e-9ba5-f0571c658d44","Type":"ContainerStarted","Data":"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"}
Jul 08 22:51:26.328952 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.328494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" event={"ID":"5567b590-2a66-4d6e-9ba5-f0571c658d44","Type":"ContainerStarted","Data":"28f55f6f195645f66c021316a5fc420437f783ef9aee9166d5b6129f02a8c106"}
Jul 08 22:51:26.328952 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.328521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:26.330224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.330194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-854b9fc89c-b2fm6" event={"ID":"7a110710-8aa6-4aea-8613-3b044eca90b6","Type":"ContainerStarted","Data":"ba611cf5ec8929f65061bbdb733c1c595241c48cbd3551d580f560a57bfac251"}
Jul 08 22:51:26.330374 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.330240    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-854b9fc89c-b2fm6" event={"ID":"7a110710-8aa6-4aea-8613-3b044eca90b6","Type":"ContainerStarted","Data":"05ee7a298807f4d19f7adb775977e6111e548724f7e70a91b437b35ac5db8526"}
Jul 08 22:51:26.347497 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.347449    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" podStartSLOduration=17.347431492 podStartE2EDuration="17.347431492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:26.346567211 +0000 UTC m=+257.947398351" watchObservedRunningTime="2026-07-08 22:51:26.347431492 +0000 UTC m=+257.948262633"
Jul 08 22:51:26.363038 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.362995    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-854b9fc89c-b2fm6" podStartSLOduration=17.362948693 podStartE2EDuration="17.362948693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:26.362086571 +0000 UTC m=+257.962917710" watchObservedRunningTime="2026-07-08 22:51:26.362948693 +0000 UTC m=+257.963779836"
Jul 08 22:51:26.963840 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.963805    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:26.966369 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:26.966350    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:27.335033 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:27.334946    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v" event={"ID":"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0","Type":"ContainerStarted","Data":"4ee1d0164eb772249aff22c531a7f3b69e1c79cbb9f9e5d1888ba7d90935e494"}
Jul 08 22:51:27.335033 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:27.335014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v" event={"ID":"ebe4ba3d-4878-41a7-a0a6-c7ddaf0632f0","Type":"ContainerStarted","Data":"26c6cae5074eab4168d8b708b642128a1abb40854bb8fd35e1362e61c9f10573"}
Jul 08 22:51:27.335520 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:27.335345    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:27.336533 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:27.336513    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-854b9fc89c-b2fm6"
Jul 08 22:51:27.350453 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:27.350414    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-zq75v" podStartSLOduration=16.474202549 podStartE2EDuration="18.350401521s" totalImagesPullingTime="1.876198972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:27.349584738 +0000 UTC m=+258.950415878" watchObservedRunningTime="2026-07-08 22:51:27.350401521 +0000 UTC m=+258.951232660"
Jul 08 22:51:28.474723 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.474672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:28.475178 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.474758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:28.475261 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.475242    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f83dcff-0d3a-4051-a004-c6b1c66c4210-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:28.476936 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.476913    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f83dcff-0d3a-4051-a004-c6b1c66c4210-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kzkvx\" (UID: \"7f83dcff-0d3a-4051-a004-c6b1c66c4210\") " pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:28.512595 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.512572    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kzkvx"
Jul 08 22:51:28.630466 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:28.630411    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kzkvx"]
Jul 08 22:51:28.632487 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:28.632464    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f83dcff_0d3a_4051_a004_c6b1c66c4210.slice/crio-e33a4bc2bdf165dc92ce23ad717bcf85a598f7cb9b2b656d731fc6ef987e119e WatchSource:0}: Error finding container e33a4bc2bdf165dc92ce23ad717bcf85a598f7cb9b2b656d731fc6ef987e119e: Status 404 returned error can't find the container with id e33a4bc2bdf165dc92ce23ad717bcf85a598f7cb9b2b656d731fc6ef987e119e
Jul 08 22:51:29.345873 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:29.345833    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kzkvx" event={"ID":"7f83dcff-0d3a-4051-a004-c6b1c66c4210","Type":"ContainerStarted","Data":"e33a4bc2bdf165dc92ce23ad717bcf85a598f7cb9b2b656d731fc6ef987e119e"}
Jul 08 22:51:32.356364 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:32.356324    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kzkvx" event={"ID":"7f83dcff-0d3a-4051-a004-c6b1c66c4210","Type":"ContainerStarted","Data":"fef188f68ea100caeff24cc333c4ea722dff078131d94f51e142ed18076f76fc"}
Jul 08 22:51:33.361451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:33.361411    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kzkvx" event={"ID":"7f83dcff-0d3a-4051-a004-c6b1c66c4210","Type":"ContainerStarted","Data":"652b46b4089553e6d2944bfb9dedc1cecd8b9329eeb919856f32319c7ed59fed"}
Jul 08 22:51:34.211887 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:34.211859    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:51:36.378773 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:36.378734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kzkvx" event={"ID":"7f83dcff-0d3a-4051-a004-c6b1c66c4210","Type":"ContainerStarted","Data":"cf992fcd13141a2bee40617e364658d631e06f4a6fe28a1e6036ca9b1ad61715"}
Jul 08 22:51:36.395251 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:36.395206    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kzkvx" podStartSLOduration=17.670056203 podStartE2EDuration="24.395193392s" totalImagesPullingTime="6.725137189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:51:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:36.394616032 +0000 UTC m=+267.995447185" watchObservedRunningTime="2026-07-08 22:51:36.395193392 +0000 UTC m=+267.996024531"
Jul 08 22:51:38.264174 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.264138    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"]
Jul 08 22:51:38.267728 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.267711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.270545 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.270522    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 08 22:51:38.270545 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.270539    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 08 22:51:38.270744 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.270558    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 22:51:38.270744 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.270576    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 22:51:38.271829 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.271810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qwhll\""
Jul 08 22:51:38.271941 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.271892    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 22:51:38.275309 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.275287    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"]
Jul 08 22:51:38.353732 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.353706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.353862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.353735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nwpc\" (UniqueName: \"kubernetes.io/projected/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-kube-api-access-9nwpc\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.353862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.353763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.353862 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.353819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.454927 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.454901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.455074 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.454931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nwpc\" (UniqueName: \"kubernetes.io/projected/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-kube-api-access-9nwpc\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.455074 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.454962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.455074 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.454986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.455674 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.455655    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.457348 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.457325    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.457466 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.457445    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.462053 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.462023    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nwpc\" (UniqueName: \"kubernetes.io/projected/eb290e75-c334-44b9-b2c8-2a4f0020d6d0-kube-api-access-9nwpc\") pod \"prometheus-operator-567f7b8b7c-sznbr\" (UID: \"eb290e75-c334-44b9-b2c8-2a4f0020d6d0\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.577124 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.577041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"
Jul 08 22:51:38.721235 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:38.721199    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr"]
Jul 08 22:51:38.724116 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:38.724090    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb290e75_c334_44b9_b2c8_2a4f0020d6d0.slice/crio-17b0ffb8cf6a95d863888d918fe96cae96fcb102b344935c3c5f5d2989a6cc59 WatchSource:0}: Error finding container 17b0ffb8cf6a95d863888d918fe96cae96fcb102b344935c3c5f5d2989a6cc59: Status 404 returned error can't find the container with id 17b0ffb8cf6a95d863888d918fe96cae96fcb102b344935c3c5f5d2989a6cc59
Jul 08 22:51:39.390136 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:39.390092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr" event={"ID":"eb290e75-c334-44b9-b2c8-2a4f0020d6d0","Type":"ContainerStarted","Data":"17b0ffb8cf6a95d863888d918fe96cae96fcb102b344935c3c5f5d2989a6cc59"}
Jul 08 22:51:40.395169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:40.395138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr" event={"ID":"eb290e75-c334-44b9-b2c8-2a4f0020d6d0","Type":"ContainerStarted","Data":"641f655ba31fe3c979d27ad99a53ac7e4f27f2111cb206844b8461df71ef3b9c"}
Jul 08 22:51:40.395499 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:40.395189    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr" event={"ID":"eb290e75-c334-44b9-b2c8-2a4f0020d6d0","Type":"ContainerStarted","Data":"60265b5fc194da8b0c4b97f258f72669bdede4d61412170ae5fb453b390bca78"}
Jul 08 22:51:40.411922 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:40.411869    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-sznbr" podStartSLOduration=1.157020105 podStartE2EDuration="2.411850134s" totalImagesPullingTime="1.254830029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:40.411374046 +0000 UTC m=+272.012205182" watchObservedRunningTime="2026-07-08 22:51:40.411850134 +0000 UTC m=+272.012681276"
Jul 08 22:51:42.609060 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.609030    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8qfs"]
Jul 08 22:51:42.612671 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.612650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.615472 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.615431    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 22:51:42.615472 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.615449    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zr2jk\""
Jul 08 22:51:42.615650 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.615474    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 22:51:42.615650 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.615449    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 22:51:42.685895 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.685857    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-sys\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686078 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.685916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686078 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-wtmp\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686078 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686057    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-metrics-client-ca\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqx9m\" (UniqueName: \"kubernetes.io/projected/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-kube-api-access-vqx9m\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686239 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-root\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.686428 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.686271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-textfile\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787298 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-metrics-client-ca\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787365    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqx9m\" (UniqueName: \"kubernetes.io/projected/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-kube-api-access-vqx9m\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-root\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-textfile\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:42.787521    2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-sys\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:42.787599    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls podName:1086bd0e-2ea7-4a5e-bf47-0e948e530adf nodeName:}" failed. No retries permitted until 2026-07-08 22:51:43.287578681 +0000 UTC m=+274.888409803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls") pod "node-exporter-s8qfs" (UID: "1086bd0e-2ea7-4a5e-bf47-0e948e530adf") : secret "node-exporter-tls" not found
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787718    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-root\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.787835 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-wtmp\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.788148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.787952    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-textfile\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.788148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.788009    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-metrics-client-ca\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.788148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.788022    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-sys\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.788148 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.788133    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-wtmp\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.788511 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.788489    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.790499 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.790479    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:42.798689 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:42.798654    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqx9m\" (UniqueName: \"kubernetes.io/projected/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-kube-api-access-vqx9m\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:43.292278 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.292246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:43.294443 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.294425    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1086bd0e-2ea7-4a5e-bf47-0e948e530adf-node-exporter-tls\") pod \"node-exporter-s8qfs\" (UID: \"1086bd0e-2ea7-4a5e-bf47-0e948e530adf\") " pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:43.523729 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.523700    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8qfs"
Jul 08 22:51:43.536316 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:43.536281    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1086bd0e_2ea7_4a5e_bf47_0e948e530adf.slice/crio-8d92cfc6c39143d95429e727b0fef0a7726ca4122df5aeb22f8e4bbdbf0a396f WatchSource:0}: Error finding container 8d92cfc6c39143d95429e727b0fef0a7726ca4122df5aeb22f8e4bbdbf0a396f: Status 404 returned error can't find the container with id 8d92cfc6c39143d95429e727b0fef0a7726ca4122df5aeb22f8e4bbdbf0a396f
Jul 08 22:51:43.651083 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.651049    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:51:43.656034 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.656012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.658663 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.658638    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 22:51:43.658785 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.658646    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 22:51:43.658785 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.658672    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4kr7\""
Jul 08 22:51:43.659102 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659040    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 22:51:43.659102 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659080    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 22:51:43.659245 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659103    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 22:51:43.659245 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659103    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 22:51:43.659245 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659138    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 22:51:43.659245 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659183    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 22:51:43.659245 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.659219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 22:51:43.666031 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.666013    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:51:43.696448 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696556 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696469    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696556 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zx2v\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696666 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.696845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.696841    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798200 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798200    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798218    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zx2v\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798477    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798506    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798606 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798936 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.798666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.798936 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:43.798870    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle podName:bd496ba3-8479-4a23-abc4-e5b343031681 nodeName:}" failed. No retries permitted until 2026-07-08 22:51:44.298849615 +0000 UTC m=+275.899680751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681") : configmap references non-existent config key: ca-bundle.crt
Jul 08 22:51:43.799093 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.799072    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.799762 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.799738    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.801984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.801717    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.801984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.801735    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.801984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.801781    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.801984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.801882    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.801984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.801935    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.802316 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.802035    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.802380 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.802315    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.802380 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.802348    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.803438 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.803420    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:43.806415 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:43.806391    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zx2v\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:44.219431 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.219379    2571 patch_prober.go:28] interesting pod/image-registry-74864789d8-tj4mc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 22:51:44.219612 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.219441    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 22:51:44.302738 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.302698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:44.303482 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.303459    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:44.412947 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.412857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8qfs" event={"ID":"1086bd0e-2ea7-4a5e-bf47-0e948e530adf","Type":"ContainerStarted","Data":"8d92cfc6c39143d95429e727b0fef0a7726ca4122df5aeb22f8e4bbdbf0a396f"}
Jul 08 22:51:44.566984 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.566902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:51:44.732480 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:44.732454    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:51:44.735370 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:44.735340    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd496ba3_8479_4a23_abc4_e5b343031681.slice/crio-6ada768d11532d916af4426ccd2c4272145fcb67fedabddcac92737fea2e8c86 WatchSource:0}: Error finding container 6ada768d11532d916af4426ccd2c4272145fcb67fedabddcac92737fea2e8c86: Status 404 returned error can't find the container with id 6ada768d11532d916af4426ccd2c4272145fcb67fedabddcac92737fea2e8c86
Jul 08 22:51:45.418986 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:45.418945    2571 generic.go:356] "Generic (PLEG): container finished" podID="1086bd0e-2ea7-4a5e-bf47-0e948e530adf" containerID="21b1124f6aee72f1660e24d40b2724d07c475c4b4c507952e10cca1c247900c7" exitCode=0
Jul 08 22:51:45.419173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:45.419038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8qfs" event={"ID":"1086bd0e-2ea7-4a5e-bf47-0e948e530adf","Type":"ContainerDied","Data":"21b1124f6aee72f1660e24d40b2724d07c475c4b4c507952e10cca1c247900c7"}
Jul 08 22:51:45.420757 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:45.420730    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"6ada768d11532d916af4426ccd2c4272145fcb67fedabddcac92737fea2e8c86"}
Jul 08 22:51:46.425538 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:46.425507    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8qfs" event={"ID":"1086bd0e-2ea7-4a5e-bf47-0e948e530adf","Type":"ContainerStarted","Data":"fa4db71a785c82d6fb5b34be42082282916bf39e2479d951a0b201b53fa53d44"}
Jul 08 22:51:46.426008 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:46.425561    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8qfs" event={"ID":"1086bd0e-2ea7-4a5e-bf47-0e948e530adf","Type":"ContainerStarted","Data":"045270ae7689100b20df41ff98ffc379719bdcdb167106c988acc62423850a51"}
Jul 08 22:51:46.427053 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:46.427029    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342" exitCode=0
Jul 08 22:51:46.427173 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:46.427080    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342"}
Jul 08 22:51:46.444975 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:46.444932    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8qfs" podStartSLOduration=3.292264952 podStartE2EDuration="4.444918258s" totalImagesPullingTime="1.086112782s" totalInitContainerRuntime="66.540524ms" isStatefulPod=true podCreationTimestamp="2026-07-08 22:51:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:46.442695103 +0000 UTC m=+278.043526241" watchObservedRunningTime="2026-07-08 22:51:46.444918258 +0000 UTC m=+278.045749398"
Jul 08 22:51:47.380345 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.380314    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"]
Jul 08 22:51:47.383728 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.383706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:47.386062 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.386034    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 08 22:51:47.386188 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.386151    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jnvx6\""
Jul 08 22:51:47.393701 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.393661    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"]
Jul 08 22:51:47.430435 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.430402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:47.430819 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.430472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2t9k\" (UniqueName: \"kubernetes.io/projected/0f149e34-7233-4fb1-9300-d4a58c4fe16c-kube-api-access-v2t9k\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:47.531670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.531639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:47.531849 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.531744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2t9k\" (UniqueName: \"kubernetes.io/projected/0f149e34-7233-4fb1-9300-d4a58c4fe16c-kube-api-access-v2t9k\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:47.531989 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:47.531968    2571 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 08 22:51:47.532074 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:47.532040    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert podName:0f149e34-7233-4fb1-9300-d4a58c4fe16c nodeName:}" failed. No retries permitted until 2026-07-08 22:51:48.03201922 +0000 UTC m=+279.632850344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-zvxr7" (UID: "0f149e34-7233-4fb1-9300-d4a58c4fe16c") : secret "monitoring-plugin-cert" not found
Jul 08 22:51:47.539779 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:47.539743    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2t9k\" (UniqueName: \"kubernetes.io/projected/0f149e34-7233-4fb1-9300-d4a58c4fe16c-kube-api-access-v2t9k\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:48.036478 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:48.036440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:48.039022 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:48.038997    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0f149e34-7233-4fb1-9300-d4a58c4fe16c-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-zvxr7\" (UID: \"0f149e34-7233-4fb1-9300-d4a58c4fe16c\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:48.296926 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:48.296848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:48.446109 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:48.446086    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"]
Jul 08 22:51:48.448451 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:48.448430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"}
Jul 08 22:51:48.452668 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:48.452638    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f149e34_7233_4fb1_9300_d4a58c4fe16c.slice/crio-d1566c33e9e53371b8a64ae51b39df033de2449b0d80a0fdafc6ba37a126aac7 WatchSource:0}: Error finding container d1566c33e9e53371b8a64ae51b39df033de2449b0d80a0fdafc6ba37a126aac7: Status 404 returned error can't find the container with id d1566c33e9e53371b8a64ae51b39df033de2449b0d80a0fdafc6ba37a126aac7
Jul 08 22:51:49.456611 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:49.456575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"}
Jul 08 22:51:49.457096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:49.456661    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"}
Jul 08 22:51:49.457096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:49.456720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"}
Jul 08 22:51:49.457096 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:49.456752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"}
Jul 08 22:51:49.463181 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:49.463156    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7" event={"ID":"0f149e34-7233-4fb1-9300-d4a58c4fe16c","Type":"ContainerStarted","Data":"d1566c33e9e53371b8a64ae51b39df033de2449b0d80a0fdafc6ba37a126aac7"}
Jul 08 22:51:50.464274 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.464239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerStarted","Data":"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"}
Jul 08 22:51:50.465617 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.465593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7" event={"ID":"0f149e34-7233-4fb1-9300-d4a58c4fe16c","Type":"ContainerStarted","Data":"5ab5f4653053c8dd17bf538f699a8005ebfed61d58c74a7da958dfbcb32ca50c"}
Jul 08 22:51:50.465738 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.465712    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:50.470197 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.470181    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7"
Jul 08 22:51:50.489486 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.489439    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.402387231 podStartE2EDuration="7.489421158s" totalImagesPullingTime="4.072750238s" totalInitContainerRuntime="14.283689ms" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:50.488073397 +0000 UTC m=+282.088904537" watchObservedRunningTime="2026-07-08 22:51:50.489421158 +0000 UTC m=+282.090252299"
Jul 08 22:51:50.504742 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:50.504700    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-zvxr7" podStartSLOduration=1.895383051 podStartE2EDuration="3.504667337s" totalImagesPullingTime="1.609284286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:50.50362548 +0000 UTC m=+282.104456620" watchObservedRunningTime="2026-07-08 22:51:50.504667337 +0000 UTC m=+282.105498477"
Jul 08 22:51:51.057256 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:51.057215    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ljw77" podUID="d17c6cad-9880-43e9-aca9-7a8dbc012823"
Jul 08 22:51:51.468618 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:51.468586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:51:54.216602 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.216572    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:54.695774 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.695744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:51:54.698025 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.698002    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d17c6cad-9880-43e9-aca9-7a8dbc012823-metrics-tls\") pod \"dns-default-ljw77\" (UID: \"d17c6cad-9880-43e9-aca9-7a8dbc012823\") " pod="openshift-dns/dns-default-ljw77"
Jul 08 22:51:54.771973 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.771953    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fbpb9\""
Jul 08 22:51:54.780306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.780289    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:51:54.905291 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:54.905266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ljw77"]
Jul 08 22:51:54.907426 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:51:54.907397    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17c6cad_9880_43e9_aca9_7a8dbc012823.slice/crio-668150f76af9ce19c12ff668ebcf402b64fd0f90feefe2ba7465eb0c96a6b754 WatchSource:0}: Error finding container 668150f76af9ce19c12ff668ebcf402b64fd0f90feefe2ba7465eb0c96a6b754: Status 404 returned error can't find the container with id 668150f76af9ce19c12ff668ebcf402b64fd0f90feefe2ba7465eb0c96a6b754
Jul 08 22:51:55.483388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:55.483338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljw77" event={"ID":"d17c6cad-9880-43e9-aca9-7a8dbc012823","Type":"ContainerStarted","Data":"668150f76af9ce19c12ff668ebcf402b64fd0f90feefe2ba7465eb0c96a6b754"}
Jul 08 22:51:57.492333 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:57.492302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljw77" event={"ID":"d17c6cad-9880-43e9-aca9-7a8dbc012823","Type":"ContainerStarted","Data":"49bdbe586d5c230353e8846ed3d37435939c7ecd322638deeaefa7bae5bcfc88"}
Jul 08 22:51:57.492742 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:57.492352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ljw77" event={"ID":"d17c6cad-9880-43e9-aca9-7a8dbc012823","Type":"ContainerStarted","Data":"c89c795c68aea2a4c911a22bf66548180d23393ae33d798fe5957141c3fd364d"}
Jul 08 22:51:57.492742 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:57.492390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:51:57.514097 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:57.514052    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ljw77" podStartSLOduration=251.991397787 podStartE2EDuration="4m13.514040277s" totalImagesPullingTime="1.52264249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:51:57.513039434 +0000 UTC m=+289.113870574" watchObservedRunningTime="2026-07-08 22:51:57.514040277 +0000 UTC m=+289.114871450"
Jul 08 22:51:59.239812 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.239774    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerName="registry" containerID="cri-o://71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac" gracePeriod=30
Jul 08 22:51:59.492329 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.492278    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:59.501166 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.501138    2571 generic.go:356] "Generic (PLEG): container finished" podID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerID="71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac" exitCode=0
Jul 08 22:51:59.501264 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.501170    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74864789d8-tj4mc"
Jul 08 22:51:59.501264 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.501226    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" event={"ID":"5567b590-2a66-4d6e-9ba5-f0571c658d44","Type":"ContainerDied","Data":"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"}
Jul 08 22:51:59.501343 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.501275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74864789d8-tj4mc" event={"ID":"5567b590-2a66-4d6e-9ba5-f0571c658d44","Type":"ContainerDied","Data":"28f55f6f195645f66c021316a5fc420437f783ef9aee9166d5b6129f02a8c106"}
Jul 08 22:51:59.501343 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.501297    2571 scope.go:117] "RemoveContainer" containerID="71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"
Jul 08 22:51:59.511999 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.511982    2571 scope.go:117] "RemoveContainer" containerID="71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"
Jul 08 22:51:59.512580 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:51:59.512552    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac\": container with ID starting with 71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac not found: ID does not exist" containerID="71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"
Jul 08 22:51:59.512714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.512589    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac"} err="failed to get container status \"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac\": rpc error: code = NotFound desc = could not find container \"71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac\": container with ID starting with 71a854720a1350166f058f1748ec59920741f9fd92c54864ac84376eb000f4ac not found: ID does not exist"
Jul 08 22:51:59.635991 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.635958    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636004    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636054    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636070    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqk7b\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636100    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636549 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636653 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636572    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.636653 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.636639    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") pod \"5567b590-2a66-4d6e-9ba5-f0571c658d44\" (UID: \"5567b590-2a66-4d6e-9ba5-f0571c658d44\") "
Jul 08 22:51:59.637129 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.637096    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:51:59.637269 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.637221    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:51:59.638612 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.638586    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b" (OuterVolumeSpecName: "kube-api-access-jqk7b") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "kube-api-access-jqk7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:51:59.638797 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.638732    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:51:59.638797 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.638745    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:51:59.638797 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.638744    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:51:59.639156 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.639127    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:51:59.645196 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.645174    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5567b590-2a66-4d6e-9ba5-f0571c658d44" (UID: "5567b590-2a66-4d6e-9ba5-f0571c658d44"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:51:59.737903 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737880    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-installation-pull-secrets\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.737903 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737899    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqk7b\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-kube-api-access-jqk7b\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737910    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-bound-sa-token\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737918    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-trusted-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737926    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-certificates\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737934    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5567b590-2a66-4d6e-9ba5-f0571c658d44-registry-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737942    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5567b590-2a66-4d6e-9ba5-f0571c658d44-ca-trust-extracted\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.738016 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.737951    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5567b590-2a66-4d6e-9ba5-f0571c658d44-image-registry-private-configuration\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:51:59.823459 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.823430    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:51:59.828968 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:51:59.828946    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74864789d8-tj4mc"]
Jul 08 22:52:01.462791 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:01.462758    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" path="/var/lib/kubelet/pods/5567b590-2a66-4d6e-9ba5-f0571c658d44/volumes"
Jul 08 22:52:06.459847 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:52:06.459802    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cc2dz" podUID="1f1a2e6f-05a7-4eaf-8d84-47700cd51905"
Jul 08 22:52:07.497826 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:07.497794    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ljw77"
Jul 08 22:52:09.285208 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:09.285186    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:52:09.285761 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:09.285741    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:52:09.296780 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:09.296760    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 22:52:17.458295 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:17.458257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:52:43.654667 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:43.654628    2571 generic.go:356] "Generic (PLEG): container finished" podID="db67385b-d847-4c76-9c5e-67c9376eb2a4" containerID="01fbe57d63f4f58c39f60a80f180f5352a2fb97f39e989b7d7c6adadf041db58" exitCode=0
Jul 08 22:52:43.655117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:43.654699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb" event={"ID":"db67385b-d847-4c76-9c5e-67c9376eb2a4","Type":"ContainerDied","Data":"01fbe57d63f4f58c39f60a80f180f5352a2fb97f39e989b7d7c6adadf041db58"}
Jul 08 22:52:43.655117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:43.655005    2571 scope.go:117] "RemoveContainer" containerID="01fbe57d63f4f58c39f60a80f180f5352a2fb97f39e989b7d7c6adadf041db58"
Jul 08 22:52:44.660223 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:44.660189    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9z8jb" event={"ID":"db67385b-d847-4c76-9c5e-67c9376eb2a4","Type":"ContainerStarted","Data":"c1db395038b757387196ebcda7331d77e3a6197c7b18982bceabd510114919b1"}
Jul 08 22:52:47.675722 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:47.675693    2571 generic.go:356] "Generic (PLEG): container finished" podID="bff360ba-e55a-46d0-9b15-c7472b5f06da" containerID="4e4d1dd5e1dd2a6d7abab4c52f2d5e63652e70cc91311f9ba6e6a9ffb37f07ab" exitCode=0
Jul 08 22:52:47.676087 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:47.675766    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j" event={"ID":"bff360ba-e55a-46d0-9b15-c7472b5f06da","Type":"ContainerDied","Data":"4e4d1dd5e1dd2a6d7abab4c52f2d5e63652e70cc91311f9ba6e6a9ffb37f07ab"}
Jul 08 22:52:47.676127 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:47.676089    2571 scope.go:117] "RemoveContainer" containerID="4e4d1dd5e1dd2a6d7abab4c52f2d5e63652e70cc91311f9ba6e6a9ffb37f07ab"
Jul 08 22:52:48.681169 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:52:48.681134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-8zn2j" event={"ID":"bff360ba-e55a-46d0-9b15-c7472b5f06da","Type":"ContainerStarted","Data":"423bccca09a27544944b3fded05e774eef6c4ecab8d2100ea3cdfe7555c4cbb6"}
Jul 08 22:53:02.955860 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.955786    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:02.956224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956065    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="alertmanager" containerID="cri-o://37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5" gracePeriod=120
Jul 08 22:53:02.956224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956133    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-metric" containerID="cri-o://d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c" gracePeriod=120
Jul 08 22:53:02.956224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956131    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-web" containerID="cri-o://b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5" gracePeriod=120
Jul 08 22:53:02.956224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956152    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="config-reloader" containerID="cri-o://791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521" gracePeriod=120
Jul 08 22:53:02.956224 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956222    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="prom-label-proxy" containerID="cri-o://5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e" gracePeriod=120
Jul 08 22:53:02.956474 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:02.956210    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy" containerID="cri-o://a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048" gracePeriod=120
Jul 08 22:53:03.736891 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736860    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e" exitCode=0
Jul 08 22:53:03.736891 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736886    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048" exitCode=0
Jul 08 22:53:03.736891 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736894    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5" exitCode=0
Jul 08 22:53:03.736891 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736900    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521" exitCode=0
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736906    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5" exitCode=0
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.736937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"}
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.737001    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"}
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.737026    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"}
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.737050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"}
Jul 08 22:53:03.737162 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:03.737075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"}
Jul 08 22:53:04.187817 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.187795    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.329693 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329589    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329693 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329693 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329660    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329943 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329707    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329943 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329730    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329943 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329749    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zx2v\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.329943 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329774    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330156 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.329995    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:04.330156 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330056    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330156 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330125    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330305 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330156    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330305 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330184    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330305 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330210    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330305 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330257    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config\") pod \"bd496ba3-8479-4a23-abc4-e5b343031681\" (UID: \"bd496ba3-8479-4a23-abc4-e5b343031681\") "
Jul 08 22:53:04.330496 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330451    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:53:04.330551 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330532    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-metrics-client-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.330601 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.330552    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-main-db\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.332609 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332397    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:53:04.332609 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332420    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.332609 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332420    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v" (OuterVolumeSpecName: "kube-api-access-9zx2v") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "kube-api-access-9zx2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:53:04.332609 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332523    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume" (OuterVolumeSpecName: "config-volume") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.332957 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332859    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 22:53:04.332957 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.332869    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out" (OuterVolumeSpecName: "config-out") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:53:04.333397 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.333368    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.333481 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.333454    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.334454 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.334432    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.337307 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.337282    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.342555 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.342536    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config" (OuterVolumeSpecName: "web-config") pod "bd496ba3-8479-4a23-abc4-e5b343031681" (UID: "bd496ba3-8479-4a23-abc4-e5b343031681"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 22:53:04.431122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431073    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431114    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-cluster-tls-config\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431126    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431122 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431135    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-main-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431144    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd496ba3-8479-4a23-abc4-e5b343031681-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431154    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-web-config\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431162    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bd496ba3-8479-4a23-abc4-e5b343031681-config-out\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431179    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-tls-assets\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431187    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-config-volume\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431196    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bd496ba3-8479-4a23-abc4-e5b343031681-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.431373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.431205    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zx2v\" (UniqueName: \"kubernetes.io/projected/bd496ba3-8479-4a23-abc4-e5b343031681-kube-api-access-9zx2v\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:53:04.744002 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.743970    2571 generic.go:356] "Generic (PLEG): container finished" podID="bd496ba3-8479-4a23-abc4-e5b343031681" containerID="d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c" exitCode=0
Jul 08 22:53:04.744201 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.744056    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.744201 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.744060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"}
Jul 08 22:53:04.744201 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.744134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bd496ba3-8479-4a23-abc4-e5b343031681","Type":"ContainerDied","Data":"6ada768d11532d916af4426ccd2c4272145fcb67fedabddcac92737fea2e8c86"}
Jul 08 22:53:04.744201 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.744169    2571 scope.go:117] "RemoveContainer" containerID="5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"
Jul 08 22:53:04.752872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.752855    2571 scope.go:117] "RemoveContainer" containerID="d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"
Jul 08 22:53:04.759712 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.759672    2571 scope.go:117] "RemoveContainer" containerID="a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"
Jul 08 22:53:04.766383 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.766365    2571 scope.go:117] "RemoveContainer" containerID="b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"
Jul 08 22:53:04.767582 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.767563    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:04.773234 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.773218    2571 scope.go:117] "RemoveContainer" containerID="791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"
Jul 08 22:53:04.773614 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.773595    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:04.780102 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.780079    2571 scope.go:117] "RemoveContainer" containerID="37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"
Jul 08 22:53:04.791562 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.791541    2571 scope.go:117] "RemoveContainer" containerID="1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342"
Jul 08 22:53:04.798538 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798517    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:04.798621 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798532    2571 scope.go:117] "RemoveContainer" containerID="5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"
Jul 08 22:53:04.798820 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798803    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerName="registry"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798824    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerName="registry"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798832    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="alertmanager"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798838    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="alertmanager"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798844    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="init-config-reloader"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798850    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="init-config-reloader"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798858    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798863    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy"
Jul 08 22:53:04.798872 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798869    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-web"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798880    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-web"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798887    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-metric"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798892    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-metric"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798902    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="config-reloader"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798907    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="config-reloader"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="prom-label-proxy"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798918    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="prom-label-proxy"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.798864    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e\": container with ID starting with 5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e not found: ID does not exist" containerID="5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798958    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-web"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798967    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="alertmanager"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798972    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="config-reloader"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798977    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5567b590-2a66-4d6e-9ba5-f0571c658d44" containerName="registry"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798981    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="prom-label-proxy"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798973    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e"} err="failed to get container status \"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e\": rpc error: code = NotFound desc = could not find container \"5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e\": container with ID starting with 5f18f1b646a494d16931ebb6644eb0134114e7edf9c2492de332de9f6ddca69e not found: ID does not exist"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798995    2571 scope.go:117] "RemoveContainer" containerID="d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.798987    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy"
Jul 08 22:53:04.799171 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799045    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" containerName="kube-rbac-proxy-metric"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.799208    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c\": container with ID starting with d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c not found: ID does not exist" containerID="d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799236    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c"} err="failed to get container status \"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c\": rpc error: code = NotFound desc = could not find container \"d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c\": container with ID starting with d0d1ec9c67d62eefde3e2d6f7b4ba24cfdc8bb6ef36a2a00dfb29797cb4ebc7c not found: ID does not exist"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799257    2571 scope.go:117] "RemoveContainer" containerID="a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.799507    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048\": container with ID starting with a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048 not found: ID does not exist" containerID="a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799539    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048"} err="failed to get container status \"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048\": rpc error: code = NotFound desc = could not find container \"a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048\": container with ID starting with a28ad2ee7fae189a1dd0089e7ace3f04e7a50e32ea2cfb5f0424650b2239b048 not found: ID does not exist"
Jul 08 22:53:04.799836 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799563    2571 scope.go:117] "RemoveContainer" containerID="b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"
Jul 08 22:53:04.800079 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.799872    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5\": container with ID starting with b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5 not found: ID does not exist" containerID="b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"
Jul 08 22:53:04.800079 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799891    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5"} err="failed to get container status \"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5\": rpc error: code = NotFound desc = could not find container \"b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5\": container with ID starting with b77497b446bc5d468124ed8c8d6178427b8ddd58f2aa5871006b314f8657f6e5 not found: ID does not exist"
Jul 08 22:53:04.800079 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.799904    2571 scope.go:117] "RemoveContainer" containerID="791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"
Jul 08 22:53:04.800213 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.800164    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521\": container with ID starting with 791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521 not found: ID does not exist" containerID="791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"
Jul 08 22:53:04.800213 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.800186    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521"} err="failed to get container status \"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521\": rpc error: code = NotFound desc = could not find container \"791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521\": container with ID starting with 791c6003232bb9e9bf1e07dde77d096b16810740aa766c5e05506cb3781e3521 not found: ID does not exist"
Jul 08 22:53:04.800213 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.800199    2571 scope.go:117] "RemoveContainer" containerID="37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"
Jul 08 22:53:04.800466 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.800445    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5\": container with ID starting with 37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5 not found: ID does not exist" containerID="37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"
Jul 08 22:53:04.800520 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.800471    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5"} err="failed to get container status \"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5\": rpc error: code = NotFound desc = could not find container \"37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5\": container with ID starting with 37076de453f46d6b58546bf9a6cfc6c4f1d33c97cf4affb4ecd4aa5cd653cbc5 not found: ID does not exist"
Jul 08 22:53:04.800520 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.800486    2571 scope.go:117] "RemoveContainer" containerID="1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342"
Jul 08 22:53:04.800804 ip-10-0-128-122 kubenswrapper[2571]: E0708 22:53:04.800786    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342\": container with ID starting with 1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342 not found: ID does not exist" containerID="1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342"
Jul 08 22:53:04.800857 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.800808    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342"} err="failed to get container status \"1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342\": rpc error: code = NotFound desc = could not find container \"1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342\": container with ID starting with 1bbd385a96a73e0f1e98aba54fddfd4127534f8f8a867744e2850874a1425342 not found: ID does not exist"
Jul 08 22:53:04.804963 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.804945    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.807578 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.807560    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 22:53:04.807695 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.807663    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4kr7\""
Jul 08 22:53:04.807764 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.807662    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 22:53:04.807927 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.807912    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 22:53:04.807997 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.807966    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 22:53:04.808158 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.808145    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 22:53:04.808476 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.808462    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 22:53:04.808650 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.808636    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 22:53:04.808758 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.808659    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 22:53:04.813166 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.813148    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 22:53:04.815299 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.815278    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:04.935992 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.935963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-web-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.935992 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.935991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkhk5\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-kube-api-access-qkhk5\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936177    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936494 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936219    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936494 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936254    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936494 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:04.936494 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:04.936336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-config-out\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037159 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkhk5\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-kube-api-access-qkhk5\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037286 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037286 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037286 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037436 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037436 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037436 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-config-out\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-web-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.037647 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.037646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.038196 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.038030    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.038549 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.038524    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.038695 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.038651    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f866fb9-2de9-43aa-928b-337407137e4e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.040145 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.040119    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.040642 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.040301    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.040642 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.040598    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.040989 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.040962    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.041205 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.041181    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-web-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.041285 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.041228    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.041338 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.041321    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.041381 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.041334    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f866fb9-2de9-43aa-928b-337407137e4e-config-out\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.042011 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.041994    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4f866fb9-2de9-43aa-928b-337407137e4e-config-volume\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.044714 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.044695    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkhk5\" (UniqueName: \"kubernetes.io/projected/4f866fb9-2de9-43aa-928b-337407137e4e-kube-api-access-qkhk5\") pod \"alertmanager-main-0\" (UID: \"4f866fb9-2de9-43aa-928b-337407137e4e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.114725 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.114702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 22:53:05.248901 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.248870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 22:53:05.251974 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:53:05.251946    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f866fb9_2de9_43aa_928b_337407137e4e.slice/crio-307587bd4b8cab0fad949aed9658ac2e898f90efcc8905fbc570fe228fcc6f5a WatchSource:0}: Error finding container 307587bd4b8cab0fad949aed9658ac2e898f90efcc8905fbc570fe228fcc6f5a: Status 404 returned error can't find the container with id 307587bd4b8cab0fad949aed9658ac2e898f90efcc8905fbc570fe228fcc6f5a
Jul 08 22:53:05.462502 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.462472    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd496ba3-8479-4a23-abc4-e5b343031681" path="/var/lib/kubelet/pods/bd496ba3-8479-4a23-abc4-e5b343031681/volumes"
Jul 08 22:53:05.750315 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.750284    2571 generic.go:356] "Generic (PLEG): container finished" podID="4f866fb9-2de9-43aa-928b-337407137e4e" containerID="d54d43c24a696a07de4e54d9afe957afb00871c429c6b78dbd572507566c0032" exitCode=0
Jul 08 22:53:05.750477 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.750356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerDied","Data":"d54d43c24a696a07de4e54d9afe957afb00871c429c6b78dbd572507566c0032"}
Jul 08 22:53:05.750477 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:05.750431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"307587bd4b8cab0fad949aed9658ac2e898f90efcc8905fbc570fe228fcc6f5a"}
Jul 08 22:53:06.757260 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"f7aa6b1bca1a7015524d0606795a03bdf4c55c18f20fb02c822de39c22bdfb0a"}
Jul 08 22:53:06.757625 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"29ff80ee099dfda958fa49fb170cbeafec38c037a30fe5d28181168cc9d9b12f"}
Jul 08 22:53:06.757625 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"e8e64f04d8be00a583befdde1630d3834f4bca71806855d0790a3a1ebcf0e1b5"}
Jul 08 22:53:06.757625 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757385    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"1a6dbb946c75b5b0752730d81879bd998b85e354190cd58b4526afb8af27c99b"}
Jul 08 22:53:06.757625 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757420    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"75baa49c7e62503d36cd244af12a3966b367eb1ef16460540d552f9a827d2f07"}
Jul 08 22:53:06.757625 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.757456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4f866fb9-2de9-43aa-928b-337407137e4e","Type":"ContainerStarted","Data":"6ad59fde2de8bf50981f5615aa1f2f66f40c9020dd980b0ca6f400ef65284555"}
Jul 08 22:53:06.782368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:06.782325    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.767633148 podStartE2EDuration="2.782310227s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.677079ms" isStatefulPod=false podCreationTimestamp="2026-07-08 22:53:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:53:06.779905188 +0000 UTC m=+358.380736342" watchObservedRunningTime="2026-07-08 22:53:06.782310227 +0000 UTC m=+358.383141366"
Jul 08 22:53:22.266480 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.266440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:53:22.268660 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.268639    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f1a2e6f-05a7-4eaf-8d84-47700cd51905-metrics-certs\") pod \"network-metrics-daemon-cc2dz\" (UID: \"1f1a2e6f-05a7-4eaf-8d84-47700cd51905\") " pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:53:22.562361 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.562291    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-48cc2\""
Jul 08 22:53:22.569544 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.569520    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cc2dz"
Jul 08 22:53:22.691535 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.691507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cc2dz"]
Jul 08 22:53:22.694424 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:53:22.694399    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1a2e6f_05a7_4eaf_8d84_47700cd51905.slice/crio-00128916c50ab793e529addbb07d568b3d5a76793cb2edabba5ebe012881659c WatchSource:0}: Error finding container 00128916c50ab793e529addbb07d568b3d5a76793cb2edabba5ebe012881659c: Status 404 returned error can't find the container with id 00128916c50ab793e529addbb07d568b3d5a76793cb2edabba5ebe012881659c
Jul 08 22:53:22.696453 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.696434    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:53:22.813541 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:22.813457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cc2dz" event={"ID":"1f1a2e6f-05a7-4eaf-8d84-47700cd51905","Type":"ContainerStarted","Data":"00128916c50ab793e529addbb07d568b3d5a76793cb2edabba5ebe012881659c"}
Jul 08 22:53:23.818760 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:23.818725    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cc2dz" event={"ID":"1f1a2e6f-05a7-4eaf-8d84-47700cd51905","Type":"ContainerStarted","Data":"cddb10395697c15c46180e69142863a61f060cb691a0fd1d8eda4d82001fff61"}
Jul 08 22:53:23.819090 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:23.818794    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cc2dz" event={"ID":"1f1a2e6f-05a7-4eaf-8d84-47700cd51905","Type":"ContainerStarted","Data":"00885d16d3c58f4698faee1b23bdfae9a08e0bd67d158c95df7a9186e4968326"}
Jul 08 22:53:23.834315 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:23.834269    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cc2dz" podStartSLOduration=373.936050527 podStartE2EDuration="6m14.834256906s" totalImagesPullingTime="898.206379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:53:23.832924552 +0000 UTC m=+375.433755670" watchObservedRunningTime="2026-07-08 22:53:23.834256906 +0000 UTC m=+375.435088045"
Jul 08 22:53:43.731654 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.731620    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"]
Jul 08 22:53:43.740306 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.740283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.743368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.743274    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 22:53:43.743368 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.743296    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9sqd6\""
Jul 08 22:53:43.743546 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.743370    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 22:53:43.743597 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.743547    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"]
Jul 08 22:53:43.817656 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.817624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.817817 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.817665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.817817 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.817741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xnj\" (UniqueName: \"kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.918411 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.918384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.918597 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.918429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.918597 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.918481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xnj\" (UniqueName: \"kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.918810 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.918792    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.918875 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.918813    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:43.927006 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:43.926984    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xnj\" (UniqueName: \"kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:44.050817 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:44.050749    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:53:44.170845 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:44.170820    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"]
Jul 08 22:53:44.174160 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:53:44.174129    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a408385_b943_4eb5_b7e0_d107cc4dee59.slice/crio-abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17 WatchSource:0}: Error finding container abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17: Status 404 returned error can't find the container with id abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17
Jul 08 22:53:44.894261 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:44.894228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv" event={"ID":"4a408385-b943-4eb5-b7e0-d107cc4dee59","Type":"ContainerStarted","Data":"abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17"}
Jul 08 22:53:51.921634 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:51.921601    2571 generic.go:356] "Generic (PLEG): container finished" podID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerID="d3099aaaa6de108b03623567ea62158e5d8717b75b8a3294566e8190fe03d6c1" exitCode=0
Jul 08 22:53:51.921956 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:51.921692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv" event={"ID":"4a408385-b943-4eb5-b7e0-d107cc4dee59","Type":"ContainerDied","Data":"d3099aaaa6de108b03623567ea62158e5d8717b75b8a3294566e8190fe03d6c1"}
Jul 08 22:53:54.934893 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:54.934861    2571 generic.go:356] "Generic (PLEG): container finished" podID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerID="45aa5955676de673068d9d7943c2af213436c920dbd9f65614c80f16afeb6f1b" exitCode=0
Jul 08 22:53:54.935302 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:53:54.934960    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv" event={"ID":"4a408385-b943-4eb5-b7e0-d107cc4dee59","Type":"ContainerDied","Data":"45aa5955676de673068d9d7943c2af213436c920dbd9f65614c80f16afeb6f1b"}
Jul 08 22:54:01.974801 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:01.974765    2571 generic.go:356] "Generic (PLEG): container finished" podID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerID="5581ba1907fdb11cbc7914bdbd93f0c097e11fccaf79747bd46f7bdf02190a33" exitCode=0
Jul 08 22:54:01.975179 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:01.974815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv" event={"ID":"4a408385-b943-4eb5-b7e0-d107cc4dee59","Type":"ContainerDied","Data":"5581ba1907fdb11cbc7914bdbd93f0c097e11fccaf79747bd46f7bdf02190a33"}
Jul 08 22:54:03.100455 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.100434    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:54:03.162712 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.162668    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util\") pod \"4a408385-b943-4eb5-b7e0-d107cc4dee59\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") "
Jul 08 22:54:03.162902 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.162733    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8xnj\" (UniqueName: \"kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj\") pod \"4a408385-b943-4eb5-b7e0-d107cc4dee59\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") "
Jul 08 22:54:03.162902 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.162773    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle\") pod \"4a408385-b943-4eb5-b7e0-d107cc4dee59\" (UID: \"4a408385-b943-4eb5-b7e0-d107cc4dee59\") "
Jul 08 22:54:03.163564 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.163538    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle" (OuterVolumeSpecName: "bundle") pod "4a408385-b943-4eb5-b7e0-d107cc4dee59" (UID: "4a408385-b943-4eb5-b7e0-d107cc4dee59"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:03.164886 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.164851    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj" (OuterVolumeSpecName: "kube-api-access-l8xnj") pod "4a408385-b943-4eb5-b7e0-d107cc4dee59" (UID: "4a408385-b943-4eb5-b7e0-d107cc4dee59"). InnerVolumeSpecName "kube-api-access-l8xnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 22:54:03.166985 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.166961    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util" (OuterVolumeSpecName: "util") pod "4a408385-b943-4eb5-b7e0-d107cc4dee59" (UID: "4a408385-b943-4eb5-b7e0-d107cc4dee59"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 22:54:03.264160 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.264065    2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-bundle\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:54:03.264160 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.264099    2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a408385-b943-4eb5-b7e0-d107cc4dee59-util\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:54:03.264160 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.264113    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8xnj\" (UniqueName: \"kubernetes.io/projected/4a408385-b943-4eb5-b7e0-d107cc4dee59-kube-api-access-l8xnj\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 22:54:03.983773 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.983735    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv" event={"ID":"4a408385-b943-4eb5-b7e0-d107cc4dee59","Type":"ContainerDied","Data":"abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17"}
Jul 08 22:54:03.983910 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.983789    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="abbfc745e4fd430516a61c381331ac79078cce4b28764113be765168a51aea17"
Jul 08 22:54:03.983910 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:03.983751    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wmmlv"
Jul 08 22:54:11.641937 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.641903    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"]
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642169    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="util"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642179    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="util"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642198    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="pull"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642203    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="pull"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642211    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="extract"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642216    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="extract"
Jul 08 22:54:11.642287 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.642260    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a408385-b943-4eb5-b7e0-d107cc4dee59" containerName="extract"
Jul 08 22:54:11.645395 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.645377    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.648117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.648095    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:54:11.648117 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.648108    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 08 22:54:11.648268 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.648153    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dtmwq\""
Jul 08 22:54:11.657801 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.657778    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"]
Jul 08 22:54:11.730386 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.730356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.730602 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.730398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whjqk\" (UniqueName: \"kubernetes.io/projected/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-kube-api-access-whjqk\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.831006 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.830955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.831167 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.831029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whjqk\" (UniqueName: \"kubernetes.io/projected/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-kube-api-access-whjqk\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.831426 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.831406    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.840998 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.840969    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whjqk\" (UniqueName: \"kubernetes.io/projected/affdfbbc-b53d-4f1e-b79f-e7c10dec1651-kube-api-access-whjqk\") pod \"cert-manager-operator-controller-manager-55c444bf86-xzbcd\" (UID: \"affdfbbc-b53d-4f1e-b79f-e7c10dec1651\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:11.954689 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:11.954599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"
Jul 08 22:54:12.081436 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:12.081411    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd"]
Jul 08 22:54:12.083555 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:54:12.083524    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaffdfbbc_b53d_4f1e_b79f_e7c10dec1651.slice/crio-bbb4aa02a57883f9297afe97239c3dfc8b240ecb1f275b93edb0e5faf872fddd WatchSource:0}: Error finding container bbb4aa02a57883f9297afe97239c3dfc8b240ecb1f275b93edb0e5faf872fddd: Status 404 returned error can't find the container with id bbb4aa02a57883f9297afe97239c3dfc8b240ecb1f275b93edb0e5faf872fddd
Jul 08 22:54:13.018879 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:13.018836    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd" event={"ID":"affdfbbc-b53d-4f1e-b79f-e7c10dec1651","Type":"ContainerStarted","Data":"bbb4aa02a57883f9297afe97239c3dfc8b240ecb1f275b93edb0e5faf872fddd"}
Jul 08 22:54:14.025180 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:14.025138    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd" event={"ID":"affdfbbc-b53d-4f1e-b79f-e7c10dec1651","Type":"ContainerStarted","Data":"42ae5ce682dab66ec8d2ca18dc45045865c672fe6ea04b116213494e78cf1531"}
Jul 08 22:54:14.048944 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:14.048896    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-xzbcd" podStartSLOduration=1.636135576 podStartE2EDuration="3.048881349s" totalImagesPullingTime="1.412745773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:54:14.047037655 +0000 UTC m=+425.647868805" watchObservedRunningTime="2026-07-08 22:54:14.048881349 +0000 UTC m=+425.649712467"
Jul 08 22:54:18.175824 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.175788    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"]
Jul 08 22:54:18.178326 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.178311    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.181031 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.181006    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9kqjn\""
Jul 08 22:54:18.182195 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.182180    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 22:54:18.182251 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.182238    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 22:54:18.186065 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.186040    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"]
Jul 08 22:54:18.282356 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.282324    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9727\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-kube-api-access-f9727\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.282503 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.282382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.383697 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.383650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.383822 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.383724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9727\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-kube-api-access-f9727\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.392054 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.392029    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.392243 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.392219    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9727\" (UniqueName: \"kubernetes.io/projected/636ee71a-f998-4d94-8436-d7af99351728-kube-api-access-f9727\") pod \"cert-manager-cainjector-559cdd8c87-9dq4c\" (UID: \"636ee71a-f998-4d94-8436-d7af99351728\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.487953 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.487856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"
Jul 08 22:54:18.613263 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:18.613239    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c"]
Jul 08 22:54:18.615446 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:54:18.615414    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod636ee71a_f998_4d94_8436_d7af99351728.slice/crio-b07ca2dbc9d10d05065a53c182ec0fc1d9a41732321ee1741fa62fe0bc22f08e WatchSource:0}: Error finding container b07ca2dbc9d10d05065a53c182ec0fc1d9a41732321ee1741fa62fe0bc22f08e: Status 404 returned error can't find the container with id b07ca2dbc9d10d05065a53c182ec0fc1d9a41732321ee1741fa62fe0bc22f08e
Jul 08 22:54:19.048520 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:19.048484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c" event={"ID":"636ee71a-f998-4d94-8436-d7af99351728","Type":"ContainerStarted","Data":"b07ca2dbc9d10d05065a53c182ec0fc1d9a41732321ee1741fa62fe0bc22f08e"}
Jul 08 22:54:26.082493 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:26.082457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c" event={"ID":"636ee71a-f998-4d94-8436-d7af99351728","Type":"ContainerStarted","Data":"91ead965e6a19c496b0c68f8949f8d861b748bd66d785b149f8e597913f9ed5f"}
Jul 08 22:54:26.097068 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:26.097025    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9dq4c" podStartSLOduration=1.624827426 podStartE2EDuration="8.097011398s" totalImagesPullingTime="6.472183972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:54:26.09633179 +0000 UTC m=+437.697162928" watchObservedRunningTime="2026-07-08 22:54:26.097011398 +0000 UTC m=+437.697842537"
Jul 08 22:54:27.071726 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.071696    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxjn5"]
Jul 08 22:54:27.074025 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.074008    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.076603 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.076587    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-l4r74\""
Jul 08 22:54:27.082877 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.082857    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxjn5"]
Jul 08 22:54:27.152292 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.152271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.152407 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.152314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr87v\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-kube-api-access-xr87v\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.253260 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.253235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr87v\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-kube-api-access-xr87v\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.253435 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.253414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.261322 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.261298    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.261549 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.261514    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr87v\" (UniqueName: \"kubernetes.io/projected/1b31042a-6839-484a-b0dd-890794b1bf63-kube-api-access-xr87v\") pod \"cert-manager-webhook-6486ffd997-zxjn5\" (UID: \"1b31042a-6839-484a-b0dd-890794b1bf63\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.382816 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.382748    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:27.504648 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:27.504619    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zxjn5"]
Jul 08 22:54:27.506085 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:54:27.506059    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b31042a_6839_484a_b0dd_890794b1bf63.slice/crio-2ce6f47e5f56b7681ea2755fb1e83571210928a31ff92ed1bc60f98c2ecdc235 WatchSource:0}: Error finding container 2ce6f47e5f56b7681ea2755fb1e83571210928a31ff92ed1bc60f98c2ecdc235: Status 404 returned error can't find the container with id 2ce6f47e5f56b7681ea2755fb1e83571210928a31ff92ed1bc60f98c2ecdc235
Jul 08 22:54:28.091728 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:28.091665    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5" event={"ID":"1b31042a-6839-484a-b0dd-890794b1bf63","Type":"ContainerStarted","Data":"bffa09c283a6cdd774219d0626ed1c1fbc18577f05e1ff92b89da49af2e1e741"}
Jul 08 22:54:28.092101 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:28.091737    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:28.092101 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:28.091750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5" event={"ID":"1b31042a-6839-484a-b0dd-890794b1bf63","Type":"ContainerStarted","Data":"2ce6f47e5f56b7681ea2755fb1e83571210928a31ff92ed1bc60f98c2ecdc235"}
Jul 08 22:54:28.107396 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:28.107353    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5" podStartSLOduration=1.107340223 podStartE2EDuration="1.107340223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:54:28.106652441 +0000 UTC m=+439.707483614" watchObservedRunningTime="2026-07-08 22:54:28.107340223 +0000 UTC m=+439.708171362"
Jul 08 22:54:34.098671 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:34.098639    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zxjn5"
Jul 08 22:54:58.761782 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.761749    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"]
Jul 08 22:54:58.765151 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.765131    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.769235 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769207    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 22:54:58.769358 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769330    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 22:54:58.769358 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769340    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 22:54:58.769523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769334    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 22:54:58.769523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769377    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 22:54:58.769523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.769428    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-88gxl\""
Jul 08 22:54:58.774726 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.774707    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"]
Jul 08 22:54:58.789688 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.789645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.789834 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.789700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ef70231-a3ba-40d1-a85f-c114e1421dea-manager-config\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.789834 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.789723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vlxv\" (UniqueName: \"kubernetes.io/projected/0ef70231-a3ba-40d1-a85f-c114e1421dea-kube-api-access-2vlxv\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.789834 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.789793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-metrics-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.890414 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.890378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-metrics-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.890589 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.890462    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.890589 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.890493    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ef70231-a3ba-40d1-a85f-c114e1421dea-manager-config\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.890675 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.890618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vlxv\" (UniqueName: \"kubernetes.io/projected/0ef70231-a3ba-40d1-a85f-c114e1421dea-kube-api-access-2vlxv\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.891227 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.891203    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0ef70231-a3ba-40d1-a85f-c114e1421dea-manager-config\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.893002 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.892982    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.893078 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.892983    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ef70231-a3ba-40d1-a85f-c114e1421dea-metrics-cert\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:58.906541 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:58.906520    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vlxv\" (UniqueName: \"kubernetes.io/projected/0ef70231-a3ba-40d1-a85f-c114e1421dea-kube-api-access-2vlxv\") pod \"lws-controller-manager-6cfd684dd8-vxfwf\" (UID: \"0ef70231-a3ba-40d1-a85f-c114e1421dea\") " pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:59.074885 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:59.074807    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:54:59.216258 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:59.216235    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"]
Jul 08 22:54:59.218337 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:54:59.218310    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef70231_a3ba_40d1_a85f_c114e1421dea.slice/crio-0171bddd31adfd428de7090b977ef72c4dda2417c25049414de58d5c8a888911 WatchSource:0}: Error finding container 0171bddd31adfd428de7090b977ef72c4dda2417c25049414de58d5c8a888911: Status 404 returned error can't find the container with id 0171bddd31adfd428de7090b977ef72c4dda2417c25049414de58d5c8a888911
Jul 08 22:54:59.226077 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:54:59.226052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf" event={"ID":"0ef70231-a3ba-40d1-a85f-c114e1421dea","Type":"ContainerStarted","Data":"0171bddd31adfd428de7090b977ef72c4dda2417c25049414de58d5c8a888911"}
Jul 08 22:55:02.245464 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.245432    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf" event={"ID":"0ef70231-a3ba-40d1-a85f-c114e1421dea","Type":"ContainerStarted","Data":"fcfff977b24971390dd7af64d032d3d7369b4b05f9b4fa83ace5339439a22fd1"}
Jul 08 22:55:02.245926 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.245504    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:55:02.266622 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.266567    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf" podStartSLOduration=1.798331288 podStartE2EDuration="4.266553288s" totalImagesPullingTime="2.468222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:02.264800409 +0000 UTC m=+473.865631551" watchObservedRunningTime="2026-07-08 22:55:02.266553288 +0000 UTC m=+473.867384429"
Jul 08 22:55:02.411378 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.411343    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"]
Jul 08 22:55:02.414886 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.414870    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.419168 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.419147    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 22:55:02.419279 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.419146    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 22:55:02.419481 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.419462    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 22:55:02.419670 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.419655    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zbz6j\""
Jul 08 22:55:02.420006 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.419991    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 22:55:02.441296 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.441272    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"]
Jul 08 22:55:02.518331 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.518236    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.518515 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.518337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2ncp\" (UniqueName: \"kubernetes.io/projected/d6270aff-a2b8-458c-9bc7-249f70052eb3-kube-api-access-d2ncp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.518515 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.518385    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.518515 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.518453    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.518515 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.518479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619264 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619280    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2ncp\" (UniqueName: \"kubernetes.io/projected/d6270aff-a2b8-458c-9bc7-249f70052eb3-kube-api-access-d2ncp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619523 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.619873 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.619848    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-manifests\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.621751 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.621728    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6270aff-a2b8-458c-9bc7-249f70052eb3-tmp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.621876 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.621855    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.621924 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.621915    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6270aff-a2b8-458c-9bc7-249f70052eb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.627371 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.627346    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2ncp\" (UniqueName: \"kubernetes.io/projected/d6270aff-a2b8-458c-9bc7-249f70052eb3-kube-api-access-d2ncp\") pod \"opendatahub-operator-controller-manager-86d776fd96-52cfq\" (UID: \"d6270aff-a2b8-458c-9bc7-249f70052eb3\") " pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.724976 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.724940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:02.858726 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:02.858695    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"]
Jul 08 22:55:02.861984 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:55:02.861951    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6270aff_a2b8_458c_9bc7_249f70052eb3.slice/crio-96c1da4dc7514c4d5aa55f266b1253dedb205ccdfc48b4000340dfb38cd262f8 WatchSource:0}: Error finding container 96c1da4dc7514c4d5aa55f266b1253dedb205ccdfc48b4000340dfb38cd262f8: Status 404 returned error can't find the container with id 96c1da4dc7514c4d5aa55f266b1253dedb205ccdfc48b4000340dfb38cd262f8
Jul 08 22:55:03.251068 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:03.251033    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq" event={"ID":"d6270aff-a2b8-458c-9bc7-249f70052eb3","Type":"ContainerStarted","Data":"96c1da4dc7514c4d5aa55f266b1253dedb205ccdfc48b4000340dfb38cd262f8"}
Jul 08 22:55:06.269095 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:06.269060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq" event={"ID":"d6270aff-a2b8-458c-9bc7-249f70052eb3","Type":"ContainerStarted","Data":"c411d8cf03c48eaf9091b5e4ef598d6034b7fd51e0b28feb48e5e38df1c435ff"}
Jul 08 22:55:07.274215 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:07.274126    2571 generic.go:356] "Generic (PLEG): container finished" podID="d6270aff-a2b8-458c-9bc7-249f70052eb3" containerID="c411d8cf03c48eaf9091b5e4ef598d6034b7fd51e0b28feb48e5e38df1c435ff" exitCode=0
Jul 08 22:55:07.274215 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:07.274181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq" event={"ID":"d6270aff-a2b8-458c-9bc7-249f70052eb3","Type":"ContainerDied","Data":"c411d8cf03c48eaf9091b5e4ef598d6034b7fd51e0b28feb48e5e38df1c435ff"}
Jul 08 22:55:08.281819 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:08.281781    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq" event={"ID":"d6270aff-a2b8-458c-9bc7-249f70052eb3","Type":"ContainerStarted","Data":"5d696bebcba558f8a7db20a38204adbd9d1721f0ae679325541d4268a262f7c6"}
Jul 08 22:55:08.282290 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:08.281917    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:08.303333 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:08.303279    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq" podStartSLOduration=1.9796084390000002 podStartE2EDuration="6.303262563s" totalImagesPullingTime="3.284625414s" totalInitContainerRuntime="1.03902871s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:08.301942856 +0000 UTC m=+479.902773994" watchObservedRunningTime="2026-07-08 22:55:08.303262563 +0000 UTC m=+479.904093703"
Jul 08 22:55:13.253563 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:13.253531    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6cfd684dd8-vxfwf"
Jul 08 22:55:19.288372 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:19.288343    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d776fd96-52cfq"
Jul 08 22:55:29.150396 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.150361    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"]
Jul 08 22:55:29.158704 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.158670    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.161595 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.161573    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 22:55:29.161715 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.161595    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 22:55:29.161715 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.161609    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 22:55:29.161715 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.161573    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 22:55:29.161715 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.161657    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ktlbh\""
Jul 08 22:55:29.171024 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.171003    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"]
Jul 08 22:55:29.243233 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243200    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rb6\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-kube-api-access-45rb6\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243381 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243381 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243381 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243368    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243489 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42db0aeb-f844-4273-9f3b-bc408a07f50a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243489 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.243554 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.243496    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.344946 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.344910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345089 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.344984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42db0aeb-f844-4273-9f3b-bc408a07f50a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345089 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345089 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345020    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345089 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45rb6\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-kube-api-access-45rb6\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345343 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345343 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.345822 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.345800    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.347264 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.347212    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/42db0aeb-f844-4273-9f3b-bc408a07f50a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.347426 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.347407    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.347728 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.347703    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.347796 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.347729    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/42db0aeb-f844-4273-9f3b-bc408a07f50a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.353373 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.353352    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rb6\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-kube-api-access-45rb6\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.353587 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.353570    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42db0aeb-f844-4273-9f3b-bc408a07f50a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-9btcj\" (UID: \"42db0aeb-f844-4273-9f3b-bc408a07f50a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.470054 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.469983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:29.608407 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:29.608384    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"]
Jul 08 22:55:29.610240 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:55:29.610210    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42db0aeb_f844_4273_9f3b_bc408a07f50a.slice/crio-b447d55c31de8184f62fac60a9f9c294a2947b263483c86d3d0e12a050b03fad WatchSource:0}: Error finding container b447d55c31de8184f62fac60a9f9c294a2947b263483c86d3d0e12a050b03fad: Status 404 returned error can't find the container with id b447d55c31de8184f62fac60a9f9c294a2947b263483c86d3d0e12a050b03fad
Jul 08 22:55:30.387435 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:30.387400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj" event={"ID":"42db0aeb-f844-4273-9f3b-bc408a07f50a","Type":"ContainerStarted","Data":"b447d55c31de8184f62fac60a9f9c294a2947b263483c86d3d0e12a050b03fad"}
Jul 08 22:55:32.225838 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:32.225794    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 22:55:32.226206 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:32.225881    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 08 22:55:32.399461 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:32.399426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj" event={"ID":"42db0aeb-f844-4273-9f3b-bc408a07f50a","Type":"ContainerStarted","Data":"b4c87754405b94228e975697891bcd649c577a9e96c2239fa54860f5a2353654"}
Jul 08 22:55:32.399622 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:32.399544    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:55:32.421929 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:32.421859    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj" podStartSLOduration=0.808566075 podStartE2EDuration="3.421838627s" totalImagesPullingTime="2.613272552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:55:32.418803093 +0000 UTC m=+504.019634233" watchObservedRunningTime="2026-07-08 22:55:32.421838627 +0000 UTC m=+504.022669768"
Jul 08 22:55:33.405176 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:55:33.405150    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-9btcj"
Jul 08 22:57:09.318754 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:09.318723    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:57:09.319493 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:09.319474    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 22:57:20.649372 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.649337    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"]
Jul 08 22:57:20.652560 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.652544    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:20.655570 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.655549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 22:57:20.656981 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.656958    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kxr7h\""
Jul 08 22:57:20.657120 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.656964    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 22:57:20.663755 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.663716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"]
Jul 08 22:57:20.771864 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.771829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5f4\" (UniqueName: \"kubernetes.io/projected/6743efb0-59ce-4a6c-8f65-1665748bf6bd-kube-api-access-fg5f4\") pod \"limitador-operator-controller-manager-859d7b78bd-68sxj\" (UID: \"6743efb0-59ce-4a6c-8f65-1665748bf6bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:20.872823 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.872772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5f4\" (UniqueName: \"kubernetes.io/projected/6743efb0-59ce-4a6c-8f65-1665748bf6bd-kube-api-access-fg5f4\") pod \"limitador-operator-controller-manager-859d7b78bd-68sxj\" (UID: \"6743efb0-59ce-4a6c-8f65-1665748bf6bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:20.881388 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.881357    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5f4\" (UniqueName: \"kubernetes.io/projected/6743efb0-59ce-4a6c-8f65-1665748bf6bd-kube-api-access-fg5f4\") pod \"limitador-operator-controller-manager-859d7b78bd-68sxj\" (UID: \"6743efb0-59ce-4a6c-8f65-1665748bf6bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:20.966104 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:20.966016    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:21.090488 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:21.090466    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"]
Jul 08 22:57:21.094604 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:57:21.094573    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6743efb0_59ce_4a6c_8f65_1665748bf6bd.slice/crio-2c05cdb437988c9a06bac18fb01b8b8deb524bd2773206cd5dd75ae86ee43877 WatchSource:0}: Error finding container 2c05cdb437988c9a06bac18fb01b8b8deb524bd2773206cd5dd75ae86ee43877: Status 404 returned error can't find the container with id 2c05cdb437988c9a06bac18fb01b8b8deb524bd2773206cd5dd75ae86ee43877
Jul 08 22:57:21.876710 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:21.876658    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj" event={"ID":"6743efb0-59ce-4a6c-8f65-1665748bf6bd","Type":"ContainerStarted","Data":"2c05cdb437988c9a06bac18fb01b8b8deb524bd2773206cd5dd75ae86ee43877"}
Jul 08 22:57:22.883029 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:22.882981    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj" event={"ID":"6743efb0-59ce-4a6c-8f65-1665748bf6bd","Type":"ContainerStarted","Data":"79ed73f6d0b04c0882d79075cc6b02292da8879b4c917468b6eb9fbd9fc98582"}
Jul 08 22:57:22.883463 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:22.883054    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:57:22.899949 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:22.899897    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj" podStartSLOduration=1.295259012 podStartE2EDuration="2.899883644s" totalImagesPullingTime="1.604624632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:57:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:57:22.898646134 +0000 UTC m=+614.499477275" watchObservedRunningTime="2026-07-08 22:57:22.899883644 +0000 UTC m=+614.500714856"
Jul 08 22:57:33.890240 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:57:33.890207    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-68sxj"
Jul 08 22:59:23.509027 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.508950    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zv9fl"]
Jul 08 22:59:23.512081 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.512066    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.514982 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.514960    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 22:59:23.515108 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.515079    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cxs4d\""
Jul 08 22:59:23.518775 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.518753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zv9fl"]
Jul 08 22:59:23.616372 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.616341    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsh8s\" (UniqueName: \"kubernetes.io/projected/7c2f92a5-a627-4820-8f10-e20ed14cff3c-kube-api-access-rsh8s\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.616538 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.616378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2f92a5-a627-4820-8f10-e20ed14cff3c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.717027 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.716975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsh8s\" (UniqueName: \"kubernetes.io/projected/7c2f92a5-a627-4820-8f10-e20ed14cff3c-kube-api-access-rsh8s\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.717218 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.717051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2f92a5-a627-4820-8f10-e20ed14cff3c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.717844 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.717824    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c2f92a5-a627-4820-8f10-e20ed14cff3c-plugins-config-volume\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.726855 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.726827    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsh8s\" (UniqueName: \"kubernetes.io/projected/7c2f92a5-a627-4820-8f10-e20ed14cff3c-kube-api-access-rsh8s\") pod \"payload-pre-processing-7964457696-zv9fl\" (UID: \"7c2f92a5-a627-4820-8f10-e20ed14cff3c\") " pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.823477 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.823375    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:23.950944 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.950912    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-zv9fl"]
Jul 08 22:59:23.954574 ip-10-0-128-122 kubenswrapper[2571]: W0708 22:59:23.954539    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2f92a5_a627_4820_8f10_e20ed14cff3c.slice/crio-e0d16d31ceb3839d8bbca44c5bb68b6bb3cfe18345383d4f28688849400b912c WatchSource:0}: Error finding container e0d16d31ceb3839d8bbca44c5bb68b6bb3cfe18345383d4f28688849400b912c: Status 404 returned error can't find the container with id e0d16d31ceb3839d8bbca44c5bb68b6bb3cfe18345383d4f28688849400b912c
Jul 08 22:59:23.956597 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:23.956579    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 22:59:24.427394 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:24.427358    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl" event={"ID":"7c2f92a5-a627-4820-8f10-e20ed14cff3c","Type":"ContainerStarted","Data":"e0d16d31ceb3839d8bbca44c5bb68b6bb3cfe18345383d4f28688849400b912c"}
Jul 08 22:59:26.437965 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:26.437929    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl" event={"ID":"7c2f92a5-a627-4820-8f10-e20ed14cff3c","Type":"ContainerStarted","Data":"158135ec9048095a0dd39a0cb5afbe0f8b60a68ccc518bf6dce2fe487d612c16"}
Jul 08 22:59:26.438413 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:26.438013    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 22:59:26.454906 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:26.454861    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl" podStartSLOduration=1.9852401849999999 podStartE2EDuration="3.454846207s" totalImagesPullingTime="1.469606022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:26.453916052 +0000 UTC m=+738.054747191" watchObservedRunningTime="2026-07-08 22:59:26.454846207 +0000 UTC m=+738.055677348"
Jul 08 22:59:37.445282 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:37.445236    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl" podUID="7c2f92a5-a627-4820-8f10-e20ed14cff3c" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.28:9004: connect: connection refused"
Jul 08 22:59:47.444330 ip-10-0-128-122 kubenswrapper[2571]: I0708 22:59:47.444298    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-zv9fl"
Jul 08 23:00:00.136408 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.136371    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:00:00.140669 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.140653    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:00:00.143563 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.143537    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 23:00:00.143721 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.143701    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 23:00:00.145090 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.145065    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 23:00:00.151739 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.151717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:00:00.216698 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.216643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxht\" (UniqueName: \"kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht\") pod \"maas-api-key-cleanup-29725860-xthh9\" (UID: \"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:00:00.317961 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.317921    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxht\" (UniqueName: \"kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht\") pod \"maas-api-key-cleanup-29725860-xthh9\" (UID: \"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:00:00.326881 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.326848    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxht\" (UniqueName: \"kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht\") pod \"maas-api-key-cleanup-29725860-xthh9\" (UID: \"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:00:00.458633 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.458599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:00:00.588386 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:00.588303    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:00:00.590616 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:00:00.590578    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1dc7fbf_84ad_44a5_b1b5_a520d0a94d8d.slice/crio-adb79073f71df1a5717bbec881fb5f67f6130ef3fa0ef2de58ce1298b8e5fa5e WatchSource:0}: Error finding container adb79073f71df1a5717bbec881fb5f67f6130ef3fa0ef2de58ce1298b8e5fa5e: Status 404 returned error can't find the container with id adb79073f71df1a5717bbec881fb5f67f6130ef3fa0ef2de58ce1298b8e5fa5e
Jul 08 23:00:01.598967 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:01.598932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" event={"ID":"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d","Type":"ContainerStarted","Data":"adb79073f71df1a5717bbec881fb5f67f6130ef3fa0ef2de58ce1298b8e5fa5e"}
Jul 08 23:00:09.275119 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.275080    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"]
Jul 08 23:00:09.278939 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.278913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.281615 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.281590    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 23:00:09.282926 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.282898    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qxrkl\""
Jul 08 23:00:09.283043 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.282951    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 23:00:09.283043 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.282900    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 08 23:00:09.288319 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.287602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"]
Jul 08 23:00:09.397115 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ng2k\" (UniqueName: \"kubernetes.io/projected/086b1410-6faf-4c48-b9b6-9cab12541f75-kube-api-access-5ng2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.397300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.397300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397197    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086b1410-6faf-4c48-b9b6-9cab12541f75-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.397300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.397300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397269    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.397451 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.397300    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498556 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498556 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086b1410-6faf-4c48-b9b6-9cab12541f75-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498820 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498820 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498820 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498656    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.498820 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ng2k\" (UniqueName: \"kubernetes.io/projected/086b1410-6faf-4c48-b9b6-9cab12541f75-kube-api-access-5ng2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.499040 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498949    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.499040 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.498976    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.499040 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.499019    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.500776 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.500748    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/086b1410-6faf-4c48-b9b6-9cab12541f75-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.500909 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.500894    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/086b1410-6faf-4c48-b9b6-9cab12541f75-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.506978 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.506957    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ng2k\" (UniqueName: \"kubernetes.io/projected/086b1410-6faf-4c48-b9b6-9cab12541f75-kube-api-access-5ng2k\") pod \"e2e-trlp-test-simulated-kserve-598466548d-zw9rr\" (UID: \"086b1410-6faf-4c48-b9b6-9cab12541f75\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.592544 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.592474    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:09.720590 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:09.720554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"]
Jul 08 23:00:09.723045 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:00:09.723019    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086b1410_6faf_4c48_b9b6_9cab12541f75.slice/crio-ab4b28267c7a5df44ab17ce4804ba0af481e424afff1dbd3c6fc783790c7ccff WatchSource:0}: Error finding container ab4b28267c7a5df44ab17ce4804ba0af481e424afff1dbd3c6fc783790c7ccff: Status 404 returned error can't find the container with id ab4b28267c7a5df44ab17ce4804ba0af481e424afff1dbd3c6fc783790c7ccff
Jul 08 23:00:10.641198 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:10.641162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr" event={"ID":"086b1410-6faf-4c48-b9b6-9cab12541f75","Type":"ContainerStarted","Data":"ab4b28267c7a5df44ab17ce4804ba0af481e424afff1dbd3c6fc783790c7ccff"}
Jul 08 23:00:16.676382 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:16.676329    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" event={"ID":"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d","Type":"ContainerStarted","Data":"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"}
Jul 08 23:00:16.692213 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:16.692158    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" podStartSLOduration=1.727747612 podStartE2EDuration="16.692138978s" totalImagesPullingTime="14.964391366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:00:16.690350956 +0000 UTC m=+788.291182096" watchObservedRunningTime="2026-07-08 23:00:16.692138978 +0000 UTC m=+788.292970118"
Jul 08 23:00:18.687105 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:18.687071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr" event={"ID":"086b1410-6faf-4c48-b9b6-9cab12541f75","Type":"ContainerStarted","Data":"822cc98c4db25833f589df5f6beb1d8c7f7eff00dd202034ee942724396e06d4"}
Jul 08 23:00:18.704754 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:18.704707    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr" podStartSLOduration=1.8028127330000001 podStartE2EDuration="9.704671422s" totalImagesPullingTime="7.901858689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:00:18.70254489 +0000 UTC m=+790.303376030" watchObservedRunningTime="2026-07-08 23:00:18.704671422 +0000 UTC m=+790.305502561"
Jul 08 23:00:19.593560 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:19.593528    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:19.593754 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:19.593576    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:19.605776 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:19.605754    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:00:19.701909 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:00:19.701880    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-zw9rr"
Jul 08 23:01:00.009887 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:00.009856    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:01:00.010392 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:00.010104    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" podUID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" containerName="cleanup" containerID="cri-o://292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b" gracePeriod=30
Jul 08 23:01:30.199921 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:30.199895    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:01:30.256369 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:30.256343    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldxht\" (UniqueName: \"kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht\") pod \"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d\" (UID: \"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d\") "
Jul 08 23:01:30.258390 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:30.258369    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht" (OuterVolumeSpecName: "kube-api-access-ldxht") pod "e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" (UID: "e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d"). InnerVolumeSpecName "kube-api-access-ldxht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:01:30.357457 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:30.357403    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldxht\" (UniqueName: \"kubernetes.io/projected/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d-kube-api-access-ldxht\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:01:31.009411 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.009376    2571 generic.go:356] "Generic (PLEG): container finished" podID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" containerID="292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b" exitCode=137
Jul 08 23:01:31.009605 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.009417    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"
Jul 08 23:01:31.009605 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.009463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" event={"ID":"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d","Type":"ContainerDied","Data":"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"}
Jul 08 23:01:31.009605 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.009516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9" event={"ID":"e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d","Type":"ContainerDied","Data":"adb79073f71df1a5717bbec881fb5f67f6130ef3fa0ef2de58ce1298b8e5fa5e"}
Jul 08 23:01:31.009605 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.009545    2571 scope.go:117] "RemoveContainer" containerID="292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"
Jul 08 23:01:31.017944 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.017786    2571 scope.go:117] "RemoveContainer" containerID="292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"
Jul 08 23:01:31.018036 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:01:31.018020    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b\": container with ID starting with 292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b not found: ID does not exist" containerID="292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"
Jul 08 23:01:31.018078 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.018042    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b"} err="failed to get container status \"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b\": rpc error: code = NotFound desc = could not find container \"292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b\": container with ID starting with 292e796edec9d2bdd1d41a2101e31fb733b2bd42e7b976602e2367a5835cc91b not found: ID does not exist"
Jul 08 23:01:31.031153 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.031129    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:01:31.034826 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.034805    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725860-xthh9"]
Jul 08 23:01:31.463672 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:01:31.463634    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" path="/var/lib/kubelet/pods/e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d/volumes"
Jul 08 23:02:09.347795 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:02:09.347705    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:02:09.349521 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:02:09.349498    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:07:09.375750 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:07:09.375711    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:07:09.378775 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:07:09.378753    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:12:09.404230 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:12:09.404204    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:12:09.406818 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:12:09.406797    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:15:00.134824 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.134791    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:15:00.137139 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.135160    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" containerName="cleanup"
Jul 08 23:15:00.137139 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.135173    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" containerName="cleanup"
Jul 08 23:15:00.137139 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.135247    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1dc7fbf-84ad-44a5-b1b5-a520d0a94d8d" containerName="cleanup"
Jul 08 23:15:00.138028 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.138013    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:15:00.140961 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.140938    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 23:15:00.141076 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.141027    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 23:15:00.142202 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.142184    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 23:15:00.155537 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.155512    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:15:00.284516 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.284484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qptx2\" (UniqueName: \"kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2\") pod \"maas-api-key-cleanup-29725875-mg692\" (UID: \"0c513c60-65e1-40ef-ae73-109220b913dd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:15:00.385135 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.385051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qptx2\" (UniqueName: \"kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2\") pod \"maas-api-key-cleanup-29725875-mg692\" (UID: \"0c513c60-65e1-40ef-ae73-109220b913dd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:15:00.393930 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.393910    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qptx2\" (UniqueName: \"kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2\") pod \"maas-api-key-cleanup-29725875-mg692\" (UID: \"0c513c60-65e1-40ef-ae73-109220b913dd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:15:00.447670 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.447646    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:15:00.573533 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.573501    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:15:00.576950 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:15:00.576916    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c513c60_65e1_40ef_ae73_109220b913dd.slice/crio-2b2d44ca81de2dbcb5dcf02dd238045fb839fc1a8fa281b0426cdbc2b0ddbc8f WatchSource:0}: Error finding container 2b2d44ca81de2dbcb5dcf02dd238045fb839fc1a8fa281b0426cdbc2b0ddbc8f: Status 404 returned error can't find the container with id 2b2d44ca81de2dbcb5dcf02dd238045fb839fc1a8fa281b0426cdbc2b0ddbc8f
Jul 08 23:15:00.616705 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:00.616673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" event={"ID":"0c513c60-65e1-40ef-ae73-109220b913dd","Type":"ContainerStarted","Data":"2b2d44ca81de2dbcb5dcf02dd238045fb839fc1a8fa281b0426cdbc2b0ddbc8f"}
Jul 08 23:15:01.623578 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:01.623547    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" event={"ID":"0c513c60-65e1-40ef-ae73-109220b913dd","Type":"ContainerStarted","Data":"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"}
Jul 08 23:15:01.640670 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:15:01.640613    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" podStartSLOduration=1.640596135 podStartE2EDuration="1.640596135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:15:01.640289946 +0000 UTC m=+1673.241121087" watchObservedRunningTime="2026-07-08 23:15:01.640596135 +0000 UTC m=+1673.241427275"
Jul 08 23:16:00.010708 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:00.010662    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:16:00.011156 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:00.010858    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" podUID="0c513c60-65e1-40ef-ae73-109220b913dd" containerName="cleanup" containerID="cri-o://a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a" gracePeriod=30
Jul 08 23:16:30.210955 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:30.210932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:16:30.333649 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:30.333550    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qptx2\" (UniqueName: \"kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2\") pod \"0c513c60-65e1-40ef-ae73-109220b913dd\" (UID: \"0c513c60-65e1-40ef-ae73-109220b913dd\") "
Jul 08 23:16:30.335574 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:30.335550    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2" (OuterVolumeSpecName: "kube-api-access-qptx2") pod "0c513c60-65e1-40ef-ae73-109220b913dd" (UID: "0c513c60-65e1-40ef-ae73-109220b913dd"). InnerVolumeSpecName "kube-api-access-qptx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:16:30.434923 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:30.434879    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qptx2\" (UniqueName: \"kubernetes.io/projected/0c513c60-65e1-40ef-ae73-109220b913dd-kube-api-access-qptx2\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:16:31.027385 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.027350    2571 generic.go:356] "Generic (PLEG): container finished" podID="0c513c60-65e1-40ef-ae73-109220b913dd" containerID="a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a" exitCode=137
Jul 08 23:16:31.027581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.027399    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"
Jul 08 23:16:31.027581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.027399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" event={"ID":"0c513c60-65e1-40ef-ae73-109220b913dd","Type":"ContainerDied","Data":"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"}
Jul 08 23:16:31.027581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.027459    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692" event={"ID":"0c513c60-65e1-40ef-ae73-109220b913dd","Type":"ContainerDied","Data":"2b2d44ca81de2dbcb5dcf02dd238045fb839fc1a8fa281b0426cdbc2b0ddbc8f"}
Jul 08 23:16:31.027581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.027482    2571 scope.go:117] "RemoveContainer" containerID="a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"
Jul 08 23:16:31.036921 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.036904    2571 scope.go:117] "RemoveContainer" containerID="a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"
Jul 08 23:16:31.037157 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:16:31.037142    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a\": container with ID starting with a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a not found: ID does not exist" containerID="a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"
Jul 08 23:16:31.037200 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.037164    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a"} err="failed to get container status \"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a\": rpc error: code = NotFound desc = could not find container \"a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a\": container with ID starting with a1ce8de9c35332a628b9189970f31c45cacee57461ddddc7e14fc93b3467430a not found: ID does not exist"
Jul 08 23:16:31.048424 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.048400    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:16:31.052189 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.052166    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725875-mg692"]
Jul 08 23:16:31.464541 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:16:31.464499    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c513c60-65e1-40ef-ae73-109220b913dd" path="/var/lib/kubelet/pods/0c513c60-65e1-40ef-ae73-109220b913dd/volumes"
Jul 08 23:17:09.430652 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:17:09.430623    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:17:09.434325 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:17:09.434300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:18:55.277907 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.277862    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:18:55.278402 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.278222    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c513c60-65e1-40ef-ae73-109220b913dd" containerName="cleanup"
Jul 08 23:18:55.278402 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.278234    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c513c60-65e1-40ef-ae73-109220b913dd" containerName="cleanup"
Jul 08 23:18:55.278402 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.278319    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c513c60-65e1-40ef-ae73-109220b913dd" containerName="cleanup"
Jul 08 23:18:55.281259 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.281240    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.283993 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.283970    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5d2c4024\"/\"openshift-service-ca.crt\""
Jul 08 23:18:55.284127 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.284023    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5d2c4024\"/\"kube-root-ca.crt\""
Jul 08 23:18:55.285318 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.285299    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5d2c4024\"/\"default-dockercfg-gw8mk\""
Jul 08 23:18:55.285423 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.285333    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5d2c4024\"/\"e2e-lifecycle-model-5d2c4024-kserve-self-signed-certs\""
Jul 08 23:18:55.290221 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.290199    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:18:55.321511 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321478    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.321511 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321510    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4v4z\" (UniqueName: \"kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.321747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.321747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.321747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.321747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.321667    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422632 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422851 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422659    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422851 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422851 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422851 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.422851 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.422838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4v4z\" (UniqueName: \"kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.423120 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.423089    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.423179 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.423152    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.423230 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.423174    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.424919 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.424899    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.425104 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.425088    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.431188 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.431165    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4v4z\" (UniqueName: \"kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z\") pod \"e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") " pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.592822 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.592733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:18:55.721735 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:55.721712    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:18:55.723876 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:18:55.723842    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c1aefc2_e0dc_4354_b1be_086c09b92821.slice/crio-870e6c18e4f86a4ba6861a1b8a29753b31d3810eee506705fc195b4636a88d48 WatchSource:0}: Error finding container 870e6c18e4f86a4ba6861a1b8a29753b31d3810eee506705fc195b4636a88d48: Status 404 returned error can't find the container with id 870e6c18e4f86a4ba6861a1b8a29753b31d3810eee506705fc195b4636a88d48
Jul 08 23:18:56.691516 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:56.691480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" event={"ID":"5c1aefc2-e0dc-4354-b1be-086c09b92821","Type":"ContainerStarted","Data":"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"}
Jul 08 23:18:56.691927 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:56.691530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" event={"ID":"5c1aefc2-e0dc-4354-b1be-086c09b92821","Type":"ContainerStarted","Data":"870e6c18e4f86a4ba6861a1b8a29753b31d3810eee506705fc195b4636a88d48"}
Jul 08 23:18:56.711672 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:18:56.711626    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" podStartSLOduration=1.711610613 podStartE2EDuration="1.711610613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:18:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:18:56.709799733 +0000 UTC m=+1908.310630936" watchObservedRunningTime="2026-07-08 23:18:56.711610613 +0000 UTC m=+1908.312441752"
Jul 08 23:19:05.593180 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:05.593130    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:05.593180 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:05.593194    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:05.605584 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:05.605560    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:05.743583 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:05.743555    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:37.860249 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:37.860212    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:19:52.880586 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:52.880539    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" podUID="5c1aefc2-e0dc-4354-b1be-086c09b92821" containerName="main" containerID="cri-o://fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42" gracePeriod=45
Jul 08 23:19:53.141912 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.141891    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:53.205570 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.205777 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205595    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4v4z\" (UniqueName: \"kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.205777 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.205777 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205669    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.205777 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205761    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.205993 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205817    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir\") pod \"5c1aefc2-e0dc-4354-b1be-086c09b92821\" (UID: \"5c1aefc2-e0dc-4354-b1be-086c09b92821\") "
Jul 08 23:19:53.206063 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.205998    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home" (OuterVolumeSpecName: "home") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:19:53.206063 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.206036    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:19:53.206296 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.206243    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:19:53.207899 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.207878    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:19:53.208115 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.208099    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm" (OuterVolumeSpecName: "dshm") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:19:53.208169 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.208132    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z" (OuterVolumeSpecName: "kube-api-access-b4v4z") pod "5c1aefc2-e0dc-4354-b1be-086c09b92821" (UID: "5c1aefc2-e0dc-4354-b1be-086c09b92821"). InnerVolumeSpecName "kube-api-access-b4v4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:19:53.306686 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306650    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-home\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.306849 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306704    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-model-cache\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.306849 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306716    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-tmp-dir\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.306849 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306724    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c1aefc2-e0dc-4354-b1be-086c09b92821-dshm\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.306849 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306732    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4v4z\" (UniqueName: \"kubernetes.io/projected/5c1aefc2-e0dc-4354-b1be-086c09b92821-kube-api-access-b4v4z\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.306849 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.306740    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c1aefc2-e0dc-4354-b1be-086c09b92821-tls-certs\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:19:53.962347 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.962312    2571 generic.go:356] "Generic (PLEG): container finished" podID="5c1aefc2-e0dc-4354-b1be-086c09b92821" containerID="fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42" exitCode=0
Jul 08 23:19:53.962855 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.962370    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"
Jul 08 23:19:53.962855 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.962406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" event={"ID":"5c1aefc2-e0dc-4354-b1be-086c09b92821","Type":"ContainerDied","Data":"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"}
Jul 08 23:19:53.962855 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.962448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52" event={"ID":"5c1aefc2-e0dc-4354-b1be-086c09b92821","Type":"ContainerDied","Data":"870e6c18e4f86a4ba6861a1b8a29753b31d3810eee506705fc195b4636a88d48"}
Jul 08 23:19:53.962855 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.962464    2571 scope.go:117] "RemoveContainer" containerID="fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"
Jul 08 23:19:53.970763 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.970746    2571 scope.go:117] "RemoveContainer" containerID="fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"
Jul 08 23:19:53.971044 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:19:53.971025    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42\": container with ID starting with fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42 not found: ID does not exist" containerID="fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"
Jul 08 23:19:53.971089 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.971052    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42"} err="failed to get container status \"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42\": rpc error: code = NotFound desc = could not find container \"fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42\": container with ID starting with fb9bf00cd373ce05e96ba757114f6ef1310821abbd32f4e40d6a629ab2de1d42 not found: ID does not exist"
Jul 08 23:19:53.978971 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.978952    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:19:53.982111 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:53.982090    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5d2c4024/e2e-lifecycle-model-5d2c4024-kserve-58cc8cdf6c-2lq52"]
Jul 08 23:19:55.464134 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:19:55.464102    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1aefc2-e0dc-4354-b1be-086c09b92821" path="/var/lib/kubelet/pods/5c1aefc2-e0dc-4354-b1be-086c09b92821/volumes"
Jul 08 23:21:22.792321 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.792286    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:21:22.792779 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.792640    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1aefc2-e0dc-4354-b1be-086c09b92821" containerName="main"
Jul 08 23:21:22.792779 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.792653    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1aefc2-e0dc-4354-b1be-086c09b92821" containerName="main"
Jul 08 23:21:22.792779 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.792720    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1aefc2-e0dc-4354-b1be-086c09b92821" containerName="main"
Jul 08 23:21:22.795558 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.795543    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.798291 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.798269    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 23:21:22.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.798310    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-0a82e7-serving-cert\""
Jul 08 23:21:22.798409 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.798330    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 23:21:22.799807 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.799789    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 23:21:22.803614 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.803593    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:21:22.876308 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.876271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.876482 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.876325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9zd\" (UniqueName: \"kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.876482 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.876351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.977724 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.977666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.977918 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.977758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9zd\" (UniqueName: \"kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.977918 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.977782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.978041 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:21:22.977932    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-serving-cert: secret "maas-api-e2e-inf-a-0a82e7-serving-cert" not found
Jul 08 23:21:22.978041 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:21:22.978007    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls podName:edc0d561-0cd1-4e24-bf24-150ee48481c6 nodeName:}" failed. No retries permitted until 2026-07-08 23:21:23.477986735 +0000 UTC m=+2055.078817853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls") pod "maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" (UID: "edc0d561-0cd1-4e24-bf24-150ee48481c6") : secret "maas-api-e2e-inf-a-0a82e7-serving-cert" not found
Jul 08 23:21:22.978437 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.978412    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:22.986532 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:22.986495    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9zd\" (UniqueName: \"kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:23.482654 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:23.482623    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:23.485025 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:23.485004    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") pod \"maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:23.706727 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:23.706673    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:23.835584 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:23.835561    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:21:23.837761 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:21:23.837731    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc0d561_0cd1_4e24_bf24_150ee48481c6.slice/crio-4629c9c4234aa168c7c112d859c519ede8345378ffaa1db6611dc11868814802 WatchSource:0}: Error finding container 4629c9c4234aa168c7c112d859c519ede8345378ffaa1db6611dc11868814802: Status 404 returned error can't find the container with id 4629c9c4234aa168c7c112d859c519ede8345378ffaa1db6611dc11868814802
Jul 08 23:21:23.839067 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:23.839049    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:21:24.372214 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:24.372179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" event={"ID":"edc0d561-0cd1-4e24-bf24-150ee48481c6","Type":"ContainerStarted","Data":"4629c9c4234aa168c7c112d859c519ede8345378ffaa1db6611dc11868814802"}
Jul 08 23:21:26.388165 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:26.388126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" event={"ID":"edc0d561-0cd1-4e24-bf24-150ee48481c6","Type":"ContainerStarted","Data":"38c38bb214459ed49f354c5aa8ebded311c06be7115d61e4ba0c41652dabb01b"}
Jul 08 23:21:26.388547 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:26.388242    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:26.408128 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:26.408081    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" podStartSLOduration=2.759889586 podStartE2EDuration="4.408065731s" totalImagesPullingTime="1.648176145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:26.406087098 +0000 UTC m=+2058.006918272" watchObservedRunningTime="2026-07-08 23:21:26.408065731 +0000 UTC m=+2058.008896870"
Jul 08 23:21:30.754437 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.754401    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:21:30.757970 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.757949    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:30.760606 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.760586    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a78f59-serving-cert\""
Jul 08 23:21:30.767271 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.767245    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:21:30.942398 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.942322    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:30.942398 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.942357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52fgb\" (UniqueName: \"kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:30.942398 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:30.942397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.043168 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.043081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.043168 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.043125    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52fgb\" (UniqueName: \"kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.043390 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.043179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.043390 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:21:31.043312    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-serving-cert: secret "maas-api-e2e-inf-b-a78f59-serving-cert" not found
Jul 08 23:21:31.043390 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:21:31.043378    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls podName:30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2 nodeName:}" failed. No retries permitted until 2026-07-08 23:21:31.543357945 +0000 UTC m=+2063.144189066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls") pod "maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" (UID: "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2") : secret "maas-api-e2e-inf-b-a78f59-serving-cert" not found
Jul 08 23:21:31.043727 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.043708    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.055380 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.055359    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52fgb\" (UniqueName: \"kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.547216 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.547181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.549511 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.549489    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.670747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.670708    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:31.801820 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:31.801798    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:21:31.804230 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:21:31.804200    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ae5d0f_b594_44ac_9a1a_e5a4e4a513d2.slice/crio-c87d3d8080ad200cfd0065af95726cca811ea2f64e9388c3c34832b0ecd20ed0 WatchSource:0}: Error finding container c87d3d8080ad200cfd0065af95726cca811ea2f64e9388c3c34832b0ecd20ed0: Status 404 returned error can't find the container with id c87d3d8080ad200cfd0065af95726cca811ea2f64e9388c3c34832b0ecd20ed0
Jul 08 23:21:32.397840 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:32.397813    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:21:32.416256 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:32.416224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" event={"ID":"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2","Type":"ContainerStarted","Data":"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"}
Jul 08 23:21:32.416395 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:32.416275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:21:32.416395 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:32.416291    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" event={"ID":"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2","Type":"ContainerStarted","Data":"c87d3d8080ad200cfd0065af95726cca811ea2f64e9388c3c34832b0ecd20ed0"}
Jul 08 23:21:32.434126 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:32.434017    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" podStartSLOduration=2.058669399 podStartE2EDuration="2.434002113s" totalImagesPullingTime="375.332714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:21:32.433302889 +0000 UTC m=+2064.034134031" watchObservedRunningTime="2026-07-08 23:21:32.434002113 +0000 UTC m=+2064.034833300"
Jul 08 23:21:38.426451 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:21:38.426419    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:22:09.459415 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:09.459386    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:22:09.469627 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:09.469606    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:22:51.587087 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.587049    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:22:51.587878 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.587824    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" podUID="edc0d561-0cd1-4e24-bf24-150ee48481c6" containerName="maas-api" containerID="cri-o://38c38bb214459ed49f354c5aa8ebded311c06be7115d61e4ba0c41652dabb01b" gracePeriod=30
Jul 08 23:22:51.775691 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.775646    2571 generic.go:356] "Generic (PLEG): container finished" podID="edc0d561-0cd1-4e24-bf24-150ee48481c6" containerID="38c38bb214459ed49f354c5aa8ebded311c06be7115d61e4ba0c41652dabb01b" exitCode=0
Jul 08 23:22:51.775834 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.775697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" event={"ID":"edc0d561-0cd1-4e24-bf24-150ee48481c6","Type":"ContainerDied","Data":"38c38bb214459ed49f354c5aa8ebded311c06be7115d61e4ba0c41652dabb01b"}
Jul 08 23:22:51.837909 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.837851    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:22:51.925207 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.925170    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq9zd\" (UniqueName: \"kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd\") pod \"edc0d561-0cd1-4e24-bf24-150ee48481c6\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") "
Jul 08 23:22:51.925394 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.925221    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca\") pod \"edc0d561-0cd1-4e24-bf24-150ee48481c6\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") "
Jul 08 23:22:51.925394 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.925254    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") pod \"edc0d561-0cd1-4e24-bf24-150ee48481c6\" (UID: \"edc0d561-0cd1-4e24-bf24-150ee48481c6\") "
Jul 08 23:22:51.925569 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.925545    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edc0d561-0cd1-4e24-bf24-150ee48481c6" (UID: "edc0d561-0cd1-4e24-bf24-150ee48481c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:22:51.927239 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.927211    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edc0d561-0cd1-4e24-bf24-150ee48481c6" (UID: "edc0d561-0cd1-4e24-bf24-150ee48481c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:22:51.927346 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:51.927262    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd" (OuterVolumeSpecName: "kube-api-access-kq9zd") pod "edc0d561-0cd1-4e24-bf24-150ee48481c6" (UID: "edc0d561-0cd1-4e24-bf24-150ee48481c6"). InnerVolumeSpecName "kube-api-access-kq9zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:22:52.026803 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.026772    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq9zd\" (UniqueName: \"kubernetes.io/projected/edc0d561-0cd1-4e24-bf24-150ee48481c6-kube-api-access-kq9zd\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:22:52.026803 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.026797    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc0d561-0cd1-4e24-bf24-150ee48481c6-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:22:52.026803 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.026807    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc0d561-0cd1-4e24-bf24-150ee48481c6-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:22:52.781405 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.781374    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"
Jul 08 23:22:52.781844 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.781408    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh" event={"ID":"edc0d561-0cd1-4e24-bf24-150ee48481c6","Type":"ContainerDied","Data":"4629c9c4234aa168c7c112d859c519ede8345378ffaa1db6611dc11868814802"}
Jul 08 23:22:52.781844 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.781467    2571 scope.go:117] "RemoveContainer" containerID="38c38bb214459ed49f354c5aa8ebded311c06be7115d61e4ba0c41652dabb01b"
Jul 08 23:22:52.802378 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.802351    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:22:52.805878 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:52.805851    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-0a82e7-74d6bcccfc-256bh"]
Jul 08 23:22:53.464251 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:22:53.464219    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc0d561-0cd1-4e24-bf24-150ee48481c6" path="/var/lib/kubelet/pods/edc0d561-0cd1-4e24-bf24-150ee48481c6/volumes"
Jul 08 23:23:34.146051 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.146015    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:23:34.146584 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.146204    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" podUID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" containerName="maas-api" containerID="cri-o://51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479" gracePeriod=30
Jul 08 23:23:34.395733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.395712    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:23:34.467399 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.467336    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") pod \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") "
Jul 08 23:23:34.467538 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.467415    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca\") pod \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") "
Jul 08 23:23:34.467538 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.467440    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52fgb\" (UniqueName: \"kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb\") pod \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\" (UID: \"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2\") "
Jul 08 23:23:34.467824 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.467799    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" (UID: "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:23:34.469399 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.469373    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" (UID: "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:23:34.469487 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.469433    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb" (OuterVolumeSpecName: "kube-api-access-52fgb") pod "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" (UID: "30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2"). InnerVolumeSpecName "kube-api-access-52fgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:23:34.568512 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.568482    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:23:34.568512 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.568509    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52fgb\" (UniqueName: \"kubernetes.io/projected/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-kube-api-access-52fgb\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:23:34.568512 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.568519    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:23:34.970987 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.970951    2571 generic.go:356] "Generic (PLEG): container finished" podID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" containerID="51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479" exitCode=0
Jul 08 23:23:34.971145 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.971004    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"
Jul 08 23:23:34.971145 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.971045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" event={"ID":"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2","Type":"ContainerDied","Data":"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"}
Jul 08 23:23:34.971145 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.971098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt" event={"ID":"30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2","Type":"ContainerDied","Data":"c87d3d8080ad200cfd0065af95726cca811ea2f64e9388c3c34832b0ecd20ed0"}
Jul 08 23:23:34.971145 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.971120    2571 scope.go:117] "RemoveContainer" containerID="51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"
Jul 08 23:23:34.979747 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.979728    2571 scope.go:117] "RemoveContainer" containerID="51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"
Jul 08 23:23:34.979999 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:23:34.979981    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479\": container with ID starting with 51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479 not found: ID does not exist" containerID="51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"
Jul 08 23:23:34.980051 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.980007    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479"} err="failed to get container status \"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479\": rpc error: code = NotFound desc = could not find container \"51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479\": container with ID starting with 51ecac9c35d0bd11d5fac5310e76b144b7700600d00274a2b60de0fe276e6479 not found: ID does not exist"
Jul 08 23:23:34.991410 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.991384    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:23:34.997393 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:34.997374    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a78f59-d4dc54dc9-dz6rt"]
Jul 08 23:23:35.464373 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:35.464341    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" path="/var/lib/kubelet/pods/30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2/volumes"
Jul 08 23:23:43.708054 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708025    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708358    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc0d561-0cd1-4e24-bf24-150ee48481c6" containerName="maas-api"
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708369    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc0d561-0cd1-4e24-bf24-150ee48481c6" containerName="maas-api"
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708389    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" containerName="maas-api"
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708395    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" containerName="maas-api"
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708458    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc0d561-0cd1-4e24-bf24-150ee48481c6" containerName="maas-api"
Jul 08 23:23:43.708492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.708469    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ae5d0f-b594-44ac-9a1a-e5a4e4a513d2" containerName="maas-api"
Jul 08 23:23:43.712824 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.712803    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.716635 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.716607    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 23:23:43.717718 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.717699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 23:23:43.717718 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.717717    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a50ce6-serving-cert\""
Jul 08 23:23:43.717879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.717706    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 23:23:43.730856 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.730833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:23:43.742001 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.741982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.742142 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.742021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7l9\" (UniqueName: \"kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.742142 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.742118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.842749 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.842719    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.842947 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.842779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.842947 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:23:43.842872    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-serving-cert: secret "maas-api-e2e-api-a-a50ce6-serving-cert" not found
Jul 08 23:23:43.842947 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.842876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7l9\" (UniqueName: \"kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.842947 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:23:43.842941    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls podName:846d029a-722e-4a24-b71f-c90a48db6940 nodeName:}" failed. No retries permitted until 2026-07-08 23:23:44.342920792 +0000 UTC m=+2195.943751920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls") pod "maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" (UID: "846d029a-722e-4a24-b71f-c90a48db6940") : secret "maas-api-e2e-api-a-a50ce6-serving-cert" not found
Jul 08 23:23:43.843382 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.843362    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:43.854639 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:43.854616    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7l9\" (UniqueName: \"kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:44.346844 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:44.346806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:44.349316 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:44.349295    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") pod \"maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:44.623506 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:44.623419    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:44.756514 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:44.756492    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:23:44.758415 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:23:44.758389    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846d029a_722e_4a24_b71f_c90a48db6940.slice/crio-fa0c8a82a453c2936210262d6d1aeb023973b5b0c9bbc4ed27ee6082eef279b6 WatchSource:0}: Error finding container fa0c8a82a453c2936210262d6d1aeb023973b5b0c9bbc4ed27ee6082eef279b6: Status 404 returned error can't find the container with id fa0c8a82a453c2936210262d6d1aeb023973b5b0c9bbc4ed27ee6082eef279b6
Jul 08 23:23:45.017850 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:45.017815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" event={"ID":"846d029a-722e-4a24-b71f-c90a48db6940","Type":"ContainerStarted","Data":"fa0c8a82a453c2936210262d6d1aeb023973b5b0c9bbc4ed27ee6082eef279b6"}
Jul 08 23:23:46.023945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:46.023907    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" event={"ID":"846d029a-722e-4a24-b71f-c90a48db6940","Type":"ContainerStarted","Data":"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"}
Jul 08 23:23:46.024401 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:46.024041    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:46.044846 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:46.044806    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" podStartSLOduration=2.607823916 podStartE2EDuration="3.044793282s" totalImagesPullingTime="436.969366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:23:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:23:46.0432513 +0000 UTC m=+2197.644082441" watchObservedRunningTime="2026-07-08 23:23:46.044793282 +0000 UTC m=+2197.645624421"
Jul 08 23:23:51.585638 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.585599    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:23:51.589201 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.589183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.591888 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.591870    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-52eefd-serving-cert\""
Jul 08 23:23:51.601580 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.601554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:23:51.708159 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.708127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfkl\" (UniqueName: \"kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.708303 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.708181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.708303 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.708232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.808826 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.808797    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfkl\" (UniqueName: \"kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.808972 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.808852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.808972 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.808883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.809585 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.809560    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.811332 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.811299    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.816484 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.816463    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfkl\" (UniqueName: \"kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl\") pod \"maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:51.902519 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:51.902481    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:52.033850 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:52.033827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:23:52.042486 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:52.042465    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:23:52.047540 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:23:52.047461    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab139f1d_b21c_4d4f_ba6f_35ece089d54d.slice/crio-7a0d85bbb6e0c2eacc5480d9371b9ab95ea43de0da627c873ce726a117b5b067 WatchSource:0}: Error finding container 7a0d85bbb6e0c2eacc5480d9371b9ab95ea43de0da627c873ce726a117b5b067: Status 404 returned error can't find the container with id 7a0d85bbb6e0c2eacc5480d9371b9ab95ea43de0da627c873ce726a117b5b067
Jul 08 23:23:52.053592 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:52.053572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" event={"ID":"ab139f1d-b21c-4d4f-ba6f-35ece089d54d","Type":"ContainerStarted","Data":"7a0d85bbb6e0c2eacc5480d9371b9ab95ea43de0da627c873ce726a117b5b067"}
Jul 08 23:23:53.060230 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:53.060194    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" event={"ID":"ab139f1d-b21c-4d4f-ba6f-35ece089d54d","Type":"ContainerStarted","Data":"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"}
Jul 08 23:23:53.060661 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:53.060328    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:23:53.078212 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:53.078168    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" podStartSLOduration=1.7130080890000001 podStartE2EDuration="2.07815517s" totalImagesPullingTime="365.147081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:23:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:23:53.076586526 +0000 UTC m=+2204.677417706" watchObservedRunningTime="2026-07-08 23:23:53.07815517 +0000 UTC m=+2204.678986309"
Jul 08 23:23:59.071385 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:23:59.071354    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:24:04.795699 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:04.789205    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:24:04.795699 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:04.789456    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" podUID="846d029a-722e-4a24-b71f-c90a48db6940" containerName="maas-api" containerID="cri-o://6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff" gracePeriod=30
Jul 08 23:24:05.049292 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.049231    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:24:05.114902 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.114874    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk7l9\" (UniqueName: \"kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9\") pod \"846d029a-722e-4a24-b71f-c90a48db6940\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") "
Jul 08 23:24:05.115069 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.114957    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca\") pod \"846d029a-722e-4a24-b71f-c90a48db6940\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") "
Jul 08 23:24:05.115069 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.115006    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") pod \"846d029a-722e-4a24-b71f-c90a48db6940\" (UID: \"846d029a-722e-4a24-b71f-c90a48db6940\") "
Jul 08 23:24:05.115322 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.115294    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "846d029a-722e-4a24-b71f-c90a48db6940" (UID: "846d029a-722e-4a24-b71f-c90a48db6940"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:24:05.117063 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.117039    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "846d029a-722e-4a24-b71f-c90a48db6940" (UID: "846d029a-722e-4a24-b71f-c90a48db6940"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:24:05.117387 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.117364    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9" (OuterVolumeSpecName: "kube-api-access-tk7l9") pod "846d029a-722e-4a24-b71f-c90a48db6940" (UID: "846d029a-722e-4a24-b71f-c90a48db6940"). InnerVolumeSpecName "kube-api-access-tk7l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:05.119017 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.118991    2571 generic.go:356] "Generic (PLEG): container finished" podID="846d029a-722e-4a24-b71f-c90a48db6940" containerID="6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff" exitCode=0
Jul 08 23:24:05.119118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.119024    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" event={"ID":"846d029a-722e-4a24-b71f-c90a48db6940","Type":"ContainerDied","Data":"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"}
Jul 08 23:24:05.119118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.119046    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"
Jul 08 23:24:05.119118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.119080    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5" event={"ID":"846d029a-722e-4a24-b71f-c90a48db6940","Type":"ContainerDied","Data":"fa0c8a82a453c2936210262d6d1aeb023973b5b0c9bbc4ed27ee6082eef279b6"}
Jul 08 23:24:05.119118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.119104    2571 scope.go:117] "RemoveContainer" containerID="6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"
Jul 08 23:24:05.133948 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.133932    2571 scope.go:117] "RemoveContainer" containerID="6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"
Jul 08 23:24:05.134193 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:05.134176    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff\": container with ID starting with 6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff not found: ID does not exist" containerID="6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"
Jul 08 23:24:05.134231 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.134201    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff"} err="failed to get container status \"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff\": rpc error: code = NotFound desc = could not find container \"6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff\": container with ID starting with 6a97bf42e7c4f25d5b7e2bacbb3445890931fdaa13e2616dd7ed1cecdad550ff not found: ID does not exist"
Jul 08 23:24:05.144196 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.144178    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:24:05.148591 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.148572    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a50ce6-f94788c4f-vgjw5"]
Jul 08 23:24:05.216202 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.216177    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/846d029a-722e-4a24-b71f-c90a48db6940-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:05.216202 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.216204    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/846d029a-722e-4a24-b71f-c90a48db6940-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:05.216358 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.216217    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk7l9\" (UniqueName: \"kubernetes.io/projected/846d029a-722e-4a24-b71f-c90a48db6940-kube-api-access-tk7l9\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:05.469856 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:05.469817    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="846d029a-722e-4a24-b71f-c90a48db6940" path="/var/lib/kubelet/pods/846d029a-722e-4a24-b71f-c90a48db6940/volumes"
Jul 08 23:24:11.268640 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.268604    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:24:11.269128 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.268864    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" podUID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" containerName="maas-api" containerID="cri-o://9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4" gracePeriod=30
Jul 08 23:24:11.528004 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.527946    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:24:11.668623 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.668585    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcfkl\" (UniqueName: \"kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl\") pod \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") "
Jul 08 23:24:11.668623 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.668623    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca\") pod \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") "
Jul 08 23:24:11.668864 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.668718    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls\") pod \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\" (UID: \"ab139f1d-b21c-4d4f-ba6f-35ece089d54d\") "
Jul 08 23:24:11.669073 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.669050    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab139f1d-b21c-4d4f-ba6f-35ece089d54d" (UID: "ab139f1d-b21c-4d4f-ba6f-35ece089d54d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:24:11.670834 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.670810    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl" (OuterVolumeSpecName: "kube-api-access-jcfkl") pod "ab139f1d-b21c-4d4f-ba6f-35ece089d54d" (UID: "ab139f1d-b21c-4d4f-ba6f-35ece089d54d"). InnerVolumeSpecName "kube-api-access-jcfkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:24:11.670893 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.670819    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab139f1d-b21c-4d4f-ba6f-35ece089d54d" (UID: "ab139f1d-b21c-4d4f-ba6f-35ece089d54d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:24:11.769456 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.769407    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcfkl\" (UniqueName: \"kubernetes.io/projected/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-kube-api-access-jcfkl\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:11.769456 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.769449    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:11.769456 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:11.769459    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab139f1d-b21c-4d4f-ba6f-35ece089d54d-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:24:12.153930 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.153899    2571 generic.go:356] "Generic (PLEG): container finished" podID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" containerID="9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4" exitCode=0
Jul 08 23:24:12.154089 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.153941    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"
Jul 08 23:24:12.154089 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.153995    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" event={"ID":"ab139f1d-b21c-4d4f-ba6f-35ece089d54d","Type":"ContainerDied","Data":"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"}
Jul 08 23:24:12.154089 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.154043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc" event={"ID":"ab139f1d-b21c-4d4f-ba6f-35ece089d54d","Type":"ContainerDied","Data":"7a0d85bbb6e0c2eacc5480d9371b9ab95ea43de0da627c873ce726a117b5b067"}
Jul 08 23:24:12.154089 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.154068    2571 scope.go:117] "RemoveContainer" containerID="9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"
Jul 08 23:24:12.163044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.163026    2571 scope.go:117] "RemoveContainer" containerID="9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"
Jul 08 23:24:12.163289 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:12.163269    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4\": container with ID starting with 9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4 not found: ID does not exist" containerID="9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"
Jul 08 23:24:12.163346 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.163302    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4"} err="failed to get container status \"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4\": rpc error: code = NotFound desc = could not find container \"9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4\": container with ID starting with 9b5937f8468088da69f6d28b31f56aee824f00495b7557841dfdbb915ed0cef4 not found: ID does not exist"
Jul 08 23:24:12.175004 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.174979    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:24:12.176490 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:12.176469    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-52eefd-74fb98c5fc-q5ngc"]
Jul 08 23:24:13.464032 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:13.464001    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" path="/var/lib/kubelet/pods/ab139f1d-b21c-4d4f-ba6f-35ece089d54d/volumes"
Jul 08 23:24:20.773474 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773444    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773785    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="846d029a-722e-4a24-b71f-c90a48db6940" containerName="maas-api"
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773797    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="846d029a-722e-4a24-b71f-c90a48db6940" containerName="maas-api"
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773814    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" containerName="maas-api"
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773820    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" containerName="maas-api"
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773886    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="846d029a-722e-4a24-b71f-c90a48db6940" containerName="maas-api"
Jul 08 23:24:20.773945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.773898    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab139f1d-b21c-4d4f-ba6f-35ece089d54d" containerName="maas-api"
Jul 08 23:24:20.776862 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.776843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:20.779655 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.779630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 23:24:20.779777 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.779742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wcbsn\""
Jul 08 23:24:20.780905 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.780885    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-77dfb5-serving-cert\""
Jul 08 23:24:20.781008 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.780935    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 23:24:20.786224 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.786200    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:24:20.949793 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.949752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:20.949793 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.949788    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:20.950043 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:20.949822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bdm\" (UniqueName: \"kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.050819 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.050733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bdm\" (UniqueName: \"kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.050966 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.050855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.050966 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.050885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.051036 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:21.050989    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-serving-cert: secret "maas-api-e2e-shared-a-77dfb5-serving-cert" not found
Jul 08 23:24:21.051070 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:21.051062    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls podName:a0120103-6e7d-4b13-978a-7d67a01b81e8 nodeName:}" failed. No retries permitted until 2026-07-08 23:24:21.551047273 +0000 UTC m=+2233.151878391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls") pod "maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" (UID: "a0120103-6e7d-4b13-978a-7d67a01b81e8") : secret "maas-api-e2e-shared-a-77dfb5-serving-cert" not found
Jul 08 23:24:21.051641 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.051619    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.060893 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.060868    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bdm\" (UniqueName: \"kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.556524 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.556483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.558968 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.558950    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") pod \"maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.688911 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.688875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:21.818112 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:21.818043    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:24:21.820339 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:24:21.820313    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0120103_6e7d_4b13_978a_7d67a01b81e8.slice/crio-8ea2ddad72e87bc90b57d6542887efd08c354b480c028dd1e35a8b2cd9d05d37 WatchSource:0}: Error finding container 8ea2ddad72e87bc90b57d6542887efd08c354b480c028dd1e35a8b2cd9d05d37: Status 404 returned error can't find the container with id 8ea2ddad72e87bc90b57d6542887efd08c354b480c028dd1e35a8b2cd9d05d37
Jul 08 23:24:22.204724 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:22.204694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" event={"ID":"a0120103-6e7d-4b13-978a-7d67a01b81e8","Type":"ContainerStarted","Data":"8ea2ddad72e87bc90b57d6542887efd08c354b480c028dd1e35a8b2cd9d05d37"}
Jul 08 23:24:23.210539 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:23.210501    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" event={"ID":"a0120103-6e7d-4b13-978a-7d67a01b81e8","Type":"ContainerStarted","Data":"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"}
Jul 08 23:24:23.210942 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:23.210576    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:23.230266 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:23.230211    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" podStartSLOduration=2.8756233780000002 podStartE2EDuration="3.230195926s" totalImagesPullingTime="354.572548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:24:23.227599777 +0000 UTC m=+2234.828430929" watchObservedRunningTime="2026-07-08 23:24:23.230195926 +0000 UTC m=+2234.831027068"
Jul 08 23:24:28.904787 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:28.904751    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:24:28.913730 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:28.913702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:28.916564 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:28.916349    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5b1175-serving-cert\""
Jul 08 23:24:28.917761 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:28.917733    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:24:29.023905 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.023864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.023905 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.023898    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp42h\" (UniqueName: \"kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.024153 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.023928    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.124449 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.124419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.124449 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.124453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp42h\" (UniqueName: \"kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.124721 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.124478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.124721 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:29.124591    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-serving-cert: secret "maas-api-e2e-shared-b-5b1175-serving-cert" not found
Jul 08 23:24:29.124721 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:24:29.124648    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls podName:6864e861-9cee-4d04-b99d-42d483cf9525 nodeName:}" failed. No retries permitted until 2026-07-08 23:24:29.624631058 +0000 UTC m=+2241.225462198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls") pod "maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" (UID: "6864e861-9cee-4d04-b99d-42d483cf9525") : secret "maas-api-e2e-shared-b-5b1175-serving-cert" not found
Jul 08 23:24:29.125187 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.125169    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.132941 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.132910    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp42h\" (UniqueName: \"kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.222159 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.222075    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:24:29.628174 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.628074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.630728 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.630704    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") pod \"maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.826988 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.826954    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:29.960422 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:29.960395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:24:29.962885 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:24:29.962857    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6864e861_9cee_4d04_b99d_42d483cf9525.slice/crio-94c16e32c99aaa9b21b718655db91a1418b6be3b9c2912f377ca3d9b663fac40 WatchSource:0}: Error finding container 94c16e32c99aaa9b21b718655db91a1418b6be3b9c2912f377ca3d9b663fac40: Status 404 returned error can't find the container with id 94c16e32c99aaa9b21b718655db91a1418b6be3b9c2912f377ca3d9b663fac40
Jul 08 23:24:30.244742 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:30.244641    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" event={"ID":"6864e861-9cee-4d04-b99d-42d483cf9525","Type":"ContainerStarted","Data":"94c16e32c99aaa9b21b718655db91a1418b6be3b9c2912f377ca3d9b663fac40"}
Jul 08 23:24:31.251144 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:31.251054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" event={"ID":"6864e861-9cee-4d04-b99d-42d483cf9525","Type":"ContainerStarted","Data":"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"}
Jul 08 23:24:31.251144 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:31.251132    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:24:31.269674 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:31.269604    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" podStartSLOduration=2.940304504 podStartE2EDuration="3.269587787s" totalImagesPullingTime="329.283283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:24:31.268570135 +0000 UTC m=+2242.869401275" watchObservedRunningTime="2026-07-08 23:24:31.269587787 +0000 UTC m=+2242.870418926"
Jul 08 23:24:37.260902 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:24:37.260874    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:27:09.490085 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:27:09.490055    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:27:09.497106 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:27:09.497087    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:28:11.678340 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.678306    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:28:11.681581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.681564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.685513 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.685490    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"sub-test-model-5b1175-kserve-self-signed-certs\""
Jul 08 23:28:11.685624 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.685490    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"openshift-service-ca.crt\""
Jul 08 23:28:11.685624 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.685535    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"kube-root-ca.crt\""
Jul 08 23:28:11.685624 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.685496    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5b1175\"/\"default-dockercfg-4z8gf\""
Jul 08 23:28:11.689425 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.689549 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689449    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.689549 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689474    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.689549 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689503    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.689549 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.689796 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.689566    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbt26\" (UniqueName: \"kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.692473 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.692451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:28:11.790581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790550    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.790581 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbt26\" (UniqueName: \"kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.790854 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790637    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.790854 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.790854 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790687    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.791001 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.790893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.791066 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.791047    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.791118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.791087    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.791231 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.791207    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.792885 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.792857    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.793119 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.793102    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.798238 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.798219    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbt26\" (UniqueName: \"kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26\") pod \"sub-test-model-5b1175-kserve-769cc86f7-4xz5z\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") " pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:11.992028 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:11.991940    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:12.125161 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:12.125133    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:28:12.127349 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:28:12.127316    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7261723c_08ee_4fe3_be00_1299671e713f.slice/crio-4bc49c79e529409c528ee59c9543bdee98fd692a32fdee919cd6adab757f6420 WatchSource:0}: Error finding container 4bc49c79e529409c528ee59c9543bdee98fd692a32fdee919cd6adab757f6420: Status 404 returned error can't find the container with id 4bc49c79e529409c528ee59c9543bdee98fd692a32fdee919cd6adab757f6420
Jul 08 23:28:12.283935 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:12.283838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" event={"ID":"7261723c-08ee-4fe3-be00-1299671e713f","Type":"ContainerStarted","Data":"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"}
Jul 08 23:28:12.283935 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:12.283882    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" event={"ID":"7261723c-08ee-4fe3-be00-1299671e713f","Type":"ContainerStarted","Data":"4bc49c79e529409c528ee59c9543bdee98fd692a32fdee919cd6adab757f6420"}
Jul 08 23:28:12.304295 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:12.304242    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" podStartSLOduration=1.304226158 podStartE2EDuration="1.304226158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:28:12.302518082 +0000 UTC m=+2463.903349258" watchObservedRunningTime="2026-07-08 23:28:12.304226158 +0000 UTC m=+2463.905057345"
Jul 08 23:28:21.992939 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:21.992892    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:21.993447 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:21.992980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:22.005223 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:22.005199    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:28:22.346319 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:28:22.346245    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:29:19.363717 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:19.363627    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:29:34.385225 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.385159    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" podUID="7261723c-08ee-4fe3-be00-1299671e713f" containerName="main" containerID="cri-o://50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28" gracePeriod=45
Jul 08 23:29:34.643415 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.643393    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:29:34.668963 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.668936    2571 generic.go:356] "Generic (PLEG): container finished" podID="7261723c-08ee-4fe3-be00-1299671e713f" containerID="50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28" exitCode=0
Jul 08 23:29:34.668963 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.668971    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" event={"ID":"7261723c-08ee-4fe3-be00-1299671e713f","Type":"ContainerDied","Data":"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"}
Jul 08 23:29:34.669166 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.668977    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"
Jul 08 23:29:34.669166 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.669004    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z" event={"ID":"7261723c-08ee-4fe3-be00-1299671e713f","Type":"ContainerDied","Data":"4bc49c79e529409c528ee59c9543bdee98fd692a32fdee919cd6adab757f6420"}
Jul 08 23:29:34.669166 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.669021    2571 scope.go:117] "RemoveContainer" containerID="50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"
Jul 08 23:29:34.677202 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.677181    2571 scope.go:117] "RemoveContainer" containerID="50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"
Jul 08 23:29:34.677469 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:29:34.677450    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28\": container with ID starting with 50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28 not found: ID does not exist" containerID="50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"
Jul 08 23:29:34.677519 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.677478    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28"} err="failed to get container status \"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28\": rpc error: code = NotFound desc = could not find container \"50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28\": container with ID starting with 50e342f34f1bbd1e60174bbe08f8bc675c8c154cdd9760bc6fca4e2b16506f28 not found: ID does not exist"
Jul 08 23:29:34.679755 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679738    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.679837 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679777    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.679837 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679817    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.679914 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbt26\" (UniqueName: \"kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.679914 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679879    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.680012 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.679940    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home\") pod \"7261723c-08ee-4fe3-be00-1299671e713f\" (UID: \"7261723c-08ee-4fe3-be00-1299671e713f\") "
Jul 08 23:29:34.680064 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.680035    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:29:34.680245 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.680223    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-tmp-dir\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.680329 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.680248    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home" (OuterVolumeSpecName: "home") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:29:34.680329 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.680262    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:29:34.681946 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.681924    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm" (OuterVolumeSpecName: "dshm") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 23:29:34.682336 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.682315    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:29:34.682336 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.682328    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26" (OuterVolumeSpecName: "kube-api-access-qbt26") pod "7261723c-08ee-4fe3-be00-1299671e713f" (UID: "7261723c-08ee-4fe3-be00-1299671e713f"). InnerVolumeSpecName "kube-api-access-qbt26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:29:34.780961 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.780933    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-home\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.780961 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.780959    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7261723c-08ee-4fe3-be00-1299671e713f-tls-certs\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.780961 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.780968    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-dshm\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.781198 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.780977    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbt26\" (UniqueName: \"kubernetes.io/projected/7261723c-08ee-4fe3-be00-1299671e713f-kube-api-access-qbt26\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.781198 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.780985    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7261723c-08ee-4fe3-be00-1299671e713f-model-cache\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:29:34.989945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.989917    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:29:34.993437 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:34.993410    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5b1175/sub-test-model-5b1175-kserve-769cc86f7-4xz5z"]
Jul 08 23:29:35.464826 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:29:35.464797    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7261723c-08ee-4fe3-be00-1299671e713f" path="/var/lib/kubelet/pods/7261723c-08ee-4fe3-be00-1299671e713f/volumes"
Jul 08 23:30:00.132724 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.132665    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:30:00.133332 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.133048    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7261723c-08ee-4fe3-be00-1299671e713f" containerName="main"
Jul 08 23:30:00.133332 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.133059    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7261723c-08ee-4fe3-be00-1299671e713f" containerName="main"
Jul 08 23:30:00.133332 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.133116    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7261723c-08ee-4fe3-be00-1299671e713f" containerName="main"
Jul 08 23:30:00.135950 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.135932    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:30:00.136082 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.136061    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:30:00.138904 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.138881    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:30:00.139025 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.138998    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:30:00.142153 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.142133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:30:00.145715 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.144414    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:30:00.147011 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.146993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:30:00.149375 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.149351    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:30:00.286828 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.286783    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfb4\" (UniqueName: \"kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4\") pod \"maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv\" (UID: \"258e717e-235a-4b7c-bf0f-4ca8d8319d1f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:30:00.286828 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.286829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lnd\" (UniqueName: \"kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd\") pod \"maas-api-key-cleanup-29725890-dfkz5\" (UID: \"e0f4a211-1525-40f6-abc2-596f1896161f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:30:00.287036 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.286848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjg9g\" (UniqueName: \"kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g\") pod \"maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c\" (UID: \"81a1a46b-2417-4957-a32f-57c253c768e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:30:00.387856 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.387830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfb4\" (UniqueName: \"kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4\") pod \"maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv\" (UID: \"258e717e-235a-4b7c-bf0f-4ca8d8319d1f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:30:00.388027 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.387864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lnd\" (UniqueName: \"kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd\") pod \"maas-api-key-cleanup-29725890-dfkz5\" (UID: \"e0f4a211-1525-40f6-abc2-596f1896161f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:30:00.388027 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.387884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjg9g\" (UniqueName: \"kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g\") pod \"maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c\" (UID: \"81a1a46b-2417-4957-a32f-57c253c768e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:30:00.396446 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.396420    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfb4\" (UniqueName: \"kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4\") pod \"maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv\" (UID: \"258e717e-235a-4b7c-bf0f-4ca8d8319d1f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:30:00.396577 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.396462    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lnd\" (UniqueName: \"kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd\") pod \"maas-api-key-cleanup-29725890-dfkz5\" (UID: \"e0f4a211-1525-40f6-abc2-596f1896161f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:30:00.396635 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.396588    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjg9g\" (UniqueName: \"kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g\") pod \"maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c\" (UID: \"81a1a46b-2417-4957-a32f-57c253c768e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:30:00.449723 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.449693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:30:00.459627 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.459607    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:30:00.468300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.468280    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:30:00.603447 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.602628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:30:00.605954 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:30:00.605910    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a1a46b_2417_4957_a32f_57c253c768e6.slice/crio-47cf4bcd6be6b1451e9877a07fd7ab9fa6850d9306c5e323c0a768becb1ed524 WatchSource:0}: Error finding container 47cf4bcd6be6b1451e9877a07fd7ab9fa6850d9306c5e323c0a768becb1ed524: Status 404 returned error can't find the container with id 47cf4bcd6be6b1451e9877a07fd7ab9fa6850d9306c5e323c0a768becb1ed524
Jul 08 23:30:00.793698 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.793652    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" event={"ID":"81a1a46b-2417-4957-a32f-57c253c768e6","Type":"ContainerStarted","Data":"47cf4bcd6be6b1451e9877a07fd7ab9fa6850d9306c5e323c0a768becb1ed524"}
Jul 08 23:30:00.840606 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.840581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:30:00.842479 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:00.842451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:30:00.842772 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:30:00.842743    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258e717e_235a_4b7c_bf0f_4ca8d8319d1f.slice/crio-3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761 WatchSource:0}: Error finding container 3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761: Status 404 returned error can't find the container with id 3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761
Jul 08 23:30:00.843212 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:30:00.843191    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f4a211_1525_40f6_abc2_596f1896161f.slice/crio-67e1bda9c5aace193917faa01390c82b391ecdc80a0be5d667476cc6bc1ccbef WatchSource:0}: Error finding container 67e1bda9c5aace193917faa01390c82b391ecdc80a0be5d667476cc6bc1ccbef: Status 404 returned error can't find the container with id 67e1bda9c5aace193917faa01390c82b391ecdc80a0be5d667476cc6bc1ccbef
Jul 08 23:30:01.799960 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.799923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" event={"ID":"81a1a46b-2417-4957-a32f-57c253c768e6","Type":"ContainerStarted","Data":"163ce849e5010240b3fce8cb8953d4e9f1e44d8343976d73c7812d54fb252cd5"}
Jul 08 23:30:01.801421 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.801394    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" event={"ID":"e0f4a211-1525-40f6-abc2-596f1896161f","Type":"ContainerStarted","Data":"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"}
Jul 08 23:30:01.801544 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.801435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" event={"ID":"e0f4a211-1525-40f6-abc2-596f1896161f","Type":"ContainerStarted","Data":"67e1bda9c5aace193917faa01390c82b391ecdc80a0be5d667476cc6bc1ccbef"}
Jul 08 23:30:01.802831 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.802810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" event={"ID":"258e717e-235a-4b7c-bf0f-4ca8d8319d1f","Type":"ContainerStarted","Data":"8b87987ade00351f7eec0ec646e0a0dc9176e7bb7509b63e692f3637acece4b2"}
Jul 08 23:30:01.802907 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.802845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" event={"ID":"258e717e-235a-4b7c-bf0f-4ca8d8319d1f","Type":"ContainerStarted","Data":"3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761"}
Jul 08 23:30:01.817296 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.817246    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" podStartSLOduration=1.817234516 podStartE2EDuration="1.817234516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:30:01.816270988 +0000 UTC m=+2573.417102129" watchObservedRunningTime="2026-07-08 23:30:01.817234516 +0000 UTC m=+2573.418065655"
Jul 08 23:30:01.829573 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.829529    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" podStartSLOduration=1.829513462 podStartE2EDuration="1.829513462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:30:01.829270633 +0000 UTC m=+2573.430101775" watchObservedRunningTime="2026-07-08 23:30:01.829513462 +0000 UTC m=+2573.430344603"
Jul 08 23:30:01.843623 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:01.843584    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" podStartSLOduration=1.843573005 podStartE2EDuration="1.843573005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:30:01.842694406 +0000 UTC m=+2573.443525538" watchObservedRunningTime="2026-07-08 23:30:01.843573005 +0000 UTC m=+2573.444404144"
Jul 08 23:30:58.036321 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.036286    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7578-140502206211328"]
Jul 08 23:30:58.039482 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.039465    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:30:58.042053 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.042025    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-njm98\""
Jul 08 23:30:58.045090 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.045068    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140502206211328"]
Jul 08 23:30:58.167859 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.167824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69496\" (UniqueName: \"kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496\") pod \"test-curl-7578-140502206211328\" (UID: \"941685cb-d66b-464a-8853-f7a9160429d8\") " pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:30:58.268788 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.268750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69496\" (UniqueName: \"kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496\") pod \"test-curl-7578-140502206211328\" (UID: \"941685cb-d66b-464a-8853-f7a9160429d8\") " pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:30:58.277171 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.277141    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69496\" (UniqueName: \"kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496\") pod \"test-curl-7578-140502206211328\" (UID: \"941685cb-d66b-464a-8853-f7a9160429d8\") " pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:30:58.349153 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.349082    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:30:58.473070 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.473017    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7578-140502206211328"]
Jul 08 23:30:58.475367 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:30:58.475328    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod941685cb_d66b_464a_8853_f7a9160429d8.slice/crio-cdebff996d9db02febabf1567747e678c81a4606f43914d91b580fa17bafb49f WatchSource:0}: Error finding container cdebff996d9db02febabf1567747e678c81a4606f43914d91b580fa17bafb49f: Status 404 returned error can't find the container with id cdebff996d9db02febabf1567747e678c81a4606f43914d91b580fa17bafb49f
Jul 08 23:30:58.476610 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:58.476592    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 23:30:59.088129 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:30:59.088092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140502206211328" event={"ID":"941685cb-d66b-464a-8853-f7a9160429d8","Type":"ContainerStarted","Data":"cdebff996d9db02febabf1567747e678c81a4606f43914d91b580fa17bafb49f"}
Jul 08 23:31:00.011736 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.011704    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:31:00.012118 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.011936    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" podUID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" containerName="cleanup" containerID="cri-o://8b87987ade00351f7eec0ec646e0a0dc9176e7bb7509b63e692f3637acece4b2" gracePeriod=30
Jul 08 23:31:00.014391 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.014371    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:31:00.014574 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.014532    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" podUID="81a1a46b-2417-4957-a32f-57c253c768e6" containerName="cleanup" containerID="cri-o://163ce849e5010240b3fce8cb8953d4e9f1e44d8343976d73c7812d54fb252cd5" gracePeriod=30
Jul 08 23:31:00.015972 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.015954    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:31:00.016117 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.016100    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" podUID="e0f4a211-1525-40f6-abc2-596f1896161f" containerName="cleanup" containerID="cri-o://227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0" gracePeriod=30
Jul 08 23:31:00.093622 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.093590    2571 generic.go:356] "Generic (PLEG): container finished" podID="941685cb-d66b-464a-8853-f7a9160429d8" containerID="744201a2fee8ad420f4f467bd0822ad69c652338367a52c00da77fd306d4fb3a" exitCode=6
Jul 08 23:31:00.094024 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:00.093674    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7578-140502206211328" event={"ID":"941685cb-d66b-464a-8853-f7a9160429d8","Type":"ContainerDied","Data":"744201a2fee8ad420f4f467bd0822ad69c652338367a52c00da77fd306d4fb3a"}
Jul 08 23:31:01.238763 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.238735    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:31:01.274593 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.274562    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7578-140502206211328_941685cb-d66b-464a-8853-f7a9160429d8/test-curl-7578-140502206211328/0.log"
Jul 08 23:31:01.295610 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.295572    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7578-140502206211328"]
Jul 08 23:31:01.301229 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.301202    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7578-140502206211328"]
Jul 08 23:31:01.397201 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.397172    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69496\" (UniqueName: \"kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496\") pod \"941685cb-d66b-464a-8853-f7a9160429d8\" (UID: \"941685cb-d66b-464a-8853-f7a9160429d8\") "
Jul 08 23:31:01.399315 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.399289    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496" (OuterVolumeSpecName: "kube-api-access-69496") pod "941685cb-d66b-464a-8853-f7a9160429d8" (UID: "941685cb-d66b-464a-8853-f7a9160429d8"). InnerVolumeSpecName "kube-api-access-69496". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:01.455923 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.455889    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7578-140502206236112"]
Jul 08 23:31:01.456273 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.456260    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941685cb-d66b-464a-8853-f7a9160429d8" containerName="test-curl-7578-140502206211328"
Jul 08 23:31:01.456314 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.456274    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="941685cb-d66b-464a-8853-f7a9160429d8" containerName="test-curl-7578-140502206211328"
Jul 08 23:31:01.456360 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.456350    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="941685cb-d66b-464a-8853-f7a9160429d8" containerName="test-curl-7578-140502206211328"
Jul 08 23:31:01.459300 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.459278    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:01.461909 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.461891    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nwz8z\""
Jul 08 23:31:01.467233 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.467206    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941685cb-d66b-464a-8853-f7a9160429d8" path="/var/lib/kubelet/pods/941685cb-d66b-464a-8853-f7a9160429d8/volumes"
Jul 08 23:31:01.467644 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.467605    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7578-140502206236112"]
Jul 08 23:31:01.497715 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.497664    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69496\" (UniqueName: \"kubernetes.io/projected/941685cb-d66b-464a-8853-f7a9160429d8-kube-api-access-69496\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:01.599056 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.599022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhd2j\" (UniqueName: \"kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j\") pod \"test-curl-7578-140502206236112\" (UID: \"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f\") " pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:01.700099 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.700019    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhd2j\" (UniqueName: \"kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j\") pod \"test-curl-7578-140502206236112\" (UID: \"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f\") " pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:01.707789 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.707768    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhd2j\" (UniqueName: \"kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j\") pod \"test-curl-7578-140502206236112\" (UID: \"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f\") " pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:01.770001 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.769972    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:01.894665 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:01.894637    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7578-140502206236112"]
Jul 08 23:31:01.896495 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:31:01.896466    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd70ed4_fb83_4e11_b26a_435a1dc74d0f.slice/crio-a64dcc9f69889b403bc0f3375234d0c8130a3df2924eaa50bc76cbf7e2b8ab66 WatchSource:0}: Error finding container a64dcc9f69889b403bc0f3375234d0c8130a3df2924eaa50bc76cbf7e2b8ab66: Status 404 returned error can't find the container with id a64dcc9f69889b403bc0f3375234d0c8130a3df2924eaa50bc76cbf7e2b8ab66
Jul 08 23:31:02.105474 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:02.105376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112" event={"ID":"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f","Type":"ContainerStarted","Data":"a64dcc9f69889b403bc0f3375234d0c8130a3df2924eaa50bc76cbf7e2b8ab66"}
Jul 08 23:31:02.106579 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:02.106565    2571 scope.go:117] "RemoveContainer" containerID="744201a2fee8ad420f4f467bd0822ad69c652338367a52c00da77fd306d4fb3a"
Jul 08 23:31:02.106666 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:02.106580    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7578-140502206211328"
Jul 08 23:31:03.114141 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:03.114106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112" event={"ID":"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f","Type":"ContainerStarted","Data":"7e47d78b4eab0dc25e9a2142df84ad56495f0e33913469c496a1b5c66c07c0b1"}
Jul 08 23:31:03.128107 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:03.128056    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112" podStartSLOduration=1.780746889 podStartE2EDuration="2.128040447s" totalImagesPullingTime="347.293558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:31:03.127875285 +0000 UTC m=+2634.728706426" watchObservedRunningTime="2026-07-08 23:31:03.128040447 +0000 UTC m=+2634.728871586"
Jul 08 23:31:13.160957 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:13.160920    2571 generic.go:356] "Generic (PLEG): container finished" podID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" containerID="7e47d78b4eab0dc25e9a2142df84ad56495f0e33913469c496a1b5c66c07c0b1" exitCode=28
Jul 08 23:31:13.161366 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:13.160995    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112" event={"ID":"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f","Type":"ContainerDied","Data":"7e47d78b4eab0dc25e9a2142df84ad56495f0e33913469c496a1b5c66c07c0b1"}
Jul 08 23:31:14.313409 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.313385    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:14.342335 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.342307    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7578-140502206236112"]
Jul 08 23:31:14.345972 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.345947    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7578-140502206236112"]
Jul 08 23:31:14.410729 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.410698    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhd2j\" (UniqueName: \"kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j\") pod \"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f\" (UID: \"bcd70ed4-fb83-4e11-b26a-435a1dc74d0f\") "
Jul 08 23:31:14.412810 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.412780    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j" (OuterVolumeSpecName: "kube-api-access-nhd2j") pod "bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" (UID: "bcd70ed4-fb83-4e11-b26a-435a1dc74d0f"). InnerVolumeSpecName "kube-api-access-nhd2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:14.511345 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:14.511308    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhd2j\" (UniqueName: \"kubernetes.io/projected/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f-kube-api-access-nhd2j\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:15.171816 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.171787    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:15.171989 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.171827    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a64dcc9f69889b403bc0f3375234d0c8130a3df2924eaa50bc76cbf7e2b8ab66"
Jul 08 23:31:15.181534 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:31:15.181507    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140502206236112\" is forbidden: User \"system:node:ip-10-0-128-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-128-122.ec2.internal' and this object" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:15.209691 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.209649    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:31:15.209871 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.209845    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" podUID="a0120103-6e7d-4b13-978a-7d67a01b81e8" containerName="maas-api" containerID="cri-o://ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1" gracePeriod=30
Jul 08 23:31:15.212065 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:31:15.212030    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7578-140502206236112\" is forbidden: User \"system:node:ip-10-0-128-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-128-122.ec2.internal' and this object" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" pod="odh-ai-gateway-infra/test-curl-7578-140502206236112"
Jul 08 23:31:15.465542 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.465454    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" path="/var/lib/kubelet/pods/bcd70ed4-fb83-4e11-b26a-435a1dc74d0f/volumes"
Jul 08 23:31:15.663912 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.663888    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:31:15.719486 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.719408    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5bdm\" (UniqueName: \"kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm\") pod \"a0120103-6e7d-4b13-978a-7d67a01b81e8\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") "
Jul 08 23:31:15.719486 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.719461    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") pod \"a0120103-6e7d-4b13-978a-7d67a01b81e8\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") "
Jul 08 23:31:15.719486 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.719480    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca\") pod \"a0120103-6e7d-4b13-978a-7d67a01b81e8\" (UID: \"a0120103-6e7d-4b13-978a-7d67a01b81e8\") "
Jul 08 23:31:15.719898 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.719875    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a0120103-6e7d-4b13-978a-7d67a01b81e8" (UID: "a0120103-6e7d-4b13-978a-7d67a01b81e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:31:15.721611 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.721584    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a0120103-6e7d-4b13-978a-7d67a01b81e8" (UID: "a0120103-6e7d-4b13-978a-7d67a01b81e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:31:15.721723 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.721627    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm" (OuterVolumeSpecName: "kube-api-access-v5bdm") pod "a0120103-6e7d-4b13-978a-7d67a01b81e8" (UID: "a0120103-6e7d-4b13-978a-7d67a01b81e8"). InnerVolumeSpecName "kube-api-access-v5bdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:15.820036 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.820004    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5bdm\" (UniqueName: \"kubernetes.io/projected/a0120103-6e7d-4b13-978a-7d67a01b81e8-kube-api-access-v5bdm\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:15.820036 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.820033    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a0120103-6e7d-4b13-978a-7d67a01b81e8-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:15.820036 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:15.820044    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a0120103-6e7d-4b13-978a-7d67a01b81e8-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:16.181172 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.181138    2571 generic.go:356] "Generic (PLEG): container finished" podID="a0120103-6e7d-4b13-978a-7d67a01b81e8" containerID="ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1" exitCode=0
Jul 08 23:31:16.181314 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.181180    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"
Jul 08 23:31:16.181314 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.181221    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" event={"ID":"a0120103-6e7d-4b13-978a-7d67a01b81e8","Type":"ContainerDied","Data":"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"}
Jul 08 23:31:16.181314 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.181272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq" event={"ID":"a0120103-6e7d-4b13-978a-7d67a01b81e8","Type":"ContainerDied","Data":"8ea2ddad72e87bc90b57d6542887efd08c354b480c028dd1e35a8b2cd9d05d37"}
Jul 08 23:31:16.181314 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.181297    2571 scope.go:117] "RemoveContainer" containerID="ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"
Jul 08 23:31:16.190429 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.190410    2571 scope.go:117] "RemoveContainer" containerID="ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"
Jul 08 23:31:16.190666 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:31:16.190647    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1\": container with ID starting with ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1 not found: ID does not exist" containerID="ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"
Jul 08 23:31:16.190818 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.190697    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1"} err="failed to get container status \"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1\": rpc error: code = NotFound desc = could not find container \"ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1\": container with ID starting with ca506de7478de1b74ed88958902aa39b81b636c92faa62be0d8d4807466fa8e1 not found: ID does not exist"
Jul 08 23:31:16.201956 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.201929    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:31:16.203759 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:16.203738    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-77dfb5-7b899f9fff-pl9cq"]
Jul 08 23:31:17.464302 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:17.464272    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0120103-6e7d-4b13-978a-7d67a01b81e8" path="/var/lib/kubelet/pods/a0120103-6e7d-4b13-978a-7d67a01b81e8/volumes"
Jul 08 23:31:22.485876 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.485841    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:31:22.486341 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.486090    2571 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" podUID="6864e861-9cee-4d04-b99d-42d483cf9525" containerName="maas-api" containerID="cri-o://42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6" gracePeriod=30
Jul 08 23:31:22.754843 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.754814    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:31:22.768611 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.768593    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") pod \"6864e861-9cee-4d04-b99d-42d483cf9525\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") "
Jul 08 23:31:22.768712 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.768641    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp42h\" (UniqueName: \"kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h\") pod \"6864e861-9cee-4d04-b99d-42d483cf9525\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") "
Jul 08 23:31:22.768790 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.768714    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca\") pod \"6864e861-9cee-4d04-b99d-42d483cf9525\" (UID: \"6864e861-9cee-4d04-b99d-42d483cf9525\") "
Jul 08 23:31:22.769096 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.769064    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6864e861-9cee-4d04-b99d-42d483cf9525" (UID: "6864e861-9cee-4d04-b99d-42d483cf9525"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 23:31:22.770630 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.770608    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6864e861-9cee-4d04-b99d-42d483cf9525" (UID: "6864e861-9cee-4d04-b99d-42d483cf9525"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 23:31:22.770748 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.770658    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h" (OuterVolumeSpecName: "kube-api-access-rp42h") pod "6864e861-9cee-4d04-b99d-42d483cf9525" (UID: "6864e861-9cee-4d04-b99d-42d483cf9525"). InnerVolumeSpecName "kube-api-access-rp42h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:22.869246 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.869218    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6864e861-9cee-4d04-b99d-42d483cf9525-maas-api-tls\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:22.869246 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.869244    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp42h\" (UniqueName: \"kubernetes.io/projected/6864e861-9cee-4d04-b99d-42d483cf9525-kube-api-access-rp42h\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:22.869246 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:22.869254    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6864e861-9cee-4d04-b99d-42d483cf9525-openshift-service-ca\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:23.224297 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.224264    2571 generic.go:356] "Generic (PLEG): container finished" podID="6864e861-9cee-4d04-b99d-42d483cf9525" containerID="42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6" exitCode=0
Jul 08 23:31:23.224464 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.224309    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"
Jul 08 23:31:23.224464 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.224312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" event={"ID":"6864e861-9cee-4d04-b99d-42d483cf9525","Type":"ContainerDied","Data":"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"}
Jul 08 23:31:23.224464 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.224440    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4" event={"ID":"6864e861-9cee-4d04-b99d-42d483cf9525","Type":"ContainerDied","Data":"94c16e32c99aaa9b21b718655db91a1418b6be3b9c2912f377ca3d9b663fac40"}
Jul 08 23:31:23.224572 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.224471    2571 scope.go:117] "RemoveContainer" containerID="42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"
Jul 08 23:31:23.233066 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.233052    2571 scope.go:117] "RemoveContainer" containerID="42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"
Jul 08 23:31:23.233310 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:31:23.233295    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6\": container with ID starting with 42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6 not found: ID does not exist" containerID="42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"
Jul 08 23:31:23.233362 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.233319    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6"} err="failed to get container status \"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6\": rpc error: code = NotFound desc = could not find container \"42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6\": container with ID starting with 42f2ecf3b2ee98c1a734017420478d5a2ff6e3ad6a5e40ce4410d355db1b2ff6 not found: ID does not exist"
Jul 08 23:31:23.245382 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.245361    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:31:23.248948 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.248919    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5b1175-6c99bfdb94-skmw4"]
Jul 08 23:31:23.463814 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:23.463785    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6864e861-9cee-4d04-b99d-42d483cf9525" path="/var/lib/kubelet/pods/6864e861-9cee-4d04-b99d-42d483cf9525/volumes"
Jul 08 23:31:30.252259 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.252233    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:31:30.259060 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.259034    2571 generic.go:356] "Generic (PLEG): container finished" podID="81a1a46b-2417-4957-a32f-57c253c768e6" containerID="163ce849e5010240b3fce8cb8953d4e9f1e44d8343976d73c7812d54fb252cd5" exitCode=137
Jul 08 23:31:30.259175 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.259113    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" event={"ID":"81a1a46b-2417-4957-a32f-57c253c768e6","Type":"ContainerDied","Data":"163ce849e5010240b3fce8cb8953d4e9f1e44d8343976d73c7812d54fb252cd5"}
Jul 08 23:31:30.260298 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.260274    2571 generic.go:356] "Generic (PLEG): container finished" podID="e0f4a211-1525-40f6-abc2-596f1896161f" containerID="227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0" exitCode=137
Jul 08 23:31:30.260388 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.260314    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"
Jul 08 23:31:30.260388 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.260356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" event={"ID":"e0f4a211-1525-40f6-abc2-596f1896161f","Type":"ContainerDied","Data":"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"}
Jul 08 23:31:30.260505 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.260407    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5" event={"ID":"e0f4a211-1525-40f6-abc2-596f1896161f","Type":"ContainerDied","Data":"67e1bda9c5aace193917faa01390c82b391ecdc80a0be5d667476cc6bc1ccbef"}
Jul 08 23:31:30.260505 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.260439    2571 scope.go:117] "RemoveContainer" containerID="227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"
Jul 08 23:31:30.261750 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.261731    2571 generic.go:356] "Generic (PLEG): container finished" podID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" containerID="8b87987ade00351f7eec0ec646e0a0dc9176e7bb7509b63e692f3637acece4b2" exitCode=137
Jul 08 23:31:30.261853 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.261798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" event={"ID":"258e717e-235a-4b7c-bf0f-4ca8d8319d1f","Type":"ContainerDied","Data":"8b87987ade00351f7eec0ec646e0a0dc9176e7bb7509b63e692f3637acece4b2"}
Jul 08 23:31:30.261853 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.261845    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv" event={"ID":"258e717e-235a-4b7c-bf0f-4ca8d8319d1f","Type":"ContainerDied","Data":"3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761"}
Jul 08 23:31:30.261948 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.261868    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c20a53df4e1cf7e067ba890e7ee421f94adce5302df5cdcd78c524619b80761"
Jul 08 23:31:30.267522 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.267473    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:31:30.270431 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.270408    2571 scope.go:117] "RemoveContainer" containerID="227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"
Jul 08 23:31:30.270722 ip-10-0-128-122 kubenswrapper[2571]: E0708 23:31:30.270698    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0\": container with ID starting with 227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0 not found: ID does not exist" containerID="227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"
Jul 08 23:31:30.270825 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.270734    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0"} err="failed to get container status \"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0\": rpc error: code = NotFound desc = could not find container \"227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0\": container with ID starting with 227d35acedf495e6398062f0949f977e85fd74d60ca69407f1d8948f1b989bb0 not found: ID does not exist"
Jul 08 23:31:30.279750 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.279727    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:31:30.324616 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.324583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjg9g\" (UniqueName: \"kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g\") pod \"81a1a46b-2417-4957-a32f-57c253c768e6\" (UID: \"81a1a46b-2417-4957-a32f-57c253c768e6\") "
Jul 08 23:31:30.324801 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.324633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2lnd\" (UniqueName: \"kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd\") pod \"e0f4a211-1525-40f6-abc2-596f1896161f\" (UID: \"e0f4a211-1525-40f6-abc2-596f1896161f\") "
Jul 08 23:31:30.324801 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.324719    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvfb4\" (UniqueName: \"kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4\") pod \"258e717e-235a-4b7c-bf0f-4ca8d8319d1f\" (UID: \"258e717e-235a-4b7c-bf0f-4ca8d8319d1f\") "
Jul 08 23:31:30.326832 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.326799    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd" (OuterVolumeSpecName: "kube-api-access-h2lnd") pod "e0f4a211-1525-40f6-abc2-596f1896161f" (UID: "e0f4a211-1525-40f6-abc2-596f1896161f"). InnerVolumeSpecName "kube-api-access-h2lnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:30.326944 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.326841    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g" (OuterVolumeSpecName: "kube-api-access-cjg9g") pod "81a1a46b-2417-4957-a32f-57c253c768e6" (UID: "81a1a46b-2417-4957-a32f-57c253c768e6"). InnerVolumeSpecName "kube-api-access-cjg9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:30.326944 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.326867    2571 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4" (OuterVolumeSpecName: "kube-api-access-dvfb4") pod "258e717e-235a-4b7c-bf0f-4ca8d8319d1f" (UID: "258e717e-235a-4b7c-bf0f-4ca8d8319d1f"). InnerVolumeSpecName "kube-api-access-dvfb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 23:31:30.426065 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.426029    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjg9g\" (UniqueName: \"kubernetes.io/projected/81a1a46b-2417-4957-a32f-57c253c768e6-kube-api-access-cjg9g\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:30.426065 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.426060    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2lnd\" (UniqueName: \"kubernetes.io/projected/e0f4a211-1525-40f6-abc2-596f1896161f-kube-api-access-h2lnd\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:30.426065 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.426071    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvfb4\" (UniqueName: \"kubernetes.io/projected/258e717e-235a-4b7c-bf0f-4ca8d8319d1f-kube-api-access-dvfb4\") on node \"ip-10-0-128-122.ec2.internal\" DevicePath \"\""
Jul 08 23:31:30.583498 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.583465    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:31:30.588750 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:30.588728    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725890-dfkz5"]
Jul 08 23:31:31.267962 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.267932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"
Jul 08 23:31:31.268448 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.267934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c" event={"ID":"81a1a46b-2417-4957-a32f-57c253c768e6","Type":"ContainerDied","Data":"47cf4bcd6be6b1451e9877a07fd7ab9fa6850d9306c5e323c0a768becb1ed524"}
Jul 08 23:31:31.268448 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.268088    2571 scope.go:117] "RemoveContainer" containerID="163ce849e5010240b3fce8cb8953d4e9f1e44d8343976d73c7812d54fb252cd5"
Jul 08 23:31:31.269010 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.268981    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"
Jul 08 23:31:31.295195 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.295174    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:31:31.298878 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.298860    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-77dfb5-29725890-l5jfv"]
Jul 08 23:31:31.308464 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.308444    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:31:31.317741 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.312921    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-5b1175-29725890-4td8c"]
Jul 08 23:31:31.463724 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.463665    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" path="/var/lib/kubelet/pods/258e717e-235a-4b7c-bf0f-4ca8d8319d1f/volumes"
Jul 08 23:31:31.464030 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.464017    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a1a46b-2417-4957-a32f-57c253c768e6" path="/var/lib/kubelet/pods/81a1a46b-2417-4957-a32f-57c253c768e6/volumes"
Jul 08 23:31:31.464298 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:31.464287    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f4a211-1525-40f6-abc2-596f1896161f" path="/var/lib/kubelet/pods/e0f4a211-1525-40f6-abc2-596f1896161f/volumes"
Jul 08 23:31:33.772966 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:33.772937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-52cfq_d6270aff-a2b8-458c-9bc7-249f70052eb3/copy-manifests/0.log"
Jul 08 23:31:33.790180 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:33.790154    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-52cfq_d6270aff-a2b8-458c-9bc7-249f70052eb3/manager/0.log"
Jul 08 23:31:36.023063 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:36.023026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68sxj_6743efb0-59ce-4a6c-8f65-1665748bf6bd/manager/0.log"
Jul 08 23:31:36.481422 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:36.481383    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9btcj_42db0aeb-f844-4273-9f3b-bc408a07f50a/discovery/0.log"
Jul 08 23:31:36.924558 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:36.924532    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zv9fl_7c2f92a5-a627-4820-8f10-e20ed14cff3c/payload-pre-processing/0.log"
Jul 08 23:31:37.146781 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:37.146743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b9fc89c-b2fm6_7a110710-8aa6-4aea-8613-3b044eca90b6/router/0.log"
Jul 08 23:31:37.702702 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:37.702647    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-zw9rr_086b1410-6faf-4c48-b9b6-9cab12541f75/main/0.log"
Jul 08 23:31:45.235824 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:45.235789    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5kbnf_fc3b8459-6284-4c9e-9cfe-2d9476c1c2bd/global-pull-secret-syncer/0.log"
Jul 08 23:31:45.351044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:45.351016    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nlsrr_6deff622-efef-4f34-9544-fd0cdc07ed52/konnectivity-agent/0.log"
Jul 08 23:31:45.409026 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:45.409000    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-122.ec2.internal_f9b0df211eddea4aae4780970deea189/haproxy/0.log"
Jul 08 23:31:51.295343 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:51.295304    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-68sxj_6743efb0-59ce-4a6c-8f65-1665748bf6bd/manager/0.log"
Jul 08 23:31:52.848524 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.848489    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/alertmanager/0.log"
Jul 08 23:31:52.878127 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.878104    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/config-reloader/0.log"
Jul 08 23:31:52.904579 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.904552    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/kube-rbac-proxy-web/0.log"
Jul 08 23:31:52.930044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.930012    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/kube-rbac-proxy/0.log"
Jul 08 23:31:52.956264 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.956242    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/kube-rbac-proxy-metric/0.log"
Jul 08 23:31:52.976047 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:52.976021    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/prom-label-proxy/0.log"
Jul 08 23:31:53.001154 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.001132    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4f866fb9-2de9-43aa-928b-337407137e4e/init-config-reloader/0.log"
Jul 08 23:31:53.153945 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.153925    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-zvxr7_0f149e34-7233-4fb1-9300-d4a58c4fe16c/monitoring-plugin/0.log"
Jul 08 23:31:53.339936 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.339908    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8qfs_1086bd0e-2ea7-4a5e-bf47-0e948e530adf/node-exporter/0.log"
Jul 08 23:31:53.359796 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.359774    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8qfs_1086bd0e-2ea7-4a5e-bf47-0e948e530adf/kube-rbac-proxy/0.log"
Jul 08 23:31:53.382240 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.382223    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8qfs_1086bd0e-2ea7-4a5e-bf47-0e948e530adf/init-textfile/0.log"
Jul 08 23:31:53.672623 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.672597    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sznbr_eb290e75-c334-44b9-b2c8-2a4f0020d6d0/prometheus-operator/0.log"
Jul 08 23:31:53.692767 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:53.692743    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-sznbr_eb290e75-c334-44b9-b2c8-2a4f0020d6d0/kube-rbac-proxy/0.log"
Jul 08 23:31:55.871335 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871304    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"]
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871628    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" containerName="test-curl-7578-140502206236112"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871640    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" containerName="test-curl-7578-140502206236112"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871660    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f4a211-1525-40f6-abc2-596f1896161f" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871667    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f4a211-1525-40f6-abc2-596f1896161f" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871691    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0120103-6e7d-4b13-978a-7d67a01b81e8" containerName="maas-api"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871697    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0120103-6e7d-4b13-978a-7d67a01b81e8" containerName="maas-api"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871702    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a1a46b-2417-4957-a32f-57c253c768e6" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871708    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a1a46b-2417-4957-a32f-57c253c768e6" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871713    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871718    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" containerName="cleanup"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871724    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6864e861-9cee-4d04-b99d-42d483cf9525" containerName="maas-api"
Jul 08 23:31:55.871733 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871728    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6864e861-9cee-4d04-b99d-42d483cf9525" containerName="maas-api"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871777    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6864e861-9cee-4d04-b99d-42d483cf9525" containerName="maas-api"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871785    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="258e717e-235a-4b7c-bf0f-4ca8d8319d1f" containerName="cleanup"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871791    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a1a46b-2417-4957-a32f-57c253c768e6" containerName="cleanup"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871796    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0120103-6e7d-4b13-978a-7d67a01b81e8" containerName="maas-api"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871802    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd70ed4-fb83-4e11-b26a-435a1dc74d0f" containerName="test-curl-7578-140502206236112"
Jul 08 23:31:55.872101 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.871809    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f4a211-1525-40f6-abc2-596f1896161f" containerName="cleanup"
Jul 08 23:31:55.874637 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.874620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:55.880817 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.880579    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9xpw\"/\"kube-root-ca.crt\""
Jul 08 23:31:55.880817 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.880577    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c9xpw\"/\"openshift-service-ca.crt\""
Jul 08 23:31:55.881711 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.881671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c9xpw\"/\"default-dockercfg-nlb47\""
Jul 08 23:31:55.888247 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.888226    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"]
Jul 08 23:31:55.934420 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.934393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-lib-modules\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:55.934420 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.934421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-podres\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:55.934592 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.934445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjxz2\" (UniqueName: \"kubernetes.io/projected/c8368f72-4d13-4ac1-b375-ec04dcd45e56-kube-api-access-wjxz2\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:55.934592 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.934470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-sys\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:55.934592 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:55.934491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-proc\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035734 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-lib-modules\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-podres\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035762    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjxz2\" (UniqueName: \"kubernetes.io/projected/c8368f72-4d13-4ac1-b375-ec04dcd45e56-kube-api-access-wjxz2\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035858    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-lib-modules\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035862    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-podres\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.035879 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-sys\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.036044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-proc\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.036044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035901    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-sys\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.036044 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.035973    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8368f72-4d13-4ac1-b375-ec04dcd45e56-proc\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.044002 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.043974    2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjxz2\" (UniqueName: \"kubernetes.io/projected/c8368f72-4d13-4ac1-b375-ec04dcd45e56-kube-api-access-wjxz2\") pod \"perf-node-gather-daemonset-7gfjb\" (UID: \"c8368f72-4d13-4ac1-b375-ec04dcd45e56\") " pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.183841 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.183820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.307375 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.307351    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"]
Jul 08 23:31:56.310082 ip-10-0-128-122 kubenswrapper[2571]: W0708 23:31:56.310038    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8368f72_4d13_4ac1_b375_ec04dcd45e56.slice/crio-f6049cef5075e10c8c0fffbd455cbdfd812848c90347e65c48cfda5e24e763b4 WatchSource:0}: Error finding container f6049cef5075e10c8c0fffbd455cbdfd812848c90347e65c48cfda5e24e763b4: Status 404 returned error can't find the container with id f6049cef5075e10c8c0fffbd455cbdfd812848c90347e65c48cfda5e24e763b4
Jul 08 23:31:56.394886 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.394860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb" event={"ID":"c8368f72-4d13-4ac1-b375-ec04dcd45e56","Type":"ContainerStarted","Data":"adc01d5e7c063584293f44368b8a0d5faef69f55bdbca23a6e1345154bbc0e65"}
Jul 08 23:31:56.395000 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.394907    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:31:56.395000 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.394924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb" event={"ID":"c8368f72-4d13-4ac1-b375-ec04dcd45e56","Type":"ContainerStarted","Data":"f6049cef5075e10c8c0fffbd455cbdfd812848c90347e65c48cfda5e24e763b4"}
Jul 08 23:31:56.410379 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:56.410337    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb" podStartSLOduration=1.410322053 podStartE2EDuration="1.410322053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:31:56.409642423 +0000 UTC m=+2688.010473562" watchObservedRunningTime="2026-07-08 23:31:56.410322053 +0000 UTC m=+2688.011153193"
Jul 08 23:31:58.037093 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:58.037059    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljw77_d17c6cad-9880-43e9-aca9-7a8dbc012823/dns/0.log"
Jul 08 23:31:58.054631 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:58.054602    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ljw77_d17c6cad-9880-43e9-aca9-7a8dbc012823/kube-rbac-proxy/0.log"
Jul 08 23:31:58.141349 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:58.141322    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rqt8q_7e6801ab-2e75-4239-9209-ebe83b853323/dns-node-resolver/0.log"
Jul 08 23:31:58.724492 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:58.724465    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6zp5j_3d1b9e84-a731-44eb-a6f8-2fd450664fe5/node-ca/0.log"
Jul 08 23:31:59.876000 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:31:59.875971    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9btcj_42db0aeb-f844-4273-9f3b-bc408a07f50a/discovery/0.log"
Jul 08 23:32:00.038748 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:00.038719    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zv9fl_7c2f92a5-a627-4820-8f10-e20ed14cff3c/payload-pre-processing/0.log"
Jul 08 23:32:00.114697 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:00.114650    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b9fc89c-b2fm6_7a110710-8aa6-4aea-8613-3b044eca90b6/router/0.log"
Jul 08 23:32:00.845440 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:00.845363    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z6nbl_c0acc643-ac22-487d-ac57-a02a6bd583a0/serve-healthcheck-canary/0.log"
Jul 08 23:32:01.292804 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:01.292775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8zn2j_bff360ba-e55a-46d0-9b15-c7472b5f06da/insights-operator/0.log"
Jul 08 23:32:01.295732 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:01.295709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-8zn2j_bff360ba-e55a-46d0-9b15-c7472b5f06da/insights-operator/1.log"
Jul 08 23:32:01.386105 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:01.386074    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kzkvx_7f83dcff-0d3a-4051-a004-c6b1c66c4210/kube-rbac-proxy/0.log"
Jul 08 23:32:01.405595 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:01.405571    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kzkvx_7f83dcff-0d3a-4051-a004-c6b1c66c4210/exporter/0.log"
Jul 08 23:32:01.429024 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:01.428997    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kzkvx_7f83dcff-0d3a-4051-a004-c6b1c66c4210/extractor/0.log"
Jul 08 23:32:02.412427 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:02.412395    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c9xpw/perf-node-gather-daemonset-7gfjb"
Jul 08 23:32:04.099731 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:04.099702    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-52cfq_d6270aff-a2b8-458c-9bc7-249f70052eb3/manager/0.log"
Jul 08 23:32:04.120235 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:04.120215    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d776fd96-52cfq_d6270aff-a2b8-458c-9bc7-249f70052eb3/copy-manifests/0.log"
Jul 08 23:32:05.727275 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:05.727246    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6cfd684dd8-vxfwf_0ef70231-a3ba-40d1-a85f-c114e1421dea/manager/0.log"
Jul 08 23:32:06.505249 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:06.505218    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9btcj_42db0aeb-f844-4273-9f3b-bc408a07f50a/discovery/0.log"
Jul 08 23:32:06.644517 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:06.644495    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zv9fl_7c2f92a5-a627-4820-8f10-e20ed14cff3c/payload-pre-processing/0.log"
Jul 08 23:32:06.705493 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:06.705463    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b9fc89c-b2fm6_7a110710-8aa6-4aea-8613-3b044eca90b6/router/0.log"
Jul 08 23:32:08.149837 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:08.149806    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-9btcj_42db0aeb-f844-4273-9f3b-bc408a07f50a/discovery/0.log"
Jul 08 23:32:08.279819 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:08.279797    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-zv9fl_7c2f92a5-a627-4820-8f10-e20ed14cff3c/payload-pre-processing/0.log"
Jul 08 23:32:08.344886 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:08.344858    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-854b9fc89c-b2fm6_7a110710-8aa6-4aea-8613-3b044eca90b6/router/0.log"
Jul 08 23:32:09.516923 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:09.516892    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:32:09.525860 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:09.525838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-svpgw_92324e79-83b5-4257-a58d-11af6e2232bc/ovn-acl-logging/0.log"
Jul 08 23:32:12.174602 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.174566    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2fmss_56b906c9-4b5b-4c0e-a95c-43818f8440fa/kube-multus/0.log"
Jul 08 23:32:12.516414 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.516333    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/kube-multus-additional-cni-plugins/0.log"
Jul 08 23:32:12.535012 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.534990    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/egress-router-binary-copy/0.log"
Jul 08 23:32:12.553191 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.553171    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/cni-plugins/0.log"
Jul 08 23:32:12.570627 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.570602    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/bond-cni-plugin/0.log"
Jul 08 23:32:12.587348 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.587322    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/routeoverride-cni/0.log"
Jul 08 23:32:12.604842 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.604821    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/whereabouts-cni-bincopy/0.log"
Jul 08 23:32:12.622277 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.622258    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pq8z7_a0be5df2-da64-47df-8501-a19988b61027/whereabouts-cni/0.log"
Jul 08 23:32:12.713318 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.713275    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cc2dz_1f1a2e6f-05a7-4eaf-8d84-47700cd51905/network-metrics-daemon/0.log"
Jul 08 23:32:12.729072 ip-10-0-128-122 kubenswrapper[2571]: I0708 23:32:12.729048    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cc2dz_1f1a2e6f-05a7-4eaf-8d84-47700cd51905/kube-rbac-proxy/0.log"