Jul 09 14:53:18.022010 ip-10-0-133-59 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 14:53:18.022023 ip-10-0-133-59 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 14:53:18.022030 ip-10-0-133-59 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 14:53:18.022355 ip-10-0-133-59 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 14:53:28.186938 ip-10-0-133-59 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 14:53:28.186955 ip-10-0-133-59 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 052a638136394bb0a60c80b7370ec9f2 --
Jul 09 14:55:21.955478 ip-10-0-133-59 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.346571    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353547    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353567    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353570    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353577    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353581    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353584    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353587    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.617450 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353590    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353594    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353598    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353602    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353605    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353607    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353610    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353613    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353615    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353618    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353621    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353624    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353626    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353629    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353632    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353634    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353637    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353640    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353642    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353645    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.619055 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353648    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353651    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353654    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353657    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353659    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353662    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353665    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353667    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353670    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353672    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353675    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353677    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353680    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353691    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353694    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353697    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353699    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353703    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353705    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353708    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.620588 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353710    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353713    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353715    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353718    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353721    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353723    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353726    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353729    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353731    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353734    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353736    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353739    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353741    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353744    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353747    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353749    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353753    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353757    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353760    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.621848 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353763    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353766    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353769    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353772    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353774    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353777    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353780    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353784    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353786    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353790    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353793    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353796    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353798    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353801    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353803    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353806    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353809    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353811    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353815    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353819    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.622740 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353822    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353825    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353827    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353830    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353832    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353835    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353839    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353841    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353844    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353847    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353849    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353852    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.353854    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354646    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354656    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354660    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354662    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354665    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354668    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354671    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.625115 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354674    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354677    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354680    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354682    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354685    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354691    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354693    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354696    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354698    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354701    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354703    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354706    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354709    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354711    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354714    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354716    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354719    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354721    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354724    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354726    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.626010 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354729    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354732    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354735    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354738    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354741    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354744    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354746    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354749    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354751    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354754    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354756    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354759    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354761    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354764    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354767    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354769    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354772    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354776    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354778    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.627762 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354783    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354787    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354790    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354795    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354798    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354802    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354804    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354808    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354811    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354813    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354816    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354818    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354821    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354824    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354826    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354829    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354832    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354834    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354837    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.628653 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354839    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354842    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354845    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354848    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354851    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354854    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354856    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354859    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354862    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354865    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354868    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354872    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354874    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354877    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354879    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354882    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354885    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354887    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354890    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354892    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.630191 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354895    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354897    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354900    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354902    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354905    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354908    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354910    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354913    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354916    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354918    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354921    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354923    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354926    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.354928    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355370    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355377    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355380    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355383    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355401    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355405    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.631075 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355409    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355413    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355416    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355421    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355423    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355426    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355429    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355431    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355434    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355437    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355439    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355442    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355444    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355447    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355449    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355452    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355454    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355457    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355462    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355466    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.631944 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355469    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355472    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355475    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355478    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355481    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355484    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355486    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355489    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355492    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355495    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355497    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355499    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355502    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355507    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355509    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355514    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355516    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355519    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355521    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355524    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.632872 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355526    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355529    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355532    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355534    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355537    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355539    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355542    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355544    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355547    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355550    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355554    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355557    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355560    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355563    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355566    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355568    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355571    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355573    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355576    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.633722 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355579    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355581    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355584    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355586    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355589    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355592    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355594    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355597    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355601    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355604    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355607    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355610    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355612    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355615    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355617    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355620    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355622    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355626    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355629    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.634812 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355631    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355634    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355636    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355639    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355642    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355644    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355647    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355650    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355654    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355656    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355659    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355661    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355664    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355666    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:22.355669    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355741    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355755    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355761    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355766    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355770    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355773    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 14:55:23.635898 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355788    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355793    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355796    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355799    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355803    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355807    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355810    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355814    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355816    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355821    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355825    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355828    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355833    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355836    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355839    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355842    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355846    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355850    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355853    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355856    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355860    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355863    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355866    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355869    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 14:55:23.636778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355872    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355875    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355879    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355882    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355885    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355888    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355891    2573 flags.go:64] FLAG: --enable-server="true"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355894    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355900    2573 flags.go:64] FLAG: --event-burst="100"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355903    2573 flags.go:64] FLAG: --event-qps="50"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355906    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355910    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355913    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355916    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355919    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355922    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355925    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355932    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355935    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355938    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355941    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355945    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355948    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355951    2573 flags.go:64] FLAG: --feature-gates=""
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355954    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 14:55:23.637877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355957    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355960    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355964    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355967    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355970    2573 flags.go:64] FLAG: --help="false"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355973    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-133-59.ec2.internal"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355976    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355979    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355982    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355985    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355988    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355991    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355994    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.355997    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356000    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356004    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356008    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356012    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356015    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356018    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356021    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356024    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356027    2573 flags.go:64] FLAG: --lock-file=""
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356030    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 14:55:23.638989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356034    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356037    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356042    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356045    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356048    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356051    2573 flags.go:64] FLAG: --logging-format="text"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356054    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356057    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356060    2573 flags.go:64] FLAG: --manifest-url=""
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356063    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356068    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356071    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356076    2573 flags.go:64] FLAG: --max-pods="110"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356080    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356083    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356086    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356089    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356092    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356094    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356098    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356109    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356112    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356115    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 14:55:23.640105 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356120    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356122    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356128    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356131    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356135    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356138    2573 flags.go:64] FLAG: --port="10250"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356141    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356144    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08094f9d8f2f8011a"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356147    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356152    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356154    2573 flags.go:64] FLAG: --register-node="true"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356158    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356161    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356164    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356167    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356170    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356174    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356177    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356180    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356183    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356186    2573 flags.go:64] FLAG: --runonce="false"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356189    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356192    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356195    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356198    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 14:55:23.641186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356200    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356203    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356206    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356209    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356212    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356215    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356218    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356221    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356225    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356228    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356231    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356237    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356240    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356242    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356246    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356248    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356254    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356257    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356260    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356265    2573 flags.go:64] FLAG: --v="2"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356271    2573 flags.go:64] FLAG: --version="false"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356278    2573 flags.go:64] FLAG: --vmodule=""
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356283    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:22.356290    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587064    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.642951 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587079    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587085    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587090    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587096    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587100    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587104    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587113    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587118    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587122    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587126    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587131    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587136    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587140    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587146    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587151    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587158    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587162    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587167    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587176    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587182    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.644087 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587186    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587190    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587194    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587201    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587205    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587210    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587214    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587218    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587222    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587227    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587235    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587239    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587244    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587249    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587253    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587257    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587262    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587266    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587270    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587275    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.646064 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587279    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587283    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587288    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587296    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587301    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587308    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587314    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587321    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587325    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587330    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587335    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587340    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587345    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587350    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587354    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587360    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587369    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587373    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587377    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.646939 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587382    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587386    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587390    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587395    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587399    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587403    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587407    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587412    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587417    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587421    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587429    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587433    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587438    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587442    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587447    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587452    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587456    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587460    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587464    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587468    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.648256 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587476    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587480    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587488    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587493    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587496    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587501    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587506    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587526    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587534    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587538    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587542    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587546    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587550    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587554    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587564    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587570    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587577    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587583    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.649126 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.587588    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.588315    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.597691    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.597714    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.597735    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.597742    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597803    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597809    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597812    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597815    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597818    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597822    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597825    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597828    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597830    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.650012 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597833    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597835    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597838    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597841    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597843    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597846    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597849    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597852    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597854    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597857    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597859    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597862    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597865    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597868    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597870    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597873    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597876    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597879    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597882    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597884    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.650684 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597886    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597892    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597894    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597897    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597900    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597904    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597906    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597909    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597912    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597914    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597917    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597920    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597922    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597925    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597927    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597930    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597933    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597937    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.651778 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597943    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597947    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597951    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597955    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597957    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597961    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597964    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597967    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597970    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597982    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597985    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597987    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597991    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597994    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.597996    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598000    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598003    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598006    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598009    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.653492 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598011    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598014    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598017    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598020    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598023    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598025    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598028    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598031    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598033    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598036    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598038    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598041    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598044    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598047    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598049    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598052    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598055    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598057    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598062    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598065    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.654386 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598067    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598070    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598072    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598075    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598077    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598080    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598082    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598085    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598089    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598092    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598094    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598097    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598099    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.598105    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598219    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:23.655268 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598223    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598226    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598230    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598233    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598236    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598240    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598244    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598246    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598250    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598253    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598256    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598259    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598262    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598264    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598267    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598271    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598274    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598276    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598279    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:23.656127 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598281    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598284    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598286    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598289    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598291    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598294    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598298    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598303    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598305    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598308    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598311    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598313    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598316    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598318    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598321    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598324    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598326    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598329    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598331    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:23.788439 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598334    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:23.688916 ip-10-0-133-59 systemd[1]: Started Kubernetes Kubelet.
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598336    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598339    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598342    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598344    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598346    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598349    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598352    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598354    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598359    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598361    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598364    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598366    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598369    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598371    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598374    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598376    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598379    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598382    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598384    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:23.789622 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598388    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598390    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598393    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598396    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598398    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598402    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598406    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598408    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598412    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598414    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598417    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598420    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598422    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598425    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598427    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598430    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598432    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598435    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598437    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598441    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:23.791348 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598444    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598447    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598450    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598453    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598455    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598458    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598460    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598463    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598465    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598468    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598471    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598473    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598477    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598479    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598482    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598485    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598487    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598490    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598493    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:23.792415 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:23.598495    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.598500    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.598652    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.602029    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.603536    2573 server.go:1019] "Starting client certificate rotation"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.603658    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.603690    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.605631    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.608158    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.621010    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.623144    2573 log.go:25] "Validated CRI v1 image API"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.623855    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 14:55:23.794016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.628636    2573 fs.go:135] Filesystem UUIDs: map[088c0146-3b18-4800-9879-25dbba9572b4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dfbca99c-610f-41b7-a8d6-1ce578e75d0f:/dev/nvme0n1p3]
Jul 09 14:55:23.794834 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.628658    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.668994    2573 manager.go:216] Machine: {Timestamp:2026-07-09 14:55:23.667717842 +0000 UTC m=+0.359130633 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099835 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21b33fac23716acbc6a78f10cd1c75 SystemUUID:ec21b33f-ac23-716a-cbc6-a78f10cd1c75 BootID:052a6381-3639-4bb0-a60c-80b7370ec9f2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:03:61:47:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:03:61:47:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:e2:93:fa:cf:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.669105    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.669245    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.670734    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.672607    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.672646    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 14:55:23.795471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.673315    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.673325    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.673333    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.673988    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.675415    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678431    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678577    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678605    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678615    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678626    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678634    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678646    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678958    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.678972    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.681175    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683173    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683201    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683375    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683388    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683394    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683400    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683413    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683421    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683986    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.683992    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684000    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684005    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684019    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684027    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684807    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.684815    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.688036    2573 server.go:1268] "Started kubelet"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.688116    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.688199    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.688321    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.689609    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.695463    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.696107    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.698254    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.698272    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tfvr"
Jul 09 14:55:23.796119 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.698292    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.698407    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.698427    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.698788    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699002    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699009    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699018    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.699099    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699113    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699127    2573 factory.go:55] Registering systemd factory
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699136    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699135    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699166    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.698229    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-59.ec2.internal.18c0a6ddbaa40534  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-59.ec2.internal,UID:ip-10-0-133-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-59.ec2.internal,},FirstTimestamp:2026-07-09 14:55:23.68801106 +0000 UTC m=+0.379423831,LastTimestamp:2026-07-09 14:55:23.68801106 +0000 UTC m=+0.379423831,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-59.ec2.internal,}"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699369    2573 factory.go:153] Registering CRI-O factory
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699382    2573 factory.go:223] Registration of the crio container factory successfully
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699405    2573 factory.go:103] Registering Raw factory
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.699418    2573 manager.go:1196] Started watching for new ooms in manager
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.700267    2573 manager.go:349] Starting recovery of all containers
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.703872    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.703913    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.706279    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9tfvr"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.716292    2573 manager.go:354] Recovery completed
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.718276    2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.721320    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723197    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723224    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723235    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723818    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723825    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.723840    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:55:23.798294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.724843    2573 policy_none.go:49] "None policy: Start"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.724856    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.724865    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.725891    2573 policy_none.go:47] "Start"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.726675    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.727036    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-59.ec2.internal.18c0a6ddbcbd2170  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-59.ec2.internal,UID:ip-10-0-133-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-59.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-59.ec2.internal,},FirstTimestamp:2026-07-09 14:55:23.72321112 +0000 UTC m=+0.414623894,LastTimestamp:2026-07-09 14:55:23.72321112 +0000 UTC m=+0.414623894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-59.ec2.internal,}"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.727425    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.727447    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.727456    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779260    2573 manager.go:337] "Starting Device Plugin manager"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.779480    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779492    2573 server.go:87] "Starting device plugin registration server"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779752    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779764    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779876    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779966    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.779974    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.780542    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 14:55:23.799841 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.780589    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:23.890416 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.880737    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.899091    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.899143    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.899154    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.899179    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-59.ec2.internal"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.900816    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.902152    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.902199    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.902226    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.902262    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.904723    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:23.905928    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-59.ec2.internal"
Jul 09 14:55:23.906254 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.905949    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-59.ec2.internal\": node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.003948 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:23.951788    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.003948 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.003089    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"]
Jul 09 14:55:24.003948 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.003160    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:24.006783 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.006227    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:24.006783 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.006257    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:24.006783 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.006269    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:24.008319 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.007533    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:24.008319 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.007636    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.008319 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.007662    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010143    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010156    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010165    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010175    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010178    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.010192    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.012029    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.012063 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.012054    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:24.015312 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.012945    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:24.015312 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.012970    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:24.015312 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.012979    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:24.115464 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.052577    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.115464 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.055434    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-59.ec2.internal\" not found" node="ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.115464 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.062076    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-59.ec2.internal\" not found" node="ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.256432 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.153673    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.256432 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.200186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e04123caa9afce06f056b45e663d1ad7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-59.ec2.internal\" (UID: \"e04123caa9afce06f056b45e663d1ad7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.256432 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.200217    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.256432 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.200239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.256432 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.254268    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300586    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e04123caa9afce06f056b45e663d1ad7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-59.ec2.internal\" (UID: \"e04123caa9afce06f056b45e663d1ad7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300618    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300684    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300688    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e04123caa9afce06f056b45e663d1ad7-config\") pod \"kube-apiserver-proxy-ip-10-0-133-59.ec2.internal\" (UID: \"e04123caa9afce06f056b45e663d1ad7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.300719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7559243164a8714e2d0ac913f0a864c1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal\" (UID: \"7559243164a8714e2d0ac913f0a864c1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.354722    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.357901    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.366967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.365611    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.462285 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.455460    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.556059 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.556023    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.602400 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.602357    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 14:55:24.602572 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.602537    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:55:24.656779 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:24.656704    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-59.ec2.internal\" not found"
Jul 09 14:55:24.713121 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.713089    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:24.718653 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.718624    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:50:23 +0000 UTC" deadline="2027-12-23 01:46:25.701500001 +0000 UTC"
Jul 09 14:55:24.718653 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.718652    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12754h51m0.982850984s"
Jul 09 14:55:24.799412 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.799383    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.812773 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.812748    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:55:24.815932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.815907    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"
Jul 09 14:55:24.829851 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.829828    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:55:24.931724 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.931697    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:24.932876 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:24.932851    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04123caa9afce06f056b45e663d1ad7.slice/crio-b22416f71b33a997fc2d880fdabcaa59d36657eb6f90cb987f8106118594f4ab WatchSource:0}: Error finding container b22416f71b33a997fc2d880fdabcaa59d36657eb6f90cb987f8106118594f4ab: Status 404 returned error can't find the container with id b22416f71b33a997fc2d880fdabcaa59d36657eb6f90cb987f8106118594f4ab
Jul 09 14:55:24.933201 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:24.933177    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7559243164a8714e2d0ac913f0a864c1.slice/crio-f6026c3de15aa88f0d51a32278eeccaa4a0faefa08d5e0b13698e89e0fec1e4a WatchSource:0}: Error finding container f6026c3de15aa88f0d51a32278eeccaa4a0faefa08d5e0b13698e89e0fec1e4a: Status 404 returned error can't find the container with id f6026c3de15aa88f0d51a32278eeccaa4a0faefa08d5e0b13698e89e0fec1e4a
Jul 09 14:55:24.938172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.938150    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:55:24.963713 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:24.963689    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:25.681673 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.681643    2573 apiserver.go:52] "Watching apiserver"
Jul 09 14:55:25.691906 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.691485    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 14:55:25.693152 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.692747    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-j2wlw","openshift-ovn-kubernetes/ovnkube-node-xqv5q","kube-system/global-pull-secret-syncer-h9vpp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4","openshift-image-registry/node-ca-dq8w4","openshift-multus/multus-additional-cni-plugins-2lt9v","openshift-multus/multus-fcs57","openshift-network-diagnostics/network-check-target-r8rr9","openshift-network-operator/iptables-alerter-pjnpf","kube-system/konnectivity-agent-nfgcs","kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8dfcp","openshift-dns/node-resolver-97lch","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal"]
Jul 09 14:55:25.694383 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.694363    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.694483 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.694462    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:25.695412 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.695359    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.696639 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.696552    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 14:55:25.696959 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.696942    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.697704 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.697684    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.697789 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.697756    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:25.698426 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.698406    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 14:55:25.698816 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.698797    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pf65n\""
Jul 09 14:55:25.699011 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.698995    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 14:55:25.700131 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.699622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.700131 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.699719    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 14:55:25.700131 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.699871    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dj7kh\""
Jul 09 14:55:25.700131 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.699945    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.700542 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.700482    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.701755 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.701695    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.703722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.702323    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.703722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.703134    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:25.703722 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.703205    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:25.703972 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.703954    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.705247 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.704978    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7rdxb\""
Jul 09 14:55:25.705247 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.705187    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.706434 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.705607    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.706434 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.706237    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zmgzp\""
Jul 09 14:55:25.706434 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.706278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 14:55:25.706710 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.706622    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 14:55:25.706710 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.706699    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.707121    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.707612    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.707696    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hd6sz\""
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.707840    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708117    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-agent-certs\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-socket-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-etc-selinux\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708261    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg2j5\" (UniqueName: \"kubernetes.io/projected/66e5db36-142b-4113-a30b-f2e9a915e1a0-kube-api-access-hg2j5\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708293    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-device-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-sys-fs\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42tz\" (UniqueName: \"kubernetes.io/projected/3d999699-2449-40a4-a43b-3a4f6ac94a5b-kube-api-access-q42tz\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.709375 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-dbus\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709170    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709269    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.708528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-registration-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhxz6\" (UniqueName: \"kubernetes.io/projected/a7f92e77-9d4f-417d-be03-3524370acf03-kube-api-access-vhxz6\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66e5db36-142b-4113-a30b-f2e9a915e1a0-host\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709751    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-system-cni-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-cnibin\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-os-release\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.710244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.709869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-konnectivity-ca\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.713806 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.713468    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 14:55:25.713806 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.713600    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.713806 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.713601    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.713806 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.713695    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqxq7\""
Jul 09 14:55:25.714162 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.712816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-kubelet-config\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.714262 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.714185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.714262 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.714213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66e5db36-142b-4113-a30b-f2e9a915e1a0-serviceca\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.714262 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.714238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.714418 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.714286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.714418 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.714308    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxvvn\" (UniqueName: \"kubernetes.io/projected/e8651a5a-be39-4723-bb82-b460740c57d4-kube-api-access-bxvvn\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.715700 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.715679    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.717059 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.716893    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 14:55:25.717630 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.717607    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.718279 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.718260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.718585 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.718568    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.718751    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.718781    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.718894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.719005    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.719093    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9rjhf\""
Jul 09 14:55:25.719294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.719174    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 14:55:25.719846 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.719826    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.720045 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.720025    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tnvqv\""
Jul 09 14:55:25.720714 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.720564    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 14:55:25.720714 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.720661    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-952l4\""
Jul 09 14:55:25.720714 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.720706    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 14:55:25.737822 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.737797    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-psfss"
Jul 09 14:55:25.748202 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.747807    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-psfss"
Jul 09 14:55:25.800941 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.800911    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 14:55:25.814671 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cni-binary-copy\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-socket-dir-parent\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-k8s-cni-cncf-io\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814750    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-kubelet-config\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814803    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxvvn\" (UniqueName: \"kubernetes.io/projected/e8651a5a-be39-4723-bb82-b460740c57d4-kube-api-access-bxvvn\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.814850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-script-lib\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-netns\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-daemon-config\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814909    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cq99\" (UniqueName: \"kubernetes.io/projected/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-kube-api-access-8cq99\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-modprobe-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42tz\" (UniqueName: \"kubernetes.io/projected/3d999699-2449-40a4-a43b-3a4f6ac94a5b-kube-api-access-q42tz\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.814990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-kubelet\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815036    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-kubernetes\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-run\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815120    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-os-release\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.815144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815165    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-systemd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-tuned\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815222    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815270    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66e5db36-142b-4113-a30b-f2e9a915e1a0-host\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-kubelet-config\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815405    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-netns\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815429    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66e5db36-142b-4113-a30b-f2e9a915e1a0-host\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-multus\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815451    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.815526    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-etc-kubernetes\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.815621    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.315585458 +0000 UTC m=+3.006998243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-conf\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.815772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-konnectivity-ca\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-systemd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815761    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-var-lib-kubelet\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815784    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-agent-certs\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815811    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-socket-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815835    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg2j5\" (UniqueName: \"kubernetes.io/projected/66e5db36-142b-4113-a30b-f2e9a915e1a0-kube-api-access-hg2j5\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-hostroot\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815897    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-kubelet\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-conf-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-iptables-alerter-script\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815969    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-host-slash\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.815992    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-lib-modules\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.816391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816157    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-konnectivity-ca\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816015    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-registration-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816549    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovn-node-metrics-cert\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816552    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-registration-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816584    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-socket-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-system-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816651    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vjbd\" (UniqueName: \"kubernetes.io/projected/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-kube-api-access-5vjbd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816676    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-etc-selinux\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816725    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n7md\" (UniqueName: \"kubernetes.io/projected/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-kube-api-access-7n7md\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-multus-certs\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816775    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-device-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816798    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-etc-selinux\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-sys-fs\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816842    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-sys-fs\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816847    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-etc-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816876    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-bin\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816900    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-config\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816922    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31de8069-1975-404b-91e2-c91ceea0e229-tmp-dir\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-bin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816972    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.816981    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-system-cni-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817007    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-cnibin\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817032    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a7f92e77-9d4f-417d-be03-3524370acf03-device-dir\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.817702 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817070    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-slash\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817093    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-node-log\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.817100    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-env-overrides\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.817148    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.317130916 +0000 UTC m=+3.008543678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-std49\" (UniqueName: \"kubernetes.io/projected/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-kube-api-access-std49\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817180    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817192    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-cnibin\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66e5db36-142b-4113-a30b-f2e9a915e1a0-serviceca\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817185    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-system-cni-dir\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lqp\" (UniqueName: \"kubernetes.io/projected/31de8069-1975-404b-91e2-c91ceea0e229-kube-api-access-q6lqp\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-tmp\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.818266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-systemd-units\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817401    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-log-socket\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysconfig\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817482    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-var-lib-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31de8069-1975-404b-91e2-c91ceea0e229-hosts-file\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cnibin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817601    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-sys\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817623    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66e5db36-142b-4113-a30b-f2e9a915e1a0-serviceca\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-host\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-dbus\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhxz6\" (UniqueName: \"kubernetes.io/projected/a7f92e77-9d4f-417d-be03-3524370acf03-kube-api-access-vhxz6\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817725    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-os-release\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817765    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-ovn\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.818875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817769    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8651a5a-be39-4723-bb82-b460740c57d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.819624 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817789    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-netd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.819624 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817854    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8651a5a-be39-4723-bb82-b460740c57d4-os-release\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.819624 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.817879    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7302b010-3a52-4b6a-92fb-571b8aaf0e25-dbus\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:25.819990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.819969    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af7f4e15-26b7-4c65-aa37-ff070a1ab09b-agent-certs\") pod \"konnectivity-agent-nfgcs\" (UID: \"af7f4e15-26b7-4c65-aa37-ff070a1ab09b\") " pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:25.831568 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.829856    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42tz\" (UniqueName: \"kubernetes.io/projected/3d999699-2449-40a4-a43b-3a4f6ac94a5b-kube-api-access-q42tz\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:25.833480 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.832130    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhxz6\" (UniqueName: \"kubernetes.io/projected/a7f92e77-9d4f-417d-be03-3524370acf03-kube-api-access-vhxz6\") pod \"aws-ebs-csi-driver-node-gftx4\" (UID: \"a7f92e77-9d4f-417d-be03-3524370acf03\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:25.835673 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.835637    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg2j5\" (UniqueName: \"kubernetes.io/projected/66e5db36-142b-4113-a30b-f2e9a915e1a0-kube-api-access-hg2j5\") pod \"node-ca-dq8w4\" (UID: \"66e5db36-142b-4113-a30b-f2e9a915e1a0\") " pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:25.835968 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.835940    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxvvn\" (UniqueName: \"kubernetes.io/projected/e8651a5a-be39-4723-bb82-b460740c57d4-kube-api-access-bxvvn\") pod \"multus-additional-cni-plugins-2lt9v\" (UID: \"e8651a5a-be39-4723-bb82-b460740c57d4\") " pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:25.907428 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.907331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal" event={"ID":"e04123caa9afce06f056b45e663d1ad7","Type":"ContainerStarted","Data":"b22416f71b33a997fc2d880fdabcaa59d36657eb6f90cb987f8106118594f4ab"}
Jul 09 14:55:25.908611 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.908566    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal" event={"ID":"7559243164a8714e2d0ac913f0a864c1","Type":"ContainerStarted","Data":"f6026c3de15aa88f0d51a32278eeccaa4a0faefa08d5e0b13698e89e0fec1e4a"}
Jul 09 14:55:25.919014 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.918974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919022    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-systemd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919044    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-var-lib-kubelet\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-hostroot\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919095    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919117    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-kubelet\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919132    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-conf-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919148    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-iptables-alerter-script\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919169    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-host-slash\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.919188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-lib-modules\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919210    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-host-slash\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919269    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-var-lib-kubelet\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919304    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-conf-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919321    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-hostroot\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919350    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-kubelet\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-systemd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919365    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovn-node-metrics-cert\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919388    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919408    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-system-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vjbd\" (UniqueName: \"kubernetes.io/projected/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-kube-api-access-5vjbd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919449    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-system-cni-dir\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919409    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-lib-modules\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.919664 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n7md\" (UniqueName: \"kubernetes.io/projected/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-kube-api-access-7n7md\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919489    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-multus-certs\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-etc-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919560    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-bin\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-config\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31de8069-1975-404b-91e2-c91ceea0e229-tmp-dir\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919633    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-bin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919664    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-bin\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919674    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-slash\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919693    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-multus-certs\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-node-log\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919719    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-env-overrides\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919744    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-std49\" (UniqueName: \"kubernetes.io/projected/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-kube-api-access-std49\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-bin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919799    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-iptables-alerter-script\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.920471 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919719    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-etc-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919812    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-slash\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-node-log\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919885    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lqp\" (UniqueName: \"kubernetes.io/projected/31de8069-1975-404b-91e2-c91ceea0e229-kube-api-access-q6lqp\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-tmp\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919944    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-systemd-units\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-log-socket\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.919991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysconfig\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920016    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-var-lib-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920024    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31de8069-1975-404b-91e2-c91ceea0e229-tmp-dir\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920043    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31de8069-1975-404b-91e2-c91ceea0e229-hosts-file\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920083    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-log-socket\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cnibin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920122    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysconfig\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-sys\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920124    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-var-lib-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920157    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-host\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920164    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cnibin\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920041    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-systemd-units\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-sys\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-ovn\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-host\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-ovn\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920221    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-netd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cni-binary-copy\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920264    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-cni-netd\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920262    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31de8069-1975-404b-91e2-c91ceea0e229-hosts-file\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920271    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-config\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-socket-dir-parent\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920311    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-k8s-cni-cncf-io\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.921777 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920345    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-env-overrides\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920372    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-script-lib\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920403    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-socket-dir-parent\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-netns\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920439    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-k8s-cni-cncf-io\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920440    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-daemon-config\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-run-netns\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cq99\" (UniqueName: \"kubernetes.io/projected/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-kube-api-access-8cq99\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920527    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-modprobe-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920553    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-kubelet\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920604    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-kubernetes\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920628    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-run\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920654    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-os-release\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.922508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920684    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-modprobe-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920702    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920717    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-kubernetes\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920747    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-cni-binary-copy\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920761    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-kubelet\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920766    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-os-release\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-run-openvswitch\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920805    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-systemd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920816    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-run\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920827    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-d\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920830    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-tuned\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920861    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-systemd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-netns\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920889    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-multus-daemon-config\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.923228 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920892    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-host-run-netns\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovnkube-script-lib\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920892    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-multus\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-host-var-lib-cni-multus\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-etc-kubernetes\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.920965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-conf\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.921020    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-etc-kubernetes\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.921106    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-sysctl-conf\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.923295    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-tmp\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.923332    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-etc-tuned\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:25.924084 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.923465    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-ovn-node-metrics-cert\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.926668 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.926643    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:25.926668 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.926673    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:25.926876 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.926686    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:25.926876 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:25.926764    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:26.426744896 +0000 UTC m=+3.118157655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:25.929732 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.929703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cq99\" (UniqueName: \"kubernetes.io/projected/a3339f4e-77a4-4852-bee7-0ac421cfe7b3-kube-api-access-8cq99\") pod \"iptables-alerter-pjnpf\" (UID: \"a3339f4e-77a4-4852-bee7-0ac421cfe7b3\") " pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:25.930167 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.930139    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-std49\" (UniqueName: \"kubernetes.io/projected/e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba-kube-api-access-std49\") pod \"multus-fcs57\" (UID: \"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba\") " pod="openshift-multus/multus-fcs57"
Jul 09 14:55:25.930550 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.930530    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lqp\" (UniqueName: \"kubernetes.io/projected/31de8069-1975-404b-91e2-c91ceea0e229-kube-api-access-q6lqp\") pod \"node-resolver-97lch\" (UID: \"31de8069-1975-404b-91e2-c91ceea0e229\") " pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:25.931069 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.931050    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n7md\" (UniqueName: \"kubernetes.io/projected/d68174b9-e26b-4000-a7c5-ac99aff8fbf0-kube-api-access-7n7md\") pod \"ovnkube-node-xqv5q\" (UID: \"d68174b9-e26b-4000-a7c5-ac99aff8fbf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:25.931881 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:25.931833    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vjbd\" (UniqueName: \"kubernetes.io/projected/cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff-kube-api-access-5vjbd\") pod \"tuned-8dfcp\" (UID: \"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:26.018274 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.018234    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:26.029785 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.029752    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4"
Jul 09 14:55:26.040480 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.040455    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dq8w4"
Jul 09 14:55:26.046221 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.046193    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2lt9v"
Jul 09 14:55:26.054000 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.053963    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcs57"
Jul 09 14:55:26.063776 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.063750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjnpf"
Jul 09 14:55:26.071625 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.071597    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:26.080628 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.080601    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dfcp"
Jul 09 14:55:26.086429 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.086401    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-97lch"
Jul 09 14:55:26.322753 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.322670    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:26.322916 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.322758    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:26.322916 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.322843    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:26.322916 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.322849    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:26.322916 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.322911    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.322895654 +0000 UTC m=+4.014308416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:26.323126 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.322928    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.3229206 +0000 UTC m=+4.014333367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:26.524586 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.524547    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:26.524749 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.524710    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:26.524749 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.524734    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:26.524749 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.524750    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:26.524865 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.524816    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.524802009 +0000 UTC m=+4.216214766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:26.750123 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.750038    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:25 +0000 UTC" deadline="2028-03-30 03:17:04.844111648 +0000 UTC"
Jul 09 14:55:26.750123 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.750071    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15108h21m38.09404364s"
Jul 09 14:55:26.781946 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.781916    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8651a5a_be39_4723_bb82_b460740c57d4.slice/crio-0a8cf1bed356efe1b2ad935cff166337e8613a31f78af2cb0c85d0f4329ba406 WatchSource:0}: Error finding container 0a8cf1bed356efe1b2ad935cff166337e8613a31f78af2cb0c85d0f4329ba406: Status 404 returned error can't find the container with id 0a8cf1bed356efe1b2ad935cff166337e8613a31f78af2cb0c85d0f4329ba406
Jul 09 14:55:26.783568 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.783465    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3339f4e_77a4_4852_bee7_0ac421cfe7b3.slice/crio-51ab171d24a1879c1f3497c0f3981c085e726f5eb2a2f3d2b71ae6fa8f19f229 WatchSource:0}: Error finding container 51ab171d24a1879c1f3497c0f3981c085e726f5eb2a2f3d2b71ae6fa8f19f229: Status 404 returned error can't find the container with id 51ab171d24a1879c1f3497c0f3981c085e726f5eb2a2f3d2b71ae6fa8f19f229
Jul 09 14:55:26.784269 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.784248    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f92e77_9d4f_417d_be03_3524370acf03.slice/crio-ece1c5ddff75595aba138a4aaaf7a3c3bb42ce66fe2dcb30e5f3c7af3104badd WatchSource:0}: Error finding container ece1c5ddff75595aba138a4aaaf7a3c3bb42ce66fe2dcb30e5f3c7af3104badd: Status 404 returned error can't find the container with id ece1c5ddff75595aba138a4aaaf7a3c3bb42ce66fe2dcb30e5f3c7af3104badd
Jul 09 14:55:26.785568 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.785542    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68174b9_e26b_4000_a7c5_ac99aff8fbf0.slice/crio-629a50dc72f4b143fcb9547ba97e8398f9b0856a42c7575ce9e005298a683cd7 WatchSource:0}: Error finding container 629a50dc72f4b143fcb9547ba97e8398f9b0856a42c7575ce9e005298a683cd7: Status 404 returned error can't find the container with id 629a50dc72f4b143fcb9547ba97e8398f9b0856a42c7575ce9e005298a683cd7
Jul 09 14:55:26.791310 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.791261    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8fdbb3d_3464_4f18_a9cf_ce3dd11895ba.slice/crio-701c48db9e5335fd9303a4f27a2719163530c62d6c5ecea2092d808354153610 WatchSource:0}: Error finding container 701c48db9e5335fd9303a4f27a2719163530c62d6c5ecea2092d808354153610: Status 404 returned error can't find the container with id 701c48db9e5335fd9303a4f27a2719163530c62d6c5ecea2092d808354153610
Jul 09 14:55:26.792331 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.792307    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e5db36_142b_4113_a30b_f2e9a915e1a0.slice/crio-39c0c80776b1028048f7978652a7b6c1d4cc7f571255cd52fd1bddebca340027 WatchSource:0}: Error finding container 39c0c80776b1028048f7978652a7b6c1d4cc7f571255cd52fd1bddebca340027: Status 404 returned error can't find the container with id 39c0c80776b1028048f7978652a7b6c1d4cc7f571255cd52fd1bddebca340027
Jul 09 14:55:26.793226 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.793193    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31de8069_1975_404b_91e2_c91ceea0e229.slice/crio-54874831ab5b7360da76ea7516045e9b38f376accc031e92bbdc16437ccde21d WatchSource:0}: Error finding container 54874831ab5b7360da76ea7516045e9b38f376accc031e92bbdc16437ccde21d: Status 404 returned error can't find the container with id 54874831ab5b7360da76ea7516045e9b38f376accc031e92bbdc16437ccde21d
Jul 09 14:55:26.794505 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.794421    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf7f4e15_26b7_4c65_aa37_ff070a1ab09b.slice/crio-622ba8b4903854c9a67a789ffe0985792589aff53f4221f93c182df856f82429 WatchSource:0}: Error finding container 622ba8b4903854c9a67a789ffe0985792589aff53f4221f93c182df856f82429: Status 404 returned error can't find the container with id 622ba8b4903854c9a67a789ffe0985792589aff53f4221f93c182df856f82429
Jul 09 14:55:26.796104 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:26.796017    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd84b31_ae3f_4b4c_a9c5_9e5f3f4c81ff.slice/crio-dd3db7b27c369d307677ae1d0699f9f7ca17344d39b73a7bc6056fb4047ecca5 WatchSource:0}: Error finding container dd3db7b27c369d307677ae1d0699f9f7ca17344d39b73a7bc6056fb4047ecca5: Status 404 returned error can't find the container with id dd3db7b27c369d307677ae1d0699f9f7ca17344d39b73a7bc6056fb4047ecca5
Jul 09 14:55:26.903128 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.903094    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:26.903277 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:26.903208    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:26.913349 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.913316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dfcp" event={"ID":"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff","Type":"ContainerStarted","Data":"dd3db7b27c369d307677ae1d0699f9f7ca17344d39b73a7bc6056fb4047ecca5"}
Jul 09 14:55:26.917064 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.917028    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nfgcs" event={"ID":"af7f4e15-26b7-4c65-aa37-ff070a1ab09b","Type":"ContainerStarted","Data":"622ba8b4903854c9a67a789ffe0985792589aff53f4221f93c182df856f82429"}
Jul 09 14:55:26.918050 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.918024    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97lch" event={"ID":"31de8069-1975-404b-91e2-c91ceea0e229","Type":"ContainerStarted","Data":"54874831ab5b7360da76ea7516045e9b38f376accc031e92bbdc16437ccde21d"}
Jul 09 14:55:26.919721 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.919697    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq8w4" event={"ID":"66e5db36-142b-4113-a30b-f2e9a915e1a0","Type":"ContainerStarted","Data":"39c0c80776b1028048f7978652a7b6c1d4cc7f571255cd52fd1bddebca340027"}
Jul 09 14:55:26.921883 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.921838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcs57" event={"ID":"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba","Type":"ContainerStarted","Data":"701c48db9e5335fd9303a4f27a2719163530c62d6c5ecea2092d808354153610"}
Jul 09 14:55:26.923424 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.923395    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"629a50dc72f4b143fcb9547ba97e8398f9b0856a42c7575ce9e005298a683cd7"}
Jul 09 14:55:26.924451 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.924432    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4" event={"ID":"a7f92e77-9d4f-417d-be03-3524370acf03","Type":"ContainerStarted","Data":"ece1c5ddff75595aba138a4aaaf7a3c3bb42ce66fe2dcb30e5f3c7af3104badd"}
Jul 09 14:55:26.925883 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.925862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjnpf" event={"ID":"a3339f4e-77a4-4852-bee7-0ac421cfe7b3","Type":"ContainerStarted","Data":"51ab171d24a1879c1f3497c0f3981c085e726f5eb2a2f3d2b71ae6fa8f19f229"}
Jul 09 14:55:26.926859 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.926839    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerStarted","Data":"0a8cf1bed356efe1b2ad935cff166337e8613a31f78af2cb0c85d0f4329ba406"}
Jul 09 14:55:26.928635 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.928612    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal" event={"ID":"e04123caa9afce06f056b45e663d1ad7","Type":"ContainerStarted","Data":"48ca7427c851fae86bd4f735c1f6be7af7da79d70c8134ded296f26d8342e471"}
Jul 09 14:55:26.947846 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:26.947787    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-59.ec2.internal" podStartSLOduration=2.947770558 podStartE2EDuration="2.947770558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:26.94764747 +0000 UTC m=+3.639060252" watchObservedRunningTime="2026-07-09 14:55:26.947770558 +0000 UTC m=+3.639183337"
Jul 09 14:55:27.329579 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.329482    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:27.329747 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.329591    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:27.329747 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.329725    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:27.329869 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.329793    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.329772385 +0000 UTC m=+6.021185144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:27.329869 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.329858    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:27.329869 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.329893    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.329879297 +0000 UTC m=+6.021292056 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:27.532439 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.532247    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:27.532439 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.532404    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:27.532439 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.532426    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:27.532439 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.532438    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:27.532825 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.532494    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:29.532475584 +0000 UTC m=+6.223888356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:27.750356 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.750240    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:25 +0000 UTC" deadline="2028-02-21 03:24:58.136008753 +0000 UTC"
Jul 09 14:55:27.750356 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.750306    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14196h29m30.385706196s"
Jul 09 14:55:27.906107 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.905345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:27.906107 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.905478    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:27.906107 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.905926    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:27.906107 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:27.906037    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:27.942785 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.941755    2573 generic.go:356] "Generic (PLEG): container finished" podID="7559243164a8714e2d0ac913f0a864c1" containerID="cc8b72c404a3bdf844486590523cb07d551e253c7cf89fb5bf380cdae162bde8" exitCode=0
Jul 09 14:55:27.942785 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:27.942575    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal" event={"ID":"7559243164a8714e2d0ac913f0a864c1","Type":"ContainerDied","Data":"cc8b72c404a3bdf844486590523cb07d551e253c7cf89fb5bf380cdae162bde8"}
Jul 09 14:55:28.902873 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:28.902718    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:28.902873 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:28.902849    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:28.951044 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:28.950986    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal" event={"ID":"7559243164a8714e2d0ac913f0a864c1","Type":"ContainerStarted","Data":"d074de9d2109f53414147f97d6d655cefeaf3683b8711993bfb8c606cf5e2e2a"}
Jul 09 14:55:29.346430 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:29.346340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:29.346430 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:29.346402    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:29.346659 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.346539    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:29.346659 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.346600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:33.346582703 +0000 UTC m=+10.037995467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:29.347007 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.346984    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:29.347084 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.347036    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:33.347021354 +0000 UTC m=+10.038434115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:29.547688 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:29.547652    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:29.547870 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.547813    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:29.547870 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.547831    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:29.547870 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.547843    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:29.548024 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.547901    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:33.547883687 +0000 UTC m=+10.239296449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:29.903722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:29.903657    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:29.904188 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.903788    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:29.904188 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:29.904157    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:29.904302 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:29.904262    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:30.902611 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:30.902557    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:30.902759 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:30.902694    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:31.902692 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:31.902551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:31.903140 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:31.902696    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:31.903140 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:31.902551    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:31.903140 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:31.902809    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:32.903460 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:32.903046    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:32.903460 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:32.903178    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:33.381613 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:33.381506    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:33.381613 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:33.381590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:33.381813 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.381705    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:33.381813 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.381788    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:41.381763282 +0000 UTC m=+18.073176057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:33.381974 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.381705    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:33.382066 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.382047    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:41.382028015 +0000 UTC m=+18.073440779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:33.582366 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:33.582324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:33.582577 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.582534    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:33.582577 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.582558    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:33.582577 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.582571    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:33.582772 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.582629    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:41.582611691 +0000 UTC m=+18.274024455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:33.904439 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:33.904394    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:33.904900 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.904532    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:33.904900 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:33.904591    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:33.904900 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:33.904706    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:34.902747 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:34.902706    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:34.902924 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:34.902845    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:35.902926 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:35.902894    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:35.903430 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:35.903030    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:35.903430 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:35.903061    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:35.903430 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:35.903144    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:36.902849 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:36.902811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:36.903061 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:36.902945    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:37.903194 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:37.903107    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:37.903654 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:37.903119    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:37.903654 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:37.903232    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:37.903654 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:37.903330    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:38.902484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:38.902449    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:38.902672 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:38.902601    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:39.903296 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:39.903263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:39.903741 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:39.903263    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:39.903741 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:39.903376    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:39.903741 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:39.903526    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:40.902459 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:40.902424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:40.902724 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:40.902594    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:41.443794 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:41.443700    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:41.443794 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:41.443759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:41.444258 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.443885    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:41.444258 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.443895    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:41.444258 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.443947    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:57.443927617 +0000 UTC m=+34.135340375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:41.444258 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.443968    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:55:57.443957468 +0000 UTC m=+34.135370229 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:41.644736 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:41.644699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:41.644923 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.644902    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:41.644980 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.644931    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:41.644980 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.644944    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:41.645081 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.645009    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:57.644990832 +0000 UTC m=+34.336403604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:41.903611 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:41.903406    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:41.903611 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:41.903435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:41.903611 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.903557    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:41.903867 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:41.903704    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:42.912686 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:42.912647    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:42.913102 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:42.912766    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:43.903542 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:43.903492    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:43.903735 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:43.903606    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:43.903735 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:43.903652    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:43.903844 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:43.903752    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:44.903338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:44.903304    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:44.903830 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:44.903446    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:45.904469 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:45.904436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:45.904896 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:45.904586    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:45.905265 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:45.905244    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:45.905464 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:45.905437    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:45.989722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:45.989057    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerStarted","Data":"f7871464888f6c6e310754236eb168b153a6cfbccd64e99bcf68be5b2eed5b07"}
Jul 09 14:55:45.992643 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:45.992205    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dfcp" event={"ID":"cdd84b31-ae3f-4b4c-a9c5-9e5f3f4c81ff","Type":"ContainerStarted","Data":"79d8d54d3853a765744ce344b77c3f7c54778f62492de557f96f0d42a7a97eae"}
Jul 09 14:55:45.994949 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:45.994280    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nfgcs" event={"ID":"af7f4e15-26b7-4c65-aa37-ff070a1ab09b","Type":"ContainerStarted","Data":"efefdf16117e4aa2162767b07ac74fdfe4eb449a418294912cfd89231ba08877"}
Jul 09 14:55:46.001154 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.001097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcs57" event={"ID":"e8fdbb3d-3464-4f18-a9cf-ce3dd11895ba","Type":"ContainerStarted","Data":"f12a2a5e6a7b67f9ceaadb96fdf5d13798f0f8ce5cd99aaa0fb8c45e9470096d"}
Jul 09 14:55:46.003508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.003475    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"9d4a32c6d1b0ee56d5b590ef7678e631f54076bdb00309b57d74f305c1e7694b"}
Jul 09 14:55:46.021196 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.019979    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-59.ec2.internal" podStartSLOduration=22.019956675 podStartE2EDuration="22.019956675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:28.972214753 +0000 UTC m=+5.663627534" watchObservedRunningTime="2026-07-09 14:55:46.019956675 +0000 UTC m=+22.711369456"
Jul 09 14:55:46.035695 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.035618    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nfgcs" podStartSLOduration=8.661857845 podStartE2EDuration="23.03559644s" totalImagesPullingTime="14.373738595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:46.035067777 +0000 UTC m=+22.726480558" watchObservedRunningTime="2026-07-09 14:55:46.03559644 +0000 UTC m=+22.727009222"
Jul 09 14:55:46.059002 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.058936    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dq8w4" podStartSLOduration=3.086997785 podStartE2EDuration="22.058912219s" totalImagesPullingTime="18.971914434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:46.058174258 +0000 UTC m=+22.749587068" watchObservedRunningTime="2026-07-09 14:55:46.058912219 +0000 UTC m=+22.750325000"
Jul 09 14:55:46.101090 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.101042    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fcs57" podStartSLOduration=3.054751409 podStartE2EDuration="22.101025824s" totalImagesPullingTime="19.046274415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:46.080666621 +0000 UTC m=+22.772079426" watchObservedRunningTime="2026-07-09 14:55:46.101025824 +0000 UTC m=+22.792438604"
Jul 09 14:55:46.101294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.101270    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8dfcp" podStartSLOduration=3.131649828 podStartE2EDuration="22.101260384s" totalImagesPullingTime="18.969610556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:46.100909115 +0000 UTC m=+22.792321896" watchObservedRunningTime="2026-07-09 14:55:46.101260384 +0000 UTC m=+22.792673213"
Jul 09 14:55:46.121559 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.121490    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-97lch" podStartSLOduration=3.171952132 podStartE2EDuration="22.121474845s" totalImagesPullingTime="18.949522713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:46.121384934 +0000 UTC m=+22.812797713" watchObservedRunningTime="2026-07-09 14:55:46.121474845 +0000 UTC m=+22.812887625"
Jul 09 14:55:46.461970 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.461728    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:46.462401 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.462384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:46.902899 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:46.902864    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:46.903119 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:46.902978    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:47.006352 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.006310    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-97lch" event={"ID":"31de8069-1975-404b-91e2-c91ceea0e229","Type":"ContainerStarted","Data":"22af99d2e698e05cb67c11c8aa8fb0a8371ad77edcdfde38912b0527d141b04b"}
Jul 09 14:55:47.007746 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.007716    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dq8w4" event={"ID":"66e5db36-142b-4113-a30b-f2e9a915e1a0","Type":"ContainerStarted","Data":"f7879e0a9eda3cb874262e4cfa59236ceb2fa189f112671730ed3ac06d399fef"}
Jul 09 14:55:47.010224 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010205    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 14:55:47.010523 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010494    2573 generic.go:356] "Generic (PLEG): container finished" podID="d68174b9-e26b-4000-a7c5-ac99aff8fbf0" containerID="e2893d0e7fed42e017e7c53569c32cd7c4f5447a371c54e276b8fea9fc4656d6" exitCode=1
Jul 09 14:55:47.010594 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010574    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"ada5b2c70258f46c6a2ac788ce203517560268e6e8fd2174222edf2d887a8733"}
Jul 09 14:55:47.010668 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"4d30e11db13d4635198674a16ed235650896f3ff33332e68b744940835adb58c"}
Jul 09 14:55:47.010724 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010709    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"436bb2fc389515d5fdca2b1141904da4749150b4dc5a30db88130e2b138fc03f"}
Jul 09 14:55:47.010778 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010759    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"889e2d3539ec1c6cc5b0067a7db25aed315a79f5d5ab0b106cf98dfe2e590c8c"}
Jul 09 14:55:47.010830 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.010807    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerDied","Data":"e2893d0e7fed42e017e7c53569c32cd7c4f5447a371c54e276b8fea9fc4656d6"}
Jul 09 14:55:47.011841 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.011819    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4" event={"ID":"a7f92e77-9d4f-417d-be03-3524370acf03","Type":"ContainerStarted","Data":"28f639ea6ba7d1fcfb9e9e211d78540bab56bf78a73ca623a5b6436f65dcb1e8"}
Jul 09 14:55:47.014707 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.014679    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="f7871464888f6c6e310754236eb168b153a6cfbccd64e99bcf68be5b2eed5b07" exitCode=0
Jul 09 14:55:47.014813 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.014780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"f7871464888f6c6e310754236eb168b153a6cfbccd64e99bcf68be5b2eed5b07"}
Jul 09 14:55:47.457041 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.457012    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 14:55:47.793133 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.792948    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:55:47.457032132Z","UUID":"40ec877a-274c-4335-906e-a106a0ce8d8c","Handler":null,"Name":"","Endpoint":""}
Jul 09 14:55:47.794426 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.794404    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 14:55:47.794618 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.794460    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 14:55:47.902696 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.902663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:47.902696 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:47.902690    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:47.902946 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:47.902888    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:47.903009 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:47.902979    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:48.019463 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:48.019429    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4" event={"ID":"a7f92e77-9d4f-417d-be03-3524370acf03","Type":"ContainerStarted","Data":"d534d4369f7bf42f7f7193d885bdc04f91499a10b57abd812f958fae95114f40"}
Jul 09 14:55:48.021342 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:48.021308    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 14:55:48.021342 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:48.021325    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjnpf" event={"ID":"a3339f4e-77a4-4852-bee7-0ac421cfe7b3","Type":"ContainerStarted","Data":"ffeac074c4d6d87c0e5a3d22b3461c444045fa0018b4218db06f0320f188737a"}
Jul 09 14:55:48.043815 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:48.043633    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pjnpf" podStartSLOduration=5.063579598 podStartE2EDuration="24.043580678s" totalImagesPullingTime="18.98000108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:48.042832835 +0000 UTC m=+24.734245619" watchObservedRunningTime="2026-07-09 14:55:48.043580678 +0000 UTC m=+24.734993647"
Jul 09 14:55:48.902880 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:48.902788    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:48.903042 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:48.902910    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:49.027117 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.027089    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 14:55:49.027596 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.027530    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"669a273856a6a1b24fdfa631368731e86d7e4b135bf3c93eead1b15cb7f09a11"}
Jul 09 14:55:49.029940 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.029915    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4" event={"ID":"a7f92e77-9d4f-417d-be03-3524370acf03","Type":"ContainerStarted","Data":"ef196c320af1d3679264906659f8958b7a15468417eeb40c8bd21599f269d926"}
Jul 09 14:55:49.053209 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.053116    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gftx4" podStartSLOduration=3.726229505 podStartE2EDuration="25.053095638s" totalImagesPullingTime="21.326866133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:49.052630206 +0000 UTC m=+25.744043013" watchObservedRunningTime="2026-07-09 14:55:49.053095638 +0000 UTC m=+25.744508418"
Jul 09 14:55:49.902633 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.902451    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:49.902818 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:49.902484    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:49.902818 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:49.902724    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:49.902939 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:49.902835    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:50.903062 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:50.902981    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:50.903765 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:50.903117    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:51.038180 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.037978    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 14:55:51.038588 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.038549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"2cc0a4c5a01e03a8bb9fad223653726d182d7bfcb7538860203e329207344a8a"}
Jul 09 14:55:51.038824 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.038787    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:51.038952 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.038853    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:51.038952 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.038898    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:51.039052 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.039033    2573 scope.go:117] "RemoveContainer" containerID="e2893d0e7fed42e017e7c53569c32cd7c4f5447a371c54e276b8fea9fc4656d6"
Jul 09 14:55:51.056391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.056360    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:51.056589 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.056506    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:55:51.902780 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.902700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:51.902934 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:51.902827    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:51.902934 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:51.902851    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:51.903026 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:51.902951    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:52.802199 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.802113    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9vpp"]
Jul 09 14:55:52.802694 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.802216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:52.802694 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:52.802304    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:52.805338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.805310    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8rr9"]
Jul 09 14:55:52.805489 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.805417    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:52.805572 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:52.805530    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:52.805973 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.805945    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2wlw"]
Jul 09 14:55:52.806095 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:52.806037    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:52.806153 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:52.806128    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:53.048049 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.048023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 14:55:53.048459 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.048424    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" event={"ID":"d68174b9-e26b-4000-a7c5-ac99aff8fbf0","Type":"ContainerStarted","Data":"57a90645c6e5cf4c8a4e3756f993340f8de7ec1dbe9125cc96816915db86d631"}
Jul 09 14:55:53.053394 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.053317    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="4a063dd282453c2b9ad83ba5987b1bd68632eb57f6b4e7a0ba0257455e7a8dce" exitCode=0
Jul 09 14:55:53.053394 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.053351    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"4a063dd282453c2b9ad83ba5987b1bd68632eb57f6b4e7a0ba0257455e7a8dce"}
Jul 09 14:55:53.080527 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.080469    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q" podStartSLOduration=10.056065956 podStartE2EDuration="29.080452863s" totalImagesPullingTime="19.024386907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:53.078841616 +0000 UTC m=+29.770254422" watchObservedRunningTime="2026-07-09 14:55:53.080452863 +0000 UTC m=+29.771865621"
Jul 09 14:55:53.162839 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.162812    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:53.163022 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.162918    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 14:55:53.163414 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.163393    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nfgcs"
Jul 09 14:55:53.903915 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:53.903892    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:53.904260 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:53.904008    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:54.057871 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:54.057838    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="888bdc58c7e91b988530399bc19d54ac017070caa625fc529c2bd7774819bbfa" exitCode=0
Jul 09 14:55:54.058041 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:54.057922    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"888bdc58c7e91b988530399bc19d54ac017070caa625fc529c2bd7774819bbfa"}
Jul 09 14:55:54.903298 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:54.903270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:54.903443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:54.903298    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:54.903443 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:54.903379    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:54.903542 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:54.903507    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:55.062325 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:55.062239    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="f53facdf4909e27eb15bbdfbe4a98953ac5b9ce1d26e1d70f8fe7fab2a92760d" exitCode=0
Jul 09 14:55:55.062325 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:55.062316    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"f53facdf4909e27eb15bbdfbe4a98953ac5b9ce1d26e1d70f8fe7fab2a92760d"}
Jul 09 14:55:55.902730 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:55.902705    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:55.902913 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:55.902870    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:56.903177 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:56.903131    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:56.903785 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:56.903269    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j2wlw" podUID="3d999699-2449-40a4-a43b-3a4f6ac94a5b"
Jul 09 14:55:56.903785 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:56.903326    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:56.903785 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:56.903450    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8rr9" podUID="71e35dd9-31e7-4ae1-9d92-74f7e2a13424"
Jul 09 14:55:57.470914 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:57.470877    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:57.471179 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:57.470930    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:57.471179 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.471046    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:57.471179 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.471046    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:57.471179 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.471113    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret podName:7302b010-3a52-4b6a-92fb-571b8aaf0e25 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:29.47109416 +0000 UTC m=+66.162506933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret") pod "global-pull-secret-syncer-h9vpp" (UID: "7302b010-3a52-4b6a-92fb-571b8aaf0e25") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:57.471179 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.471130    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:56:29.471122791 +0000 UTC m=+66.162535552 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:57.673301 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:57.673265    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:57.673487 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.673462    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:57.673487 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.673486    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:57.673647 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.673499    2573 projected.go:196] Error preparing data for projected volume kube-api-access-c46l4 for pod openshift-network-diagnostics/network-check-target-r8rr9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:57.673647 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.673601    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4 podName:71e35dd9-31e7-4ae1-9d92-74f7e2a13424 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:29.673578731 +0000 UTC m=+66.364991503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c46l4" (UniqueName: "kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4") pod "network-check-target-r8rr9" (UID: "71e35dd9-31e7-4ae1-9d92-74f7e2a13424") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:57.903060 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:57.902979    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:57.903227 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:57.903103    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h9vpp" podUID="7302b010-3a52-4b6a-92fb-571b8aaf0e25"
Jul 09 14:55:58.648442 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.648365    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-59.ec2.internal" event="NodeReady"
Jul 09 14:55:58.648647 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.648558    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 14:55:58.708186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.708146    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2cd85"]
Jul 09 14:55:58.763993 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.763961    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8wmcv"]
Jul 09 14:55:58.764183 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.764100    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.767871 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.767851    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\""
Jul 09 14:55:58.768281 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.768260    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 14:55:58.768281 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.768274    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 14:55:58.788300 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.788264    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2cd85"]
Jul 09 14:55:58.788457 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.788329    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wmcv"]
Jul 09 14:55:58.788457 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.788427    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.794400 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.794375    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 14:55:58.794558 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.794437    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qmd6h\""
Jul 09 14:55:58.794558 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.794380    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 14:55:58.794665 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.794380    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 14:55:58.882687 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqvs\" (UniqueName: \"kubernetes.io/projected/ad661331-e9c0-4384-9797-e23cd0ef48fa-kube-api-access-cjqvs\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.882862 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-config-volume\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.882862 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882748    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-tmp-dir\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.882862 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882830    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52swt\" (UniqueName: \"kubernetes.io/projected/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-kube-api-access-52swt\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.882862 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882855    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.883106 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.882885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad661331-e9c0-4384-9797-e23cd0ef48fa-cert\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.902821 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.902730    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:55:58.902985 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.902735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:55:58.906608 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.906566    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:55:58.906608 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.906566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:55:58.906608 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.906604    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\""
Jul 09 14:55:58.907232 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.906566    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:55:58.907232 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.906642    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\""
Jul 09 14:55:58.983957 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.983916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-config-volume\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.984132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.983968    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-tmp-dir\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.984132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.984011    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52swt\" (UniqueName: \"kubernetes.io/projected/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-kube-api-access-52swt\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.984132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.984035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.984132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.984060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad661331-e9c0-4384-9797-e23cd0ef48fa-cert\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.984132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.984119    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqvs\" (UniqueName: \"kubernetes.io/projected/ad661331-e9c0-4384-9797-e23cd0ef48fa-kube-api-access-cjqvs\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.985561 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:58.984631    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:58.985561 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:58.984696    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:59.484676739 +0000 UTC m=+36.176089512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:58.985561 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.984725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-tmp-dir\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.985876 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.985825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-config-volume\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.989630 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.989607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad661331-e9c0-4384-9797-e23cd0ef48fa-cert\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:58.997118 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.997086    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52swt\" (UniqueName: \"kubernetes.io/projected/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-kube-api-access-52swt\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:58.997236 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:58.997177    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqvs\" (UniqueName: \"kubernetes.io/projected/ad661331-e9c0-4384-9797-e23cd0ef48fa-kube-api-access-cjqvs\") pod \"ingress-canary-8wmcv\" (UID: \"ad661331-e9c0-4384-9797-e23cd0ef48fa\") " pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:59.098269 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:59.098230    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wmcv"
Jul 09 14:55:59.282266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:59.282059    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wmcv"]
Jul 09 14:55:59.334831 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:55:59.334797    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad661331_e9c0_4384_9797_e23cd0ef48fa.slice/crio-5661ee4212935cedb6da1e2f50a91ba72b95c60793659d6afd043fdf09a7d7c6 WatchSource:0}: Error finding container 5661ee4212935cedb6da1e2f50a91ba72b95c60793659d6afd043fdf09a7d7c6: Status 404 returned error can't find the container with id 5661ee4212935cedb6da1e2f50a91ba72b95c60793659d6afd043fdf09a7d7c6
Jul 09 14:55:59.488409 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:59.488371    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:55:59.488610 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:59.488526    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:59.488610 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:55:59.488589    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:00.488573971 +0000 UTC m=+37.179986732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:59.903440 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:59.903362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:55:59.907642 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:55:59.907090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:56:00.077259 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:00.077219    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="0029b3116850e77bfe6499e2ec24b7a962a806169e8c3a2570dc3fd0cee41000" exitCode=0
Jul 09 14:56:00.077424 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:00.077260    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"0029b3116850e77bfe6499e2ec24b7a962a806169e8c3a2570dc3fd0cee41000"}
Jul 09 14:56:00.078583 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:00.078545    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wmcv" event={"ID":"ad661331-e9c0-4384-9797-e23cd0ef48fa","Type":"ContainerStarted","Data":"5661ee4212935cedb6da1e2f50a91ba72b95c60793659d6afd043fdf09a7d7c6"}
Jul 09 14:56:00.495464 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:00.495373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:56:00.495653 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:00.495538    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:00.495653 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:00.495606    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:02.495586877 +0000 UTC m=+39.186999648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:01.085064 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:01.085034    2573 generic.go:356] "Generic (PLEG): container finished" podID="e8651a5a-be39-4723-bb82-b460740c57d4" containerID="6a77c850331457c6853633db6d64eee24e0efbc1378194c4f46a6b4b9b638a4b" exitCode=0
Jul 09 14:56:01.085506 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:01.085087    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerDied","Data":"6a77c850331457c6853633db6d64eee24e0efbc1378194c4f46a6b4b9b638a4b"}
Jul 09 14:56:02.091079 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:02.090833    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" event={"ID":"e8651a5a-be39-4723-bb82-b460740c57d4","Type":"ContainerStarted","Data":"79ae67844d618170a1f57f514f278a53c26f5236d0428c83a4169315af1100fc"}
Jul 09 14:56:02.092308 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:02.092283    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wmcv" event={"ID":"ad661331-e9c0-4384-9797-e23cd0ef48fa","Type":"ContainerStarted","Data":"c1bb1e40ab1987ad53ec8fa664215563e6cae6a76770692c51fb23476aa43e11"}
Jul 09 14:56:02.120115 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:02.120066    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2lt9v" podStartSLOduration=7.861861228 podStartE2EDuration="38.120042937s" totalImagesPullingTime="30.258181709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:02.118437269 +0000 UTC m=+38.809850052" watchObservedRunningTime="2026-07-09 14:56:02.120042937 +0000 UTC m=+38.811455717"
Jul 09 14:56:02.138127 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:02.137942    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8wmcv" podStartSLOduration=1.750663001 podStartE2EDuration="4.137921064s" totalImagesPullingTime="2.387258063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:02.136883067 +0000 UTC m=+38.828295847" watchObservedRunningTime="2026-07-09 14:56:02.137921064 +0000 UTC m=+38.829333844"
Jul 09 14:56:02.511162 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:02.511125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:56:02.511345 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:02.511280    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:02.511390 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:02.511349    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:06.511334527 +0000 UTC m=+43.202747286 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:06.540979 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:06.540934    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:56:06.541489 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:06.541092    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:06.541489 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:06.541161    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:14.541143608 +0000 UTC m=+51.232556366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:14.598152 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:14.598113    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:56:14.598629 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:14.598239    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:14.598629 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:14.598287    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:30.598275233 +0000 UTC m=+67.289687990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:24.075485 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:24.075454    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xqv5q"
Jul 09 14:56:29.503171 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.503134    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:56:29.503171 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.503188    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:56:29.506675 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.506654    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:56:29.506737 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.506653    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:56:29.514238 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:29.514215    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 14:56:29.514337 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:29.514282    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs podName:3d999699-2449-40a4-a43b-3a4f6ac94a5b nodeName:}" failed. No retries permitted until 2026-07-09 14:57:33.514266185 +0000 UTC m=+130.205678944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs") pod "network-metrics-daemon-j2wlw" (UID: "3d999699-2449-40a4-a43b-3a4f6ac94a5b") : secret "metrics-daemon-secret" not found
Jul 09 14:56:29.517722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.517697    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7302b010-3a52-4b6a-92fb-571b8aaf0e25-original-pull-secret\") pod \"global-pull-secret-syncer-h9vpp\" (UID: \"7302b010-3a52-4b6a-92fb-571b8aaf0e25\") " pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:56:29.617061 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.617026    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h9vpp"
Jul 09 14:56:29.705000 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.704971    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:56:29.709793 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.709769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:56:29.719029 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.719002    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:56:29.728530 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.728482    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46l4\" (UniqueName: \"kubernetes.io/projected/71e35dd9-31e7-4ae1-9d92-74f7e2a13424-kube-api-access-c46l4\") pod \"network-check-target-r8rr9\" (UID: \"71e35dd9-31e7-4ae1-9d92-74f7e2a13424\") " pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:56:29.740818 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.740795    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h9vpp"]
Jul 09 14:56:29.743547 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:56:29.743506    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7302b010_3a52_4b6a_92fb_571b8aaf0e25.slice/crio-985ac8297f57b4305f05457d07182a77bf9beee9d9aeee9364e1c695dfb08f80 WatchSource:0}: Error finding container 985ac8297f57b4305f05457d07182a77bf9beee9d9aeee9364e1c695dfb08f80: Status 404 returned error can't find the container with id 985ac8297f57b4305f05457d07182a77bf9beee9d9aeee9364e1c695dfb08f80
Jul 09 14:56:29.818098 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.818007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmw8t\""
Jul 09 14:56:29.824907 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.824888    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:56:29.947026 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:29.946999    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8rr9"]
Jul 09 14:56:29.949759 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:56:29.949735    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e35dd9_31e7_4ae1_9d92_74f7e2a13424.slice/crio-b8a36bd10d86b2edc810de5a7f03a187d18b9d9bb4fea8ff002f737e0b310d52 WatchSource:0}: Error finding container b8a36bd10d86b2edc810de5a7f03a187d18b9d9bb4fea8ff002f737e0b310d52: Status 404 returned error can't find the container with id b8a36bd10d86b2edc810de5a7f03a187d18b9d9bb4fea8ff002f737e0b310d52
Jul 09 14:56:30.162187 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:30.162152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8rr9" event={"ID":"71e35dd9-31e7-4ae1-9d92-74f7e2a13424","Type":"ContainerStarted","Data":"b8a36bd10d86b2edc810de5a7f03a187d18b9d9bb4fea8ff002f737e0b310d52"}
Jul 09 14:56:30.163175 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:30.163140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9vpp" event={"ID":"7302b010-3a52-4b6a-92fb-571b8aaf0e25","Type":"ContainerStarted","Data":"985ac8297f57b4305f05457d07182a77bf9beee9d9aeee9364e1c695dfb08f80"}
Jul 09 14:56:30.610494 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:30.610344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:56:30.610970 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:30.610540    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:30.610970 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:56:30.610611    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:02.610591467 +0000 UTC m=+99.302004240 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:35.178444 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:35.178408    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8rr9" event={"ID":"71e35dd9-31e7-4ae1-9d92-74f7e2a13424","Type":"ContainerStarted","Data":"1477de6f9b5c40a81bb79d0d96d233a407ac8a0b43b571157abc81a3e71d4f9a"}
Jul 09 14:56:35.179009 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:35.178545    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:56:35.179977 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:35.179952    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h9vpp" event={"ID":"7302b010-3a52-4b6a-92fb-571b8aaf0e25","Type":"ContainerStarted","Data":"a3f72c0ab1c3425b68973324e67d061e3a16fbf9de8ee4557fb1056d7246bfaa"}
Jul 09 14:56:35.200698 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:35.200650    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8rr9" podStartSLOduration=66.642762627 podStartE2EDuration="1m11.200635027s" totalImagesPullingTime="4.5578724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:35.199019628 +0000 UTC m=+71.890432408" watchObservedRunningTime="2026-07-09 14:56:35.200635027 +0000 UTC m=+71.892047806"
Jul 09 14:56:35.217874 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:56:35.217826    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h9vpp" podStartSLOduration=66.45092734 podStartE2EDuration="1m11.21781233s" totalImagesPullingTime="4.76688499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:35.217444809 +0000 UTC m=+71.908857588" watchObservedRunningTime="2026-07-09 14:56:35.21781233 +0000 UTC m=+71.909225106"
Jul 09 14:57:02.623075 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:02.622985    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:57:02.623467 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:02.623100    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:57:02.623467 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:02.623163    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls podName:a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4 nodeName:}" failed. No retries permitted until 2026-07-09 14:58:06.623148774 +0000 UTC m=+163.314561531 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls") pod "dns-default-2cd85" (UID: "a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4") : secret "dns-default-metrics-tls" not found
Jul 09 14:57:06.184151 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:06.184120    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8rr9"
Jul 09 14:57:10.670669 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.670637    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-f9mfq"]
Jul 09 14:57:10.673873 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.673855    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.677301 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.677282    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 09 14:57:10.677597 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.677582    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 14:57:10.677673 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.677655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 09 14:57:10.678940 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.678913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-v7gbh\""
Jul 09 14:57:10.679178 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.679162    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 14:57:10.684969 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.684950    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 09 14:57:10.700943 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.700920    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-f9mfq"]
Jul 09 14:57:10.780244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67198508-e405-4194-85ab-832bab637cf2-serving-cert\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.780244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780245    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9k8\" (UniqueName: \"kubernetes.io/projected/67198508-e405-4194-85ab-832bab637cf2-kube-api-access-nv9k8\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.780482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.780482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-tmp\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.780482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-snapshots\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.780482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.780453    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.798553 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.798506    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:57:10.800527 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.800490    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"]
Jul 09 14:57:10.800655 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.800609    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.802207 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.802180    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-6xrfw"]
Jul 09 14:57:10.802315 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.802300    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.803744 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.803728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.805271 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.805251    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-133-59.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-133-59.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret"
Jul 09 14:57:10.805587 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.805562    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-d76fb84f5-vwfhs\" is forbidden: User \"system:node:ip-10-0-133-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-133-59.ec2.internal' and this object" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.806459 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.806438    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 14:57:10.806745 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.806724    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 14:57:10.806843 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.806726    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gfkwb\""
Jul 09 14:57:10.806843 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.806780    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 14:57:10.806843 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.806743    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 14:57:10.807283 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.807262    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 14:57:10.807998 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.807981    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 14:57:10.808103 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.807999    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57p5w\""
Jul 09 14:57:10.808103 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.807983    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:57:10.809614 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.809599    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 14:57:10.809957 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.809939    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:57:10.811807 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.811786    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qgzhq\""
Jul 09 14:57:10.817338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.817310    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 14:57:10.819825 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.819674    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"]
Jul 09 14:57:10.826292 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.826272    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:57:10.828634 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.828619    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 14:57:10.833874 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.833848    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6xrfw"]
Jul 09 14:57:10.881275 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881249    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881275 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881281    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9988cc9e-a398-4c1d-b8ab-adbca8f84020-serving-cert\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-trusted-ca\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881363    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmz6b\" (UniqueName: \"kubernetes.io/projected/9988cc9e-a398-4c1d-b8ab-adbca8f84020-kube-api-access-jmz6b\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-tmp\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881400    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881418    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.881472 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881438    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlkr8\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881549    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-snapshots\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8tch\" (UniqueName: \"kubernetes.io/projected/1fe33b31-6e9a-46e0-95f2-2930d77327e8-kube-api-access-g8tch\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881616    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-config\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881709    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.881774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881770    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881777    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-tmp\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881821    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881843    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67198508-e405-4194-85ab-832bab637cf2-serving-cert\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881864    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9k8\" (UniqueName: \"kubernetes.io/projected/67198508-e405-4194-85ab-832bab637cf2-kube-api-access-nv9k8\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881869    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.881885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.882300 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.882119    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/67198508-e405-4194-85ab-832bab637cf2-snapshots\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.882470 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.882453    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67198508-e405-4194-85ab-832bab637cf2-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.884219 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.884197    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67198508-e405-4194-85ab-832bab637cf2-serving-cert\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.897743 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.897718    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"]
Jul 09 14:57:10.900077 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.900061    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"
Jul 09 14:57:10.904043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.904019    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 09 14:57:10.904154 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.904072    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xp7bl\""
Jul 09 14:57:10.904735 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.904711    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:57:10.905090 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.905073    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9k8\" (UniqueName: \"kubernetes.io/projected/67198508-e405-4194-85ab-832bab637cf2-kube-api-access-nv9k8\") pod \"insights-operator-68d9dd94cf-f9mfq\" (UID: \"67198508-e405-4194-85ab-832bab637cf2\") " pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.915414 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.915391    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"]
Jul 09 14:57:10.983039 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.982953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-trusted-ca\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.983039 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.982988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmz6b\" (UniqueName: \"kubernetes.io/projected/9988cc9e-a398-4c1d-b8ab-adbca8f84020-kube-api-access-jmz6b\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.983039 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9988cc9e-a398-4c1d-b8ab-adbca8f84020-serving-cert\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983060    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlkr8\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983147    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8tch\" (UniqueName: \"kubernetes.io/projected/1fe33b31-6e9a-46e0-95f2-2930d77327e8-kube-api-access-g8tch\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983181    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vx56\" (UniqueName: \"kubernetes.io/projected/0fb4e695-7efb-4060-b37a-7379e233daed-kube-api-access-2vx56\") pod \"volume-data-source-validator-78495597f6-ss7mv\" (UID: \"0fb4e695-7efb-4060-b37a-7379e233daed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.983241    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.983319    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:57:10.983316 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.983334    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d76fb84f5-vwfhs: secret "image-registry-tls" not found
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.983325    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls podName:1fe33b31-6e9a-46e0-95f2-2930d77327e8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.483303083 +0000 UTC m=+108.174715843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls") pod "cluster-samples-operator-65db858894-wh5dp" (UID: "1fe33b31-6e9a-46e0-95f2-2930d77327e8") : secret "samples-operator-tls" not found
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:10.983485    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.483467503 +0000 UTC m=+108.174880275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : secret "image-registry-tls" not found
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983507    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983619    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983659    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-config\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.983869 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.983848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.984234 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.984182    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-trusted-ca\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.984409 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.984392    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.984495 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.984475    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9988cc9e-a398-4c1d-b8ab-adbca8f84020-config\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.984774 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.984755    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.984866 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.984853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq"
Jul 09 14:57:10.985713 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.985694    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9988cc9e-a398-4c1d-b8ab-adbca8f84020-serving-cert\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.985795 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.985729    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.995988 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.995963    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmz6b\" (UniqueName: \"kubernetes.io/projected/9988cc9e-a398-4c1d-b8ab-adbca8f84020-kube-api-access-jmz6b\") pod \"console-operator-7866497494-6xrfw\" (UID: \"9988cc9e-a398-4c1d-b8ab-adbca8f84020\") " pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:10.996575 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.996555    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8tch\" (UniqueName: \"kubernetes.io/projected/1fe33b31-6e9a-46e0-95f2-2930d77327e8-kube-api-access-g8tch\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:10.996739 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.996723    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlkr8\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:10.996931 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:10.996911    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:11.084442 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.084406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vx56\" (UniqueName: \"kubernetes.io/projected/0fb4e695-7efb-4060-b37a-7379e233daed-kube-api-access-2vx56\") pod \"volume-data-source-validator-78495597f6-ss7mv\" (UID: \"0fb4e695-7efb-4060-b37a-7379e233daed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"
Jul 09 14:57:11.097880 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.097848    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vx56\" (UniqueName: \"kubernetes.io/projected/0fb4e695-7efb-4060-b37a-7379e233daed-kube-api-access-2vx56\") pod \"volume-data-source-validator-78495597f6-ss7mv\" (UID: \"0fb4e695-7efb-4060-b37a-7379e233daed\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"
Jul 09 14:57:11.114649 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.114622    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-f9mfq"]
Jul 09 14:57:11.117484 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:11.117456    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67198508_e405_4194_85ab_832bab637cf2.slice/crio-3f2962962b521d4dcbd822ed216320121406424862e4e9eb850e95eb13b1e24d WatchSource:0}: Error finding container 3f2962962b521d4dcbd822ed216320121406424862e4e9eb850e95eb13b1e24d: Status 404 returned error can't find the container with id 3f2962962b521d4dcbd822ed216320121406424862e4e9eb850e95eb13b1e24d
Jul 09 14:57:11.122761 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.122743    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:11.217019 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.216991    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"
Jul 09 14:57:11.246204 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.246126    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-6xrfw"]
Jul 09 14:57:11.249477 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:11.249434    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9988cc9e_a398_4c1d_b8ab_adbca8f84020.slice/crio-1f694f4f542aa051004df0325f4a5ac92a2cd32ddbd7fa0c2ba7f5c8e1c67a9d WatchSource:0}: Error finding container 1f694f4f542aa051004df0325f4a5ac92a2cd32ddbd7fa0c2ba7f5c8e1c67a9d: Status 404 returned error can't find the container with id 1f694f4f542aa051004df0325f4a5ac92a2cd32ddbd7fa0c2ba7f5c8e1c67a9d
Jul 09 14:57:11.266100 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.266026    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6xrfw" event={"ID":"9988cc9e-a398-4c1d-b8ab-adbca8f84020","Type":"ContainerStarted","Data":"1f694f4f542aa051004df0325f4a5ac92a2cd32ddbd7fa0c2ba7f5c8e1c67a9d"}
Jul 09 14:57:11.267477 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.267425    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq" event={"ID":"67198508-e405-4194-85ab-832bab637cf2","Type":"ContainerStarted","Data":"3f2962962b521d4dcbd822ed216320121406424862e4e9eb850e95eb13b1e24d"}
Jul 09 14:57:11.343756 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.343723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv"]
Jul 09 14:57:11.346230 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:11.346199    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb4e695_7efb_4060_b37a_7379e233daed.slice/crio-9428af488dd05c5fc1036051e4f222006b9319dbc385f368735e012d63ab2b0d WatchSource:0}: Error finding container 9428af488dd05c5fc1036051e4f222006b9319dbc385f368735e012d63ab2b0d: Status 404 returned error can't find the container with id 9428af488dd05c5fc1036051e4f222006b9319dbc385f368735e012d63ab2b0d
Jul 09 14:57:11.487779 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.487745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:11.487945 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:11.487794    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:11.487945 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.487896    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 14:57:11.488021 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.487960    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls podName:1fe33b31-6e9a-46e0-95f2-2930d77327e8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.487945673 +0000 UTC m=+109.179358435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls") pod "cluster-samples-operator-65db858894-wh5dp" (UID: "1fe33b31-6e9a-46e0-95f2-2930d77327e8") : secret "samples-operator-tls" not found
Jul 09 14:57:11.488021 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.487898    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:57:11.488021 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.487996    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d76fb84f5-vwfhs: secret "image-registry-tls" not found
Jul 09 14:57:11.488129 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.488039    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.488025968 +0000 UTC m=+109.179438727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : secret "image-registry-tls" not found
Jul 09 14:57:11.984775 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.984429    2573 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition
Jul 09 14:57:11.984775 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:11.984539    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:12.484497309 +0000 UTC m=+109.175910071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : failed to sync secret cache: timed out waiting for the condition
Jul 09 14:57:12.253436 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.253359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 14:57:12.272868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.272829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv" event={"ID":"0fb4e695-7efb-4060-b37a-7379e233daed","Type":"ContainerStarted","Data":"9428af488dd05c5fc1036051e4f222006b9319dbc385f368735e012d63ab2b0d"}
Jul 09 14:57:12.498185 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.498140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:12.498371 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:12.498307    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 14:57:12.498437 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:12.498376    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls podName:1fe33b31-6e9a-46e0-95f2-2930d77327e8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:14.498357911 +0000 UTC m=+111.189770688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls") pod "cluster-samples-operator-65db858894-wh5dp" (UID: "1fe33b31-6e9a-46e0-95f2-2930d77327e8") : secret "samples-operator-tls" not found
Jul 09 14:57:12.498437 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:12.498400    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:57:12.498437 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:12.498421    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d76fb84f5-vwfhs: secret "image-registry-tls" not found
Jul 09 14:57:12.498618 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:12.498471    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:14.498452758 +0000 UTC m=+111.189865530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : secret "image-registry-tls" not found
Jul 09 14:57:12.498618 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.498308    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:12.498618 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.498533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:12.503097 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:12.503068    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:13.277641 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:13.277596    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv" event={"ID":"0fb4e695-7efb-4060-b37a-7379e233daed","Type":"ContainerStarted","Data":"a2bbd992aa5fc1789e47103cbc25ee7dca0777fbab2ca75a4fbea3ddf3524d53"}
Jul 09 14:57:13.295789 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:13.295729    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ss7mv" podStartSLOduration=2.078641814 podStartE2EDuration="3.295713342s" totalImagesPullingTime="1.217071528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:13.29509059 +0000 UTC m=+109.986503395" watchObservedRunningTime="2026-07-09 14:57:13.295713342 +0000 UTC m=+109.987126122"
Jul 09 14:57:14.282315 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.282286    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/0.log"
Jul 09 14:57:14.282803 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.282327    2573 generic.go:356] "Generic (PLEG): container finished" podID="9988cc9e-a398-4c1d-b8ab-adbca8f84020" containerID="0d3dbcacc03c9cd1e3bb60987cd017f8a13ae36b1fed2c03bc2f8894cb897190" exitCode=255
Jul 09 14:57:14.282803 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.282404    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6xrfw" event={"ID":"9988cc9e-a398-4c1d-b8ab-adbca8f84020","Type":"ContainerDied","Data":"0d3dbcacc03c9cd1e3bb60987cd017f8a13ae36b1fed2c03bc2f8894cb897190"}
Jul 09 14:57:14.282803 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.282677    2573 scope.go:117] "RemoveContainer" containerID="0d3dbcacc03c9cd1e3bb60987cd017f8a13ae36b1fed2c03bc2f8894cb897190"
Jul 09 14:57:14.283875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.283844    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq" event={"ID":"67198508-e405-4194-85ab-832bab637cf2","Type":"ContainerStarted","Data":"39531492411c204b1a1f7cead21a95a6f838d67195e62826c89e0991714aac84"}
Jul 09 14:57:14.322227 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.322180    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq" podStartSLOduration=1.6330150319999999 podStartE2EDuration="4.322163302s" totalImagesPullingTime="2.68914827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:14.321216693 +0000 UTC m=+111.012629520" watchObservedRunningTime="2026-07-09 14:57:14.322163302 +0000 UTC m=+111.013576060"
Jul 09 14:57:14.513430 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.513387    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:14.513644 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.513499    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:14.513644 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.513577    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:57:14.513644 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.513601    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d76fb84f5-vwfhs: secret "image-registry-tls" not found
Jul 09 14:57:14.513644 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.513610    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 14:57:14.513850 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.513661    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.513644393 +0000 UTC m=+115.205057151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : secret "image-registry-tls" not found
Jul 09 14:57:14.513850 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.513675    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls podName:1fe33b31-6e9a-46e0-95f2-2930d77327e8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.513668276 +0000 UTC m=+115.205081033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls") pod "cluster-samples-operator-65db858894-wh5dp" (UID: "1fe33b31-6e9a-46e0-95f2-2930d77327e8") : secret "samples-operator-tls" not found
Jul 09 14:57:14.723900 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.723861    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r7bhj"]
Jul 09 14:57:14.726043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.726021    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.731220 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.731185    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 14:57:14.731332 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.731229    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dh2jv\""
Jul 09 14:57:14.731396 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.731334    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 14:57:14.739004 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.738983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r7bhj"]
Jul 09 14:57:14.815651 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.815610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-crio-socket\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.815831 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.815661    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw84w\" (UniqueName: \"kubernetes.io/projected/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-api-access-nw84w\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.815831 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.815692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-data-volume\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.815831 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.815716    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.815831 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.815817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.916323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.916282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-crio-socket\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.916323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.916325    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw84w\" (UniqueName: \"kubernetes.io/projected/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-api-access-nw84w\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.916431    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-crio-socket\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.916349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-data-volume\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.917033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-data-volume\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.917109    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917663 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.917230    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:14.917663 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.917310    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:14.917663 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.917337    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:14.917663 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.917389    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.417369367 +0000 UTC m=+112.108782128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:14.919979 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:14.919689    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:15.419665577 +0000 UTC m=+112.111078342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:14.934372 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:14.934344    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw84w\" (UniqueName: \"kubernetes.io/projected/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-api-access-nw84w\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:15.288975 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.288951    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 14:57:15.289391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.289370    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/0.log"
Jul 09 14:57:15.289432 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.289412    2573 generic.go:356] "Generic (PLEG): container finished" podID="9988cc9e-a398-4c1d-b8ab-adbca8f84020" containerID="40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49" exitCode=255
Jul 09 14:57:15.289531 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.289492    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6xrfw" event={"ID":"9988cc9e-a398-4c1d-b8ab-adbca8f84020","Type":"ContainerDied","Data":"40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49"}
Jul 09 14:57:15.289601 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.289590    2573 scope.go:117] "RemoveContainer" containerID="0d3dbcacc03c9cd1e3bb60987cd017f8a13ae36b1fed2c03bc2f8894cb897190"
Jul 09 14:57:15.289827 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.289812    2573 scope.go:117] "RemoveContainer" containerID="40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49"
Jul 09 14:57:15.290004 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:15.289987    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6xrfw_openshift-console-operator(9988cc9e-a398-4c1d-b8ab-adbca8f84020)\"" pod="openshift-console-operator/console-operator-7866497494-6xrfw" podUID="9988cc9e-a398-4c1d-b8ab-adbca8f84020"
Jul 09 14:57:15.420754 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.420715    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:15.420931 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.420807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:15.420931 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:15.420853    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:15.420931 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:15.420890    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:15.420931 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:15.420918    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.420902955 +0000 UTC m=+113.112315713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:15.421113 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:15.420950    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:16.420933981 +0000 UTC m=+113.112346740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:15.583965 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.583883    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"]
Jul 09 14:57:15.586538 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.586500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"
Jul 09 14:57:15.589452 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.589427    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 14:57:15.589577 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.589427    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qlrxd\""
Jul 09 14:57:15.589655 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.589627    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 14:57:15.606284 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.606259    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"]
Jul 09 14:57:15.622146 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.622121    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8txm8\" (UniqueName: \"kubernetes.io/projected/524ac1d2-ec08-47eb-84de-76615828e4eb-kube-api-access-8txm8\") pod \"migrator-7f59b54f6c-2rh52\" (UID: \"524ac1d2-ec08-47eb-84de-76615828e4eb\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"
Jul 09 14:57:15.722883 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.722837    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8txm8\" (UniqueName: \"kubernetes.io/projected/524ac1d2-ec08-47eb-84de-76615828e4eb-kube-api-access-8txm8\") pod \"migrator-7f59b54f6c-2rh52\" (UID: \"524ac1d2-ec08-47eb-84de-76615828e4eb\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"
Jul 09 14:57:15.734523 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.734485    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8txm8\" (UniqueName: \"kubernetes.io/projected/524ac1d2-ec08-47eb-84de-76615828e4eb-kube-api-access-8txm8\") pod \"migrator-7f59b54f6c-2rh52\" (UID: \"524ac1d2-ec08-47eb-84de-76615828e4eb\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"
Jul 09 14:57:15.895635 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:15.895600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"
Jul 09 14:57:16.017473 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.017442    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52"]
Jul 09 14:57:16.020136 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:16.020110    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524ac1d2_ec08_47eb_84de_76615828e4eb.slice/crio-c358795574f2e2b90da789cf4ba4d7745e5a84df80cff5b684de8e70ab045ce9 WatchSource:0}: Error finding container c358795574f2e2b90da789cf4ba4d7745e5a84df80cff5b684de8e70ab045ce9: Status 404 returned error can't find the container with id c358795574f2e2b90da789cf4ba4d7745e5a84df80cff5b684de8e70ab045ce9
Jul 09 14:57:16.295682 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.295612    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 14:57:16.296180 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.295958    2573 scope.go:117] "RemoveContainer" containerID="40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49"
Jul 09 14:57:16.296180 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:16.296125    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6xrfw_openshift-console-operator(9988cc9e-a398-4c1d-b8ab-adbca8f84020)\"" pod="openshift-console-operator/console-operator-7866497494-6xrfw" podUID="9988cc9e-a398-4c1d-b8ab-adbca8f84020"
Jul 09 14:57:16.296846 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.296826    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52" event={"ID":"524ac1d2-ec08-47eb-84de-76615828e4eb","Type":"ContainerStarted","Data":"c358795574f2e2b90da789cf4ba4d7745e5a84df80cff5b684de8e70ab045ce9"}
Jul 09 14:57:16.431580 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.431543    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:16.431768 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.431636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:16.431768 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:16.431649    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:16.431768 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:16.431717    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.431701913 +0000 UTC m=+115.123114672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:16.431917 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:16.431782    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:16.431917 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:16.431835    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:18.431822478 +0000 UTC m=+115.123235237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:16.477961 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:16.477934    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97lch_31de8069-1975-404b-91e2-c91ceea0e229/dns-node-resolver/0.log"
Jul 09 14:57:17.301181 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:17.301152    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52" event={"ID":"524ac1d2-ec08-47eb-84de-76615828e4eb","Type":"ContainerStarted","Data":"b70923bed9b9618b1f04160ccd801bee263c52c93f6287ab111783624c69e45c"}
Jul 09 14:57:17.301567 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:17.301235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52" event={"ID":"524ac1d2-ec08-47eb-84de-76615828e4eb","Type":"ContainerStarted","Data":"031c8b24e7e30c2c35ae91540800e863d36bc1e033f89f53b145bbe1c4cffbe0"}
Jul 09 14:57:17.334349 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:17.334298    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-2rh52" podStartSLOduration=1.2358688070000001 podStartE2EDuration="2.334279848s" totalImagesPullingTime="1.098411041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:17.333042943 +0000 UTC m=+114.024455746" watchObservedRunningTime="2026-07-09 14:57:17.334279848 +0000 UTC m=+114.025692618"
Jul 09 14:57:17.478311 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:17.478284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq8w4_66e5db36-142b-4113-a30b-f2e9a915e1a0/node-ca/0.log"
Jul 09 14:57:18.278137 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:18.278106    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wmcv_ad661331-e9c0-4384-9797-e23cd0ef48fa/serve-healthcheck-canary/0.log"
Jul 09 14:57:18.448584 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:18.448548    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:18.448940 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:18.448632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:18.448940 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.448664    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:18.448940 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.448728    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.448709565 +0000 UTC m=+119.140122337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:18.448940 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.448738    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:18.448940 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.448781    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:22.448770779 +0000 UTC m=+119.140183537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:18.549709 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:18.549616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:18.549723    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.549775    2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.549797    2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d76fb84f5-vwfhs: secret "image-registry-tls" not found
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.549814    2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.549850    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls podName:713133ab-76bb-4e6b-9144-5beedb66934d nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.549834939 +0000 UTC m=+123.241247702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls") pod "image-registry-d76fb84f5-vwfhs" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d") : secret "image-registry-tls" not found
Jul 09 14:57:18.549863 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:18.549863    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls podName:1fe33b31-6e9a-46e0-95f2-2930d77327e8 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:26.549856971 +0000 UTC m=+123.241269729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls") pod "cluster-samples-operator-65db858894-wh5dp" (UID: "1fe33b31-6e9a-46e0-95f2-2930d77327e8") : secret "samples-operator-tls" not found
Jul 09 14:57:21.123864 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:21.123830    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:21.124369 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:21.123918    2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:21.124434 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:21.124414    2573 scope.go:117] "RemoveContainer" containerID="40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49"
Jul 09 14:57:21.124650 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:21.124624    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-6xrfw_openshift-console-operator(9988cc9e-a398-4c1d-b8ab-adbca8f84020)\"" pod="openshift-console-operator/console-operator-7866497494-6xrfw" podUID="9988cc9e-a398-4c1d-b8ab-adbca8f84020"
Jul 09 14:57:22.484736 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:22.484697    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:22.485108 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:22.484779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:22.485108 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:22.484853    2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:22.485108 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:22.484922    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.484905292 +0000 UTC m=+127.176318050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:22.485108 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:22.484863    2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:22.485108 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:57:22.484997    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm podName:07a7a3be-eb1a-49d2-8f6d-9ef2753d1458 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:30.484985327 +0000 UTC m=+127.176398085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r7bhj" (UID: "07a7a3be-eb1a-49d2-8f6d-9ef2753d1458") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:26.620966 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.620910    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:26.621356 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.620999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:26.623470 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.623447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1fe33b31-6e9a-46e0-95f2-2930d77327e8-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-wh5dp\" (UID: \"1fe33b31-6e9a-46e0-95f2-2930d77327e8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:26.623581 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.623447    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"image-registry-d76fb84f5-vwfhs\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") " pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:26.713434 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.713398    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gfkwb\""
Jul 09 14:57:26.720566 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.720546    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57p5w\""
Jul 09 14:57:26.721544 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.721506    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:26.728549 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.728528    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"
Jul 09 14:57:26.866981 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.866952    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:57:26.870906 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:26.870883    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713133ab_76bb_4e6b_9144_5beedb66934d.slice/crio-42f8c2ef208e695c0449cb37f72bef1ae23dc8057fd57cd34b1dce5f1211d4e5 WatchSource:0}: Error finding container 42f8c2ef208e695c0449cb37f72bef1ae23dc8057fd57cd34b1dce5f1211d4e5: Status 404 returned error can't find the container with id 42f8c2ef208e695c0449cb37f72bef1ae23dc8057fd57cd34b1dce5f1211d4e5
Jul 09 14:57:26.884206 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:26.884179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp"]
Jul 09 14:57:27.332268 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:27.332227    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" event={"ID":"713133ab-76bb-4e6b-9144-5beedb66934d","Type":"ContainerStarted","Data":"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"}
Jul 09 14:57:27.332478 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:27.332290    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" event={"ID":"713133ab-76bb-4e6b-9144-5beedb66934d","Type":"ContainerStarted","Data":"42f8c2ef208e695c0449cb37f72bef1ae23dc8057fd57cd34b1dce5f1211d4e5"}
Jul 09 14:57:27.332570 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:27.332553    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:57:27.333772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:27.333748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp" event={"ID":"1fe33b31-6e9a-46e0-95f2-2930d77327e8","Type":"ContainerStarted","Data":"7d53a6bc03b67c98d1c790872b99e6f13b512d8734bf7c8b5fbf31985983afd1"}
Jul 09 14:57:27.361110 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:27.361055    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" podStartSLOduration=17.361038165 podStartE2EDuration="17.361038165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:27.360283735 +0000 UTC m=+124.051696539" watchObservedRunningTime="2026-07-09 14:57:27.361038165 +0000 UTC m=+124.052450946"
Jul 09 14:57:29.342065 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:29.342032    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp" event={"ID":"1fe33b31-6e9a-46e0-95f2-2930d77327e8","Type":"ContainerStarted","Data":"0047023bec2ea2a8cf708cf8f3652496777e6d8dbc6122aca1d2d15f9768c051"}
Jul 09 14:57:29.342451 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:29.342106    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp" event={"ID":"1fe33b31-6e9a-46e0-95f2-2930d77327e8","Type":"ContainerStarted","Data":"5c4d30a529a99dbedfd1e11bdd0e4a35afcbb3392c2552d9722d109adfb9b704"}
Jul 09 14:57:29.362401 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:29.362353    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-wh5dp" podStartSLOduration=17.895505036 podStartE2EDuration="19.362338973s" totalImagesPullingTime="1.466833937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:29.361313601 +0000 UTC m=+126.052726384" watchObservedRunningTime="2026-07-09 14:57:29.362338973 +0000 UTC m=+126.053751753"
Jul 09 14:57:30.551395 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.551358    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:30.551787 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.551421    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:30.551938 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.551920    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:30.553618 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.553588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/07a7a3be-eb1a-49d2-8f6d-9ef2753d1458-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r7bhj\" (UID: \"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458\") " pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:30.638951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.638918    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dh2jv\""
Jul 09 14:57:30.645724 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.645705    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r7bhj"
Jul 09 14:57:30.769194 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:30.769162    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r7bhj"]
Jul 09 14:57:30.771929 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:30.771903    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a7a3be_eb1a_49d2_8f6d_9ef2753d1458.slice/crio-652adbd29fec0bc128779d7310e781fd624adcf13ecb1e067ff1e8fc09b8bb23 WatchSource:0}: Error finding container 652adbd29fec0bc128779d7310e781fd624adcf13ecb1e067ff1e8fc09b8bb23: Status 404 returned error can't find the container with id 652adbd29fec0bc128779d7310e781fd624adcf13ecb1e067ff1e8fc09b8bb23
Jul 09 14:57:31.351557 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:31.351502    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r7bhj" event={"ID":"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458","Type":"ContainerStarted","Data":"652adbd29fec0bc128779d7310e781fd624adcf13ecb1e067ff1e8fc09b8bb23"}
Jul 09 14:57:33.576029 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:33.575986    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:57:33.578493 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:33.578466    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d999699-2449-40a4-a43b-3a4f6ac94a5b-metrics-certs\") pod \"network-metrics-daemon-j2wlw\" (UID: \"3d999699-2449-40a4-a43b-3a4f6ac94a5b\") " pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:57:33.723288 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:33.723258    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9rvwx\""
Jul 09 14:57:33.731120 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:33.731095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j2wlw"
Jul 09 14:57:33.907597 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:33.907571    2573 scope.go:117] "RemoveContainer" containerID="40587f9fda749a132a69bf7f9603b53d46c28fcd6a9f27907ce5dd6f1e708b49"
Jul 09 14:57:34.371411 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.371374    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 14:57:34.371580 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.371491    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-6xrfw" event={"ID":"9988cc9e-a398-4c1d-b8ab-adbca8f84020","Type":"ContainerStarted","Data":"9963e05512304777b8d21327770a84a83569b4725a93b843e70b5911bbf94f34"}
Jul 09 14:57:34.371833 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.371809    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:34.372440 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.372417    2573 patch_prober.go:28] interesting pod/console-operator-7866497494-6xrfw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body=
Jul 09 14:57:34.372569 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.372456    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-6xrfw" podUID="9988cc9e-a398-4c1d-b8ab-adbca8f84020" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.11:8443/readyz\": dial tcp 10.133.0.11:8443: connect: connection refused"
Jul 09 14:57:34.372999 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.372977    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r7bhj" event={"ID":"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458","Type":"ContainerStarted","Data":"9d4abccd2aca032c5a626617d222a9d80bed8c699a77870a6d13a2310ee7ef73"}
Jul 09 14:57:34.379633 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.379612    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j2wlw"]
Jul 09 14:57:34.381804 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:34.381770    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d999699_2449_40a4_a43b_3a4f6ac94a5b.slice/crio-718bca3399965a511d25b410e0b663c7d4bccd69e1cd3f35d3e9d065a986b082 WatchSource:0}: Error finding container 718bca3399965a511d25b410e0b663c7d4bccd69e1cd3f35d3e9d065a986b082: Status 404 returned error can't find the container with id 718bca3399965a511d25b410e0b663c7d4bccd69e1cd3f35d3e9d065a986b082
Jul 09 14:57:34.395238 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:34.395198    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-6xrfw" podStartSLOduration=21.839410204 podStartE2EDuration="24.39518325s" totalImagesPullingTime="2.555773046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:34.394963181 +0000 UTC m=+131.086375988" watchObservedRunningTime="2026-07-09 14:57:34.39518325 +0000 UTC m=+131.086596058"
Jul 09 14:57:35.377956 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:35.377924    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r7bhj" event={"ID":"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458","Type":"ContainerStarted","Data":"4175a06d65fe09e209e853fb0bbfc9ca7a273487c650ea14b1a07d90e8746952"}
Jul 09 14:57:35.378932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:35.378905    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2wlw" event={"ID":"3d999699-2449-40a4-a43b-3a4f6ac94a5b","Type":"ContainerStarted","Data":"718bca3399965a511d25b410e0b663c7d4bccd69e1cd3f35d3e9d065a986b082"}
Jul 09 14:57:35.382991 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:35.382973    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-6xrfw"
Jul 09 14:57:36.384332 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:36.384289    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2wlw" event={"ID":"3d999699-2449-40a4-a43b-3a4f6ac94a5b","Type":"ContainerStarted","Data":"0fbb1c3511f1ba970dbcc946e2be3cc9f6283105b7b16ec6688335762739c37e"}
Jul 09 14:57:36.384802 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:36.384356    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j2wlw" event={"ID":"3d999699-2449-40a4-a43b-3a4f6ac94a5b","Type":"ContainerStarted","Data":"4dc4c55fc7cd5332493cf7b0b5a1947ae145d010a6bcf7f672bb397571cbcd47"}
Jul 09 14:57:36.405468 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:36.405407    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j2wlw" podStartSLOduration=132.462886258 podStartE2EDuration="2m13.405385935s" totalImagesPullingTime="942.499677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:36.404066297 +0000 UTC m=+133.095479102" watchObservedRunningTime="2026-07-09 14:57:36.405385935 +0000 UTC m=+133.096798718"
Jul 09 14:57:38.393145 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:38.393114    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r7bhj" event={"ID":"07a7a3be-eb1a-49d2-8f6d-9ef2753d1458","Type":"ContainerStarted","Data":"5d0c8a91289b791ed2fdcb60ed472e91b72e3a3baf7258939c82d9c40f55e335"}
Jul 09 14:57:38.415398 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:38.415347    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r7bhj" podStartSLOduration=17.820440553 podStartE2EDuration="24.415329719s" totalImagesPullingTime="6.594889166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:38.414762474 +0000 UTC m=+135.106175274" watchObservedRunningTime="2026-07-09 14:57:38.415329719 +0000 UTC m=+135.106742511"
Jul 09 14:57:40.202830 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.202796    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:57:40.221374 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.221341    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"]
Jul 09 14:57:40.223389 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.223366    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:40.226757 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.226736    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-p874g\""
Jul 09 14:57:40.226757 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.226750    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 14:57:40.298212 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.298182    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"]
Jul 09 14:57:40.336590 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.336557    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f8b3ff1-a836-4858-b92c-0370cdfa0e6f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wzrk5\" (UID: \"8f8b3ff1-a836-4858-b92c-0370cdfa0e6f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:40.437112 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.437074    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f8b3ff1-a836-4858-b92c-0370cdfa0e6f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wzrk5\" (UID: \"8f8b3ff1-a836-4858-b92c-0370cdfa0e6f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:40.439533 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.439499    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8f8b3ff1-a836-4858-b92c-0370cdfa0e6f-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-wzrk5\" (UID: \"8f8b3ff1-a836-4858-b92c-0370cdfa0e6f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:40.536088 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.536003    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:40.662791 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:40.662759    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"]
Jul 09 14:57:40.666372 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:40.666337    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f8b3ff1_a836_4858_b92c_0370cdfa0e6f.slice/crio-d5ca77d61c183761f1d7a8fe5f59206d7fc66dee57ce818483e4c436397b660a WatchSource:0}: Error finding container d5ca77d61c183761f1d7a8fe5f59206d7fc66dee57ce818483e4c436397b660a: Status 404 returned error can't find the container with id d5ca77d61c183761f1d7a8fe5f59206d7fc66dee57ce818483e4c436397b660a
Jul 09 14:57:41.404371 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:41.404338    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5" event={"ID":"8f8b3ff1-a836-4858-b92c-0370cdfa0e6f","Type":"ContainerStarted","Data":"d5ca77d61c183761f1d7a8fe5f59206d7fc66dee57ce818483e4c436397b660a"}
Jul 09 14:57:42.408983 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:42.408946    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5" event={"ID":"8f8b3ff1-a836-4858-b92c-0370cdfa0e6f","Type":"ContainerStarted","Data":"5af70330f841afd574f0ea9fc4f2af09a8bfcb8109c717562ad8c2000fe280c8"}
Jul 09 14:57:42.409438 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:42.409165    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:42.413690 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:42.413672    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5"
Jul 09 14:57:42.431628 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:42.431584    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-wzrk5" podStartSLOduration=1.437753786 podStartE2EDuration="2.43157127s" totalImagesPullingTime="993.817484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:42.43060409 +0000 UTC m=+139.122016894" watchObservedRunningTime="2026-07-09 14:57:42.43157127 +0000 UTC m=+139.122984050"
Jul 09 14:57:43.007312 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.007275    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mstwc"]
Jul 09 14:57:43.009685 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.009659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.014003 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.013972    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 14:57:43.015086 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.015057    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qfx8x\""
Jul 09 14:57:43.015167 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.015112    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 14:57:43.015326 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.015305    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 14:57:43.015392 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.015337    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 14:57:43.015442 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.015400    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 14:57:43.025884 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.025866    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mstwc"]
Jul 09 14:57:43.156701 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.156660    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.160445 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.156746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.160445 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.157189    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208d6f46-5971-465a-afb7-736dd760f04b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.160445 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.157361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxbb\" (UniqueName: \"kubernetes.io/projected/208d6f46-5971-465a-afb7-736dd760f04b-kube-api-access-bzxbb\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.258363 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.258286    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.258363 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.258334    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208d6f46-5971-465a-afb7-736dd760f04b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.258552 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.258362    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxbb\" (UniqueName: \"kubernetes.io/projected/208d6f46-5971-465a-afb7-736dd760f04b-kube-api-access-bzxbb\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.258552 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.258397    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.259123 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.259096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/208d6f46-5971-465a-afb7-736dd760f04b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.260703 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.260682    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.260788 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.260745    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/208d6f46-5971-465a-afb7-736dd760f04b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.268799 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.268773    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxbb\" (UniqueName: \"kubernetes.io/projected/208d6f46-5971-465a-afb7-736dd760f04b-kube-api-access-bzxbb\") pod \"prometheus-operator-64785b6675-mstwc\" (UID: \"208d6f46-5971-465a-afb7-736dd760f04b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.318734 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.318699    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc"
Jul 09 14:57:43.441238 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:43.441217    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-mstwc"]
Jul 09 14:57:43.443572 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:43.443545    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208d6f46_5971_465a_afb7_736dd760f04b.slice/crio-85d0c7ecdd1c604ee5bc4efbd6eea3f059c12a2da03fbb3a198f9a2a95296fc1 WatchSource:0}: Error finding container 85d0c7ecdd1c604ee5bc4efbd6eea3f059c12a2da03fbb3a198f9a2a95296fc1: Status 404 returned error can't find the container with id 85d0c7ecdd1c604ee5bc4efbd6eea3f059c12a2da03fbb3a198f9a2a95296fc1
Jul 09 14:57:44.417191 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:44.417154    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc" event={"ID":"208d6f46-5971-465a-afb7-736dd760f04b","Type":"ContainerStarted","Data":"85d0c7ecdd1c604ee5bc4efbd6eea3f059c12a2da03fbb3a198f9a2a95296fc1"}
Jul 09 14:57:45.422022 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.421991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc" event={"ID":"208d6f46-5971-465a-afb7-736dd760f04b","Type":"ContainerStarted","Data":"ad6f5f3b2cb03bf7c70d084e78219714b476948294d2c9fd946f1dccab07ec93"}
Jul 09 14:57:45.422405 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.422041    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc" event={"ID":"208d6f46-5971-465a-afb7-736dd760f04b","Type":"ContainerStarted","Data":"a1d849b97760ebaf0f5f377fc56d948815fe4812045d083ccc930b9600c4a103"}
Jul 09 14:57:45.444781 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.444702    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-mstwc" podStartSLOduration=2.314786028 podStartE2EDuration="3.444686744s" totalImagesPullingTime="1.129900716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:45.443892695 +0000 UTC m=+142.135305499" watchObservedRunningTime="2026-07-09 14:57:45.444686744 +0000 UTC m=+142.136099524"
Jul 09 14:57:45.583337 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.583307    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:57:45.586307 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.586287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.590850 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.590826    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 14:57:45.590967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.590937    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 14:57:45.590967 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.590951    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 14:57:45.591449 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.591431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 14:57:45.591552 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.591448    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mblkz\""
Jul 09 14:57:45.591999 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.591970    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 14:57:45.592076 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.592011    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 14:57:45.592604 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.592588    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 14:57:45.602552 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.602534    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:57:45.675658 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675570    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn97c\" (UniqueName: \"kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.675658 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.675658 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.675865 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.675865 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.675865 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.675772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.776899 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.776861    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.776899 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.776902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.776918    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.776952    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.776983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.777033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn97c\" (UniqueName: \"kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777701 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.777670    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777830 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.777702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.777830 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.777681    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.779587 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.779553    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.779688 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.779599    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.787895 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.787872    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn97c\" (UniqueName: \"kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c\") pod \"console-5f5bb9b9f6-nrgq4\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") " pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:45.895330 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:45.895297    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:46.023441 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:46.023412    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:57:46.026155 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:46.026132    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687f8aa5_36e5_49e9_b49a_872ba1981dec.slice/crio-4dc82d912f68800f0309263189f8cd411320642aea79dbab9081eb1a25e87334 WatchSource:0}: Error finding container 4dc82d912f68800f0309263189f8cd411320642aea79dbab9081eb1a25e87334: Status 404 returned error can't find the container with id 4dc82d912f68800f0309263189f8cd411320642aea79dbab9081eb1a25e87334
Jul 09 14:57:46.430135 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:46.430085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5bb9b9f6-nrgq4" event={"ID":"687f8aa5-36e5-49e9-b49a-872ba1981dec","Type":"ContainerStarted","Data":"4dc82d912f68800f0309263189f8cd411320642aea79dbab9081eb1a25e87334"}
Jul 09 14:57:47.421302 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.421267    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"]
Jul 09 14:57:47.442684 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.442652    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"]
Jul 09 14:57:47.443103 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.442785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.443731 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.443705    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vlhnn"]
Jul 09 14:57:47.445435 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.445410    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 14:57:47.445654 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.445635    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 14:57:47.445817 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.445798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-582b5\""
Jul 09 14:57:47.455429 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.455407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.458190 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.458168    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 14:57:47.458417 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.458400    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qkgqz\""
Jul 09 14:57:47.458526 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.458429    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 14:57:47.458673 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.458655    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 14:57:47.592048 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592190 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592065    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-root\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592190 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e109ddb2-1514-4e30-94be-178a6e9b6b7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.592190 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592143    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592190 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592167    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-metrics-client-ca\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-textfile\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592262    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-tls\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592291    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.592338 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n22cb\" (UniqueName: \"kubernetes.io/projected/e109ddb2-1514-4e30-94be-178a6e9b6b7f-kube-api-access-n22cb\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.592508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.592508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-wtmp\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592423    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-sys\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.592508 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.592447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xp2c\" (UniqueName: \"kubernetes.io/projected/7a069391-fe77-49c8-a028-852a96a41b9e-kube-api-access-7xp2c\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693052 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.692974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.693052 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-wtmp\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-sys\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693128    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-sys\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693170    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xp2c\" (UniqueName: \"kubernetes.io/projected/7a069391-fe77-49c8-a028-852a96a41b9e-kube-api-access-7xp2c\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-root\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693252    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-wtmp\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693316 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e109ddb2-1514-4e30-94be-178a6e9b6b7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7a069391-fe77-49c8-a028-852a96a41b9e-root\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-metrics-client-ca\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693487    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-textfile\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693531    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-tls\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.693677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693605    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n22cb\" (UniqueName: \"kubernetes.io/projected/e109ddb2-1514-4e30-94be-178a6e9b6b7f-kube-api-access-n22cb\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.694005 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.693965    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-textfile\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.694069 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.694010    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e109ddb2-1514-4e30-94be-178a6e9b6b7f-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.694314 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.694270    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-accelerators-collector-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.694445 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.694324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a069391-fe77-49c8-a028-852a96a41b9e-metrics-client-ca\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.695911 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.695886    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.696210 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.696190    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-tls\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.696600 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.696562    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7a069391-fe77-49c8-a028-852a96a41b9e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.696697 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.696665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e109ddb2-1514-4e30-94be-178a6e9b6b7f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.706349 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.706324    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n22cb\" (UniqueName: \"kubernetes.io/projected/e109ddb2-1514-4e30-94be-178a6e9b6b7f-kube-api-access-n22cb\") pod \"openshift-state-metrics-84bd68b896-dmg9z\" (UID: \"e109ddb2-1514-4e30-94be-178a6e9b6b7f\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.706577 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.706558    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xp2c\" (UniqueName: \"kubernetes.io/projected/7a069391-fe77-49c8-a028-852a96a41b9e-kube-api-access-7xp2c\") pod \"node-exporter-vlhnn\" (UID: \"7a069391-fe77-49c8-a028-852a96a41b9e\") " pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:47.754165 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.754135    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"
Jul 09 14:57:47.764900 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:47.764874    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vlhnn"
Jul 09 14:57:48.717472 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:48.717439    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a069391_fe77_49c8_a028_852a96a41b9e.slice/crio-e3b68e55d3c3cb744ba1743ff7c02fc121e4b532db44676bb10314589350f16a WatchSource:0}: Error finding container e3b68e55d3c3cb744ba1743ff7c02fc121e4b532db44676bb10314589350f16a: Status 404 returned error can't find the container with id e3b68e55d3c3cb744ba1743ff7c02fc121e4b532db44676bb10314589350f16a
Jul 09 14:57:48.840387 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:48.840355    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z"]
Jul 09 14:57:48.844148 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:48.844122    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode109ddb2_1514_4e30_94be_178a6e9b6b7f.slice/crio-f33dc2a30abcda01814b6ebae5b01de44be1fe88002afbb9e416ff7d2b7a871b WatchSource:0}: Error finding container f33dc2a30abcda01814b6ebae5b01de44be1fe88002afbb9e416ff7d2b7a871b: Status 404 returned error can't find the container with id f33dc2a30abcda01814b6ebae5b01de44be1fe88002afbb9e416ff7d2b7a871b
Jul 09 14:57:49.445147 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.445112    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlhnn" event={"ID":"7a069391-fe77-49c8-a028-852a96a41b9e","Type":"ContainerStarted","Data":"e3b68e55d3c3cb744ba1743ff7c02fc121e4b532db44676bb10314589350f16a"}
Jul 09 14:57:49.447013 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.446980    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5bb9b9f6-nrgq4" event={"ID":"687f8aa5-36e5-49e9-b49a-872ba1981dec","Type":"ContainerStarted","Data":"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"}
Jul 09 14:57:49.448734 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.448706    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z" event={"ID":"e109ddb2-1514-4e30-94be-178a6e9b6b7f","Type":"ContainerStarted","Data":"7d1f72e2c6f176b562fbe7625e960af351bcfc74a576c7fbdca8c0531b9ee604"}
Jul 09 14:57:49.448838 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.448748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z" event={"ID":"e109ddb2-1514-4e30-94be-178a6e9b6b7f","Type":"ContainerStarted","Data":"52226d46438abf3b96d8e473a4008e7e6183b56324023e7eed606be772bc0bb2"}
Jul 09 14:57:49.448838 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.448767    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z" event={"ID":"e109ddb2-1514-4e30-94be-178a6e9b6b7f","Type":"ContainerStarted","Data":"f33dc2a30abcda01814b6ebae5b01de44be1fe88002afbb9e416ff7d2b7a871b"}
Jul 09 14:57:49.478885 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.478830    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5bb9b9f6-nrgq4" podStartSLOduration=1.767284796 podStartE2EDuration="4.478810096s" totalImagesPullingTime="2.7115253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:49.478435317 +0000 UTC m=+146.169848121" watchObservedRunningTime="2026-07-09 14:57:49.478810096 +0000 UTC m=+146.170222869"
Jul 09 14:57:49.509191 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.509169    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"]
Jul 09 14:57:49.514853 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.514828    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.517911 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.517859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9zlq7\""
Jul 09 14:57:49.517911 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.517874    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 14:57:49.517911 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.517874    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 14:57:49.518152 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.517917    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 14:57:49.518152 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.517859    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 14:57:49.518253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.518241    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 14:57:49.518310 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.518273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-941e10qejed63\""
Jul 09 14:57:49.527060 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.527040    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"]
Jul 09 14:57:49.608750 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608750 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608697    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-grpc-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608793    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-metrics-client-ca\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlktr\" (UniqueName: \"kubernetes.io/projected/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-kube-api-access-zlktr\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608898    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.608990 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.608981    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.709819 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709731    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.709819 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-metrics-client-ca\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.709819 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlktr\" (UniqueName: \"kubernetes.io/projected/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-kube-api-access-zlktr\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709916    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709942    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.709974    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710089 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.710002    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-grpc-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.710875 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.710594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-metrics-client-ca\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.712856 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.712808    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.713026 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.713007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.713119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.713084    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.713201 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.713176    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.713251 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.713231    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-grpc-tls\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.713407 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.713392    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.720347 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.720329    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlktr\" (UniqueName: \"kubernetes.io/projected/0f8e2328-bc5c-4230-ae71-5ce0bd3056c6-kube-api-access-zlktr\") pod \"thanos-querier-cb85f9c57-j2vxf\" (UID: \"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6\") " pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:49.838125 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:49.838075    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:50.067661 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.067624    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"]
Jul 09 14:57:50.069581 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:50.069559    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8e2328_bc5c_4230_ae71_5ce0bd3056c6.slice/crio-b25d4b9d5a8c4a3cad93831b4be56dc6cd47c5596234e0c6c8644aca7aba5770 WatchSource:0}: Error finding container b25d4b9d5a8c4a3cad93831b4be56dc6cd47c5596234e0c6c8644aca7aba5770: Status 404 returned error can't find the container with id b25d4b9d5a8c4a3cad93831b4be56dc6cd47c5596234e0c6c8644aca7aba5770
Jul 09 14:57:50.208146 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.208115    2573 patch_prober.go:28] interesting pod/image-registry-d76fb84f5-vwfhs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 14:57:50.208310 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.208165    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 14:57:50.455057 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.454992    2573 generic.go:356] "Generic (PLEG): container finished" podID="7a069391-fe77-49c8-a028-852a96a41b9e" containerID="010b6a7ac8a803d369e82567165ba449b414d9f5978bdf25d288c0c35f4922d6" exitCode=0
Jul 09 14:57:50.455247 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.455080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlhnn" event={"ID":"7a069391-fe77-49c8-a028-852a96a41b9e","Type":"ContainerDied","Data":"010b6a7ac8a803d369e82567165ba449b414d9f5978bdf25d288c0c35f4922d6"}
Jul 09 14:57:50.456573 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.456549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"b25d4b9d5a8c4a3cad93831b4be56dc6cd47c5596234e0c6c8644aca7aba5770"}
Jul 09 14:57:50.458902 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.458876    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z" event={"ID":"e109ddb2-1514-4e30-94be-178a6e9b6b7f","Type":"ContainerStarted","Data":"62d6db3cf470d253e774effbad03964d05af29b5566fcd7cc3101075e8e1c5e0"}
Jul 09 14:57:50.506435 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:50.506384    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-dmg9z" podStartSLOduration=2.493932518 podStartE2EDuration="3.506365874s" totalImagesPullingTime="1.012433356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:50.506052603 +0000 UTC m=+147.197465416" watchObservedRunningTime="2026-07-09 14:57:50.506365874 +0000 UTC m=+147.197778664"
Jul 09 14:57:51.466282 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.466244    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlhnn" event={"ID":"7a069391-fe77-49c8-a028-852a96a41b9e","Type":"ContainerStarted","Data":"156f2f08f8b9d46fd5e9afc9c0471b5d927607d7c618394690699ad35af480cc"}
Jul 09 14:57:51.466742 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.466306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vlhnn" event={"ID":"7a069391-fe77-49c8-a028-852a96a41b9e","Type":"ContainerStarted","Data":"5f819b24f53c71637d84dc57ca73900c429b8d9abdfce34a7fd8b76922086a32"}
Jul 09 14:57:51.490907 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.490847    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vlhnn" podStartSLOduration=3.673847132 podStartE2EDuration="4.490826499s" totalImagesPullingTime="742.011225ms" totalInitContainerRuntime="74.968142ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:51.489192973 +0000 UTC m=+148.180605776" watchObservedRunningTime="2026-07-09 14:57:51.490826499 +0000 UTC m=+148.182239280"
Jul 09 14:57:51.847909 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.847878    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"]
Jul 09 14:57:51.851245 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.851227    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:51.854359 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.854337    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 14:57:51.854473 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.854392    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ffrjamuaemqas\""
Jul 09 14:57:51.854592 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.854576    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 14:57:51.855029 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.855011    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 14:57:51.855115 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.855060    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 14:57:51.855294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.855280    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7tfdt\""
Jul 09 14:57:51.867453 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:51.867427    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"]
Jul 09 14:57:52.032656 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-client-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032656 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032611    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-metrics-server-audit-profiles\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032656 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032654    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-client-certs\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032678    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br2sd\" (UniqueName: \"kubernetes.io/projected/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-kube-api-access-br2sd\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-tls\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032865    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-audit-log\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.032958 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.032888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.133946 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.133907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134142 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.133972    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-client-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134142 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134003    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-metrics-server-audit-profiles\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134142 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134049    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-client-certs\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134142 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134073    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br2sd\" (UniqueName: \"kubernetes.io/projected/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-kube-api-access-br2sd\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134340 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-tls\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134340 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-audit-log\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.134995 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.134846    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-audit-log\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.135364 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.135305    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.135483 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.135460    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-metrics-server-audit-profiles\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.137685 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.137649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-client-certs\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.137826 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.137649    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-secret-metrics-server-tls\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.137826 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.137783    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-client-ca-bundle\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.145408 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.145384    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br2sd\" (UniqueName: \"kubernetes.io/projected/b3918a8e-a0f2-4168-b74b-cc429ff19ce9-kube-api-access-br2sd\") pod \"metrics-server-b4bdc4fdf-trkm7\" (UID: \"b3918a8e-a0f2-4168-b74b-cc429ff19ce9\") " pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.167008 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.166915    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:57:52.314113 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.313975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"]
Jul 09 14:57:52.394108 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:52.394075    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3918a8e_a0f2_4168_b74b_cc429ff19ce9.slice/crio-55f86f1d63542ab5d95c602a3301dbd5179250fbcb55172ef19c2ac273bea459 WatchSource:0}: Error finding container 55f86f1d63542ab5d95c602a3301dbd5179250fbcb55172ef19c2ac273bea459: Status 404 returned error can't find the container with id 55f86f1d63542ab5d95c602a3301dbd5179250fbcb55172ef19c2ac273bea459
Jul 09 14:57:52.471377 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.471349    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7" event={"ID":"b3918a8e-a0f2-4168-b74b-cc429ff19ce9","Type":"ContainerStarted","Data":"55f86f1d63542ab5d95c602a3301dbd5179250fbcb55172ef19c2ac273bea459"}
Jul 09 14:57:52.473209 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.473185    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"1ec53b2257956d795d6ee5e705f7ab390de72eded7238d0eafb9ed95b79e5486"}
Jul 09 14:57:52.473283 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.473240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"19349f64e89356d6194ed36e9f13eb19233d4955391b65400b6eddb1252a3045"}
Jul 09 14:57:52.473283 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:52.473266    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"e6a7365d2d782b85f037df4d2a51910fccb6c1aba2b326e0397e2d479121cab8"}
Jul 09 14:57:53.481761 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.481720    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"7c8adcae242c6227498dc86a6814652c961acfc66cb53905a06a08e90523c224"}
Jul 09 14:57:53.482223 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.481802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"2346564c7b65d6971092526032955677f772e422b5c32a2a234cdc102f2a3ff6"}
Jul 09 14:57:53.482223 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.481966    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:53.482223 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.482078    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" event={"ID":"0f8e2328-bc5c-4230-ae71-5ce0bd3056c6","Type":"ContainerStarted","Data":"4cf8cb01a2a1bff7e40a836fcd04101b88e6f7ea6a385cf3ae5efdc6059e5516"}
Jul 09 14:57:53.510296 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.509687    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf" podStartSLOduration=2.318109611 podStartE2EDuration="4.509665036s" totalImagesPullingTime="2.191555425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:53.507919184 +0000 UTC m=+150.199331988" watchObservedRunningTime="2026-07-09 14:57:53.509665036 +0000 UTC m=+150.201077817"
Jul 09 14:57:53.730129 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.730089    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:57:53.734465 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.734395    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.739233 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739189    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 14:57:53.739501 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739484    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 14:57:53.739695 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739670    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 14:57:53.739768 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739694    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 14:57:53.739768 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739735    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1s97hgmf7fd47\""
Jul 09 14:57:53.739864 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.739640    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 14:57:53.740043 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.740007    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 14:57:53.740265 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.740240    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 14:57:53.740447 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.740431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 14:57:53.743383 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.743365    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 14:57:53.743549 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.743370    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 14:57:53.743782 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.743401    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mnjsf\""
Jul 09 14:57:53.743782 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.743420    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 14:57:53.743782 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.743469    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 14:57:53.744662 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.744629    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 14:57:53.752159 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.752130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.757737 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.757710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.757926 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.757899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.758067 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.754190    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 14:57:53.760323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.758051    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.760323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.759095    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.760323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.759191    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.760323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.759265    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.760323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.759297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.762780 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.762756    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:57:53.859845 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859907    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859923    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9sxq\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860006 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.859958    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860029    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860072    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860253 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860256    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860457    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.860484 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.860486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.863798 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.863798 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863669    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.863798 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863711    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.863798 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863742    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.864065 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863828    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.864065 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.863830    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.864172 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.864120    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.864743 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.864725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.961716 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.961680    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.961716 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.961730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.961959 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.961746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.961959 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.961776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962227 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962204    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962357 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962344    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962469 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962457    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9sxq\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962583 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962666    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962795 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962781    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.962911 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.963002 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.963250    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962672    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.963382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.963575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.963825    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.962692    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.964443 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.964382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.965757 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.965308    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.966067 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.966020    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.966388 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.966366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.967335 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.967312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:53.972453 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:53.972430    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9sxq\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq\") pod \"prometheus-k8s-0\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:54.051218 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:54.051122    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:57:54.221566 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:54.221450    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:57:54.224100 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:57:54.224069    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4147315b_d23e_4497_9cfc_885f3fafca9a.slice/crio-86a06e1c57b54c4351d2255c40fddb00faac49a116d0fd77189e9c4ec7a1ddf5 WatchSource:0}: Error finding container 86a06e1c57b54c4351d2255c40fddb00faac49a116d0fd77189e9c4ec7a1ddf5: Status 404 returned error can't find the container with id 86a06e1c57b54c4351d2255c40fddb00faac49a116d0fd77189e9c4ec7a1ddf5
Jul 09 14:57:54.486304 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:54.486265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"86a06e1c57b54c4351d2255c40fddb00faac49a116d0fd77189e9c4ec7a1ddf5"}
Jul 09 14:57:54.487682 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:54.487655    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7" event={"ID":"b3918a8e-a0f2-4168-b74b-cc429ff19ce9","Type":"ContainerStarted","Data":"3866a8dcf061be0633033664d22bfd91bc7a176949f21934cb1735cffea5736c"}
Jul 09 14:57:54.508376 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:54.508327    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7" podStartSLOduration=2.284006253 podStartE2EDuration="3.508313469s" totalImagesPullingTime="1.224307216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:54.507010965 +0000 UTC m=+151.198423770" watchObservedRunningTime="2026-07-09 14:57:54.508313469 +0000 UTC m=+151.199726249"
Jul 09 14:57:55.492741 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:55.492707    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f" exitCode=0
Jul 09 14:57:55.493229 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:55.492796    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"}
Jul 09 14:57:55.895881 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:55.895849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:55.896038 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:55.895940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:55.900650 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:55.900628    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:56.185984 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:56.185898    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:57:56.502102 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:56.502009    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:57:59.493834 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.493807    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-cb85f9c57-j2vxf"
Jul 09 14:57:59.514025 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.513991    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"}
Jul 09 14:57:59.514173 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.514060    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"}
Jul 09 14:57:59.514173 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.514105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"}
Jul 09 14:57:59.514173 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.514140    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"}
Jul 09 14:57:59.514351 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.514174    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"}
Jul 09 14:57:59.514351 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.514217    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerStarted","Data":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"}
Jul 09 14:57:59.552631 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:57:59.552572    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7107114660000002 podStartE2EDuration="6.552549836s" totalImagesPullingTime="3.823557309s" totalInitContainerRuntime="18.281061ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:59.550265763 +0000 UTC m=+156.241678602" watchObservedRunningTime="2026-07-09 14:57:59.552549836 +0000 UTC m=+156.243962617"
Jul 09 14:58:00.207306 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:00.207278    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:58:01.774796 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:58:01.774742    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2cd85" podUID="a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4"
Jul 09 14:58:02.526286 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:02.526258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:04.051884 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:04.051847    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:58:05.223238 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.223171    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" containerName="registry" containerID="cri-o://51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8" gracePeriod=30
Jul 09 14:58:05.534286 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.534254    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:58:05.538971 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.538938    2573 generic.go:356] "Generic (PLEG): container finished" podID="713133ab-76bb-4e6b-9144-5beedb66934d" containerID="51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8" exitCode=0
Jul 09 14:58:05.539101 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.538979    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs"
Jul 09 14:58:05.539101 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.539025    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" event={"ID":"713133ab-76bb-4e6b-9144-5beedb66934d","Type":"ContainerDied","Data":"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"}
Jul 09 14:58:05.539101 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.539098    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d76fb84f5-vwfhs" event={"ID":"713133ab-76bb-4e6b-9144-5beedb66934d","Type":"ContainerDied","Data":"42f8c2ef208e695c0449cb37f72bef1ae23dc8057fd57cd34b1dce5f1211d4e5"}
Jul 09 14:58:05.539203 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.539118    2573 scope.go:117] "RemoveContainer" containerID="51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"
Jul 09 14:58:05.546975 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.546953    2573 scope.go:117] "RemoveContainer" containerID="51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"
Jul 09 14:58:05.547224 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:58:05.547203    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8\": container with ID starting with 51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8 not found: ID does not exist" containerID="51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"
Jul 09 14:58:05.547273 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.547233    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8"} err="failed to get container status \"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8\": rpc error: code = NotFound desc = could not find container \"51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8\": container with ID starting with 51250fc72725cb5b69c630def67887b90d24d33bd38350b9d71cd1876e82a6e8 not found: ID does not exist"
Jul 09 14:58:05.673413 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673380    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673591 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673434    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673591 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673469    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673591 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673540    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673591 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673582    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673790 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673633    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlkr8\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673790 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673661    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673790 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673687    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca\") pod \"713133ab-76bb-4e6b-9144-5beedb66934d\" (UID: \"713133ab-76bb-4e6b-9144-5beedb66934d\") "
Jul 09 14:58:05.673950 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.673874    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:05.674294 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.674266    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-registry-certificates\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.674708 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.674679    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:05.675980 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.675951    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:05.676106 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.676086    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:05.676211 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.676185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:05.676259 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.676185    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8" (OuterVolumeSpecName: "kube-api-access-jlkr8") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "kube-api-access-jlkr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:05.676336 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.676315    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:05.682040 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.682009    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "713133ab-76bb-4e6b-9144-5beedb66934d" (UID: "713133ab-76bb-4e6b-9144-5beedb66934d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775523    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713133ab-76bb-4e6b-9144-5beedb66934d-ca-trust-extracted\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775555    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713133ab-76bb-4e6b-9144-5beedb66934d-trusted-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775565    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-installation-pull-secrets\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775574    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-bound-sa-token\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775584    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713133ab-76bb-4e6b-9144-5beedb66934d-image-registry-private-configuration\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775593    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-registry-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.775609 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.775601    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlkr8\" (UniqueName: \"kubernetes.io/projected/713133ab-76bb-4e6b-9144-5beedb66934d-kube-api-access-jlkr8\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:05.861438 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.861409    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:58:05.865687 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.865660    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d76fb84f5-vwfhs"]
Jul 09 14:58:05.907848 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:05.907818    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" path="/var/lib/kubelet/pods/713133ab-76bb-4e6b-9144-5beedb66934d/volumes"
Jul 09 14:58:06.684937 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:06.684902    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:06.687167 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:06.687148    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4-metrics-tls\") pod \"dns-default-2cd85\" (UID: \"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4\") " pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:06.729985 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:06.729955    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mn998\""
Jul 09 14:58:06.737430 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:06.737415    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:06.912639 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:06.912616    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2cd85"]
Jul 09 14:58:06.914699 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:58:06.914669    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b08ffe_3125_4dc8_aefa_25cf5a74b5f4.slice/crio-37ae802e8e0b60d7b649533a0381a0e618d97a7bb017ff89e8b76d46dbaf34aa WatchSource:0}: Error finding container 37ae802e8e0b60d7b649533a0381a0e618d97a7bb017ff89e8b76d46dbaf34aa: Status 404 returned error can't find the container with id 37ae802e8e0b60d7b649533a0381a0e618d97a7bb017ff89e8b76d46dbaf34aa
Jul 09 14:58:07.549360 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:07.549324    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2cd85" event={"ID":"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4","Type":"ContainerStarted","Data":"37ae802e8e0b60d7b649533a0381a0e618d97a7bb017ff89e8b76d46dbaf34aa"}
Jul 09 14:58:09.561634 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:09.561549    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2cd85" event={"ID":"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4","Type":"ContainerStarted","Data":"13c1466ed7982e5f68c7de625472ddd932ebf581d7886db8fcf70be39416f216"}
Jul 09 14:58:09.561981 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:09.561644    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2cd85" event={"ID":"a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4","Type":"ContainerStarted","Data":"9b123a5590f5aad0952530974df73bddaf02e4527a69f136a4e467daae5a9695"}
Jul 09 14:58:09.561981 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:09.561689    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:09.585821 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:09.585769    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2cd85" podStartSLOduration=129.313382879 podStartE2EDuration="2m11.585753539s" totalImagesPullingTime="2.27237066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:58:09.584567451 +0000 UTC m=+166.275980257" watchObservedRunningTime="2026-07-09 14:58:09.585753539 +0000 UTC m=+166.277166318"
Jul 09 14:58:12.167097 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:12.167044    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:58:12.167486 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:12.167127    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:58:19.569285 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:19.569211    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2cd85"
Jul 09 14:58:22.526922 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.526856    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f5bb9b9f6-nrgq4" podUID="687f8aa5-36e5-49e9-b49a-872ba1981dec" containerName="console" containerID="cri-o://a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715" gracePeriod=15
Jul 09 14:58:22.762369 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.762347    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:58:22.924772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924744    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.924951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924792    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.924951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924837    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.924951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924857    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.924951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924898    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn97c\" (UniqueName: \"kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.924951 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.924929    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca\") pod \"687f8aa5-36e5-49e9-b49a-872ba1981dec\" (UID: \"687f8aa5-36e5-49e9-b49a-872ba1981dec\") "
Jul 09 14:58:22.925302 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.925280    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config" (OuterVolumeSpecName: "console-config") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:22.925394 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.925302    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:22.925394 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.925374    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca" (OuterVolumeSpecName: "service-ca") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:22.927153 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.927126    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:22.927249 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.927160    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:22.927249 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:22.927170    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c" (OuterVolumeSpecName: "kube-api-access-pn97c") pod "687f8aa5-36e5-49e9-b49a-872ba1981dec" (UID: "687f8aa5-36e5-49e9-b49a-872ba1981dec"). InnerVolumeSpecName "kube-api-access-pn97c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:23.025824 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025784    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-oauth-serving-cert\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.025824 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025813    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-oauth-config\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.025824 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025823    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn97c\" (UniqueName: \"kubernetes.io/projected/687f8aa5-36e5-49e9-b49a-872ba1981dec-kube-api-access-pn97c\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.025824 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025832    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.026094 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025841    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-serving-cert\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.026094 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.025850    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/687f8aa5-36e5-49e9-b49a-872ba1981dec-console-config\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:58:23.621194 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.621157    2573 generic.go:356] "Generic (PLEG): container finished" podID="687f8aa5-36e5-49e9-b49a-872ba1981dec" containerID="a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715" exitCode=0
Jul 09 14:58:23.621612 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.621204    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5bb9b9f6-nrgq4"
Jul 09 14:58:23.621612 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.621240    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5bb9b9f6-nrgq4" event={"ID":"687f8aa5-36e5-49e9-b49a-872ba1981dec","Type":"ContainerDied","Data":"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"}
Jul 09 14:58:23.621612 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.621303    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5bb9b9f6-nrgq4" event={"ID":"687f8aa5-36e5-49e9-b49a-872ba1981dec","Type":"ContainerDied","Data":"4dc82d912f68800f0309263189f8cd411320642aea79dbab9081eb1a25e87334"}
Jul 09 14:58:23.621612 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.621333    2573 scope.go:117] "RemoveContainer" containerID="a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"
Jul 09 14:58:23.630130 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.630109    2573 scope.go:117] "RemoveContainer" containerID="a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"
Jul 09 14:58:23.630380 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:58:23.630360    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715\": container with ID starting with a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715 not found: ID does not exist" containerID="a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"
Jul 09 14:58:23.630425 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.630389    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715"} err="failed to get container status \"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715\": rpc error: code = NotFound desc = could not find container \"a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715\": container with ID starting with a2ad2e0e8ee86a514f2331a286ebbf8ce3ca9c9f2167a8d6a23c7f50677a6715 not found: ID does not exist"
Jul 09 14:58:23.644177 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.644148    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:58:23.653016 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.652992    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5bb9b9f6-nrgq4"]
Jul 09 14:58:23.908275 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:23.908242    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="687f8aa5-36e5-49e9-b49a-872ba1981dec" path="/var/lib/kubelet/pods/687f8aa5-36e5-49e9-b49a-872ba1981dec/volumes"
Jul 09 14:58:32.172343 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:32.172311    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:58:32.176207 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:32.176181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b4bdc4fdf-trkm7"
Jul 09 14:58:34.664193 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:34.664159    2573 generic.go:356] "Generic (PLEG): container finished" podID="67198508-e405-4194-85ab-832bab637cf2" containerID="39531492411c204b1a1f7cead21a95a6f838d67195e62826c89e0991714aac84" exitCode=0
Jul 09 14:58:34.664578 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:34.664230    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq" event={"ID":"67198508-e405-4194-85ab-832bab637cf2","Type":"ContainerDied","Data":"39531492411c204b1a1f7cead21a95a6f838d67195e62826c89e0991714aac84"}
Jul 09 14:58:34.664628 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:34.664614    2573 scope.go:117] "RemoveContainer" containerID="39531492411c204b1a1f7cead21a95a6f838d67195e62826c89e0991714aac84"
Jul 09 14:58:35.670001 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:35.669964    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-f9mfq" event={"ID":"67198508-e405-4194-85ab-832bab637cf2","Type":"ContainerStarted","Data":"ac0d234c52792984081494a2e6271f0fc7cc3533e672789c9d5b4c502242c1ab"}
Jul 09 14:58:54.052082 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:54.052042    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:58:54.071409 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:54.071378    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:58:54.757481 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:58:54.757455    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:12.134900 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.134866    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:12.135970 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.135904    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="prometheus" containerID="cri-o://8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34" gracePeriod=600
Jul 09 14:59:12.136199 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.135962    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2" gracePeriod=600
Jul 09 14:59:12.136322 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.136025    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy" containerID="cri-o://4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e" gracePeriod=600
Jul 09 14:59:12.136322 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.136025    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="thanos-sidecar" containerID="cri-o://4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd" gracePeriod=600
Jul 09 14:59:12.136431 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.136040    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-web" containerID="cri-o://e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f" gracePeriod=600
Jul 09 14:59:12.136481 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.136034    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="config-reloader" containerID="cri-o://b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1" gracePeriod=600
Jul 09 14:59:12.383394 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.383370    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:12.535391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535358    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535399    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535426    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535482    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535538    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535569    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535597    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.535646 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535622    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535665    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535703    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535727    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535758    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535798    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535852    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535864    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535875    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535882    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535940    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9sxq\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.536018 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.535972    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.537932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.536861    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.537932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.537328    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:12.537932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.537405    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.537932 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.537884    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.538745 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.538726    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs\") pod \"4147315b-d23e-4497-9cfc-885f3fafca9a\" (UID: \"4147315b-d23e-4497-9cfc-885f3fafca9a\") "
Jul 09 14:59:12.539271 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539249    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539405 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539389    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539497 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539484    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539593 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539582    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-k8s-db\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539672 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539661    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539757 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539746    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.539864 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539839    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.539972 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.539954    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.540186 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.540062    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config" (OuterVolumeSpecName: "config") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.540300 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.540132    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq" (OuterVolumeSpecName: "kube-api-access-h9sxq") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "kube-api-access-h9sxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:12.541476 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.541447    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.541726 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.541706    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.541997 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.541960    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.541997 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.541970    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:12.542357 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.542334    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out" (OuterVolumeSpecName: "config-out") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 14:59:12.542459 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.542435    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:12.542766 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.542737    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.542992 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.542965    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.543055 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.543036    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.552081 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.552061    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config" (OuterVolumeSpecName: "web-config") pod "4147315b-d23e-4497-9cfc-885f3fafca9a" (UID: "4147315b-d23e-4497-9cfc-885f3fafca9a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:12.640906 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640873    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.640906 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640901    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4147315b-d23e-4497-9cfc-885f3fafca9a-configmap-metrics-client-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.640906 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640911    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-grpc-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640922    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-kube-rbac-proxy\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640931    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9sxq\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-kube-api-access-h9sxq\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640941    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-config\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640949    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-metrics-client-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640957    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-web-config\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640965    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640974    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640982    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4147315b-d23e-4497-9cfc-885f3fafca9a-config-out\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640990    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.640998    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4147315b-d23e-4497-9cfc-885f3fafca9a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.641114 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.641008    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4147315b-d23e-4497-9cfc-885f3fafca9a-tls-assets\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816395    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2" exitCode=0
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816419    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e" exitCode=0
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816426    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f" exitCode=0
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816432    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd" exitCode=0
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816437    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1" exitCode=0
Jul 09 14:59:12.816482 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816443    2573 generic.go:356] "Generic (PLEG): container finished" podID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34" exitCode=0
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816479    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816558    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816588    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816488    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816637    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816661    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"}
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816677    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.816889 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.816685    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4147315b-d23e-4497-9cfc-885f3fafca9a","Type":"ContainerDied","Data":"86a06e1c57b54c4351d2255c40fddb00faac49a116d0fd77189e9c4ec7a1ddf5"}
Jul 09 14:59:12.824602 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.824567    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.833873 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.833856    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.840269 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.840249    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.843225 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.843202    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:12.847329 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.847314    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.847670 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.847654    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:12.853920 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.853895    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.861216 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.861201    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.867631 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.867614    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.867892 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.867876    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.867940 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.867899    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.867940 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.867915    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.868157 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.868135    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.868202 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868168    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.868202 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868187    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.868454 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.868436    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.868542 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868462    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.868542 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868484    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.868783 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.868767    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.868843 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868788    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.868843 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.868804    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.869039 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.869023    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.869078 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869046    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.869078 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869072    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.869296 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.869278    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.869334 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869302    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.869334 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869315    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.869558 ip-10-0-133-59 kubenswrapper[2573]: E0709 14:59:12.869543    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.869615 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869561    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.869615 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869575    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.869772 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869751    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.869815 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869774    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.869973 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869955    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.870022 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.869973    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.870158 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870139    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.870197 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870158    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.870324 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870305    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.870324 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870322    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.870566 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870497    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.870619 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870611    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.870842 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870823    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.870923 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.870843    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.871066 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871048    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.871109 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871067    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.871269 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871252    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.871334 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871270    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.871476 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871460    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.871551 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871477    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.871722 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871706    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.871786 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871723    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.871924 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871907    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.871987 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.871925    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.872119 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872103    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.872182 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872120    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.872318 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872302    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.872379 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872320    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.872552 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872536    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.872613 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872553    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.872759 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872742    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.872808 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872762    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.872989 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872961    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.873026 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.872991    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.873187 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873171    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.873244 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873188    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.873405 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873384    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.873405 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873404    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.873627 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873611    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.873677 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873629    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.873822 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873807    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.873822 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873821    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.874001 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.873987    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.874048 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874002    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.874202 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874187    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.874247 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874202    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.874413 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874393    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.874452 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874414    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.874668 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874650    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.874717 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874668    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.874868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874852    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.874929 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.874869    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.875090 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875075    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.875090 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875089    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.875286 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875270    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.875323 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875294    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.875483 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875467    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.875536 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875484    2573 scope.go:117] "RemoveContainer" containerID="af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"
Jul 09 14:59:12.875747 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875684    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2"} err="failed to get container status \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": rpc error: code = NotFound desc = could not find container \"af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2\": container with ID starting with af87a29afc747993cfc1ffff1cbd503c00a1e4274b791ce2bb5a74e481fba5d2 not found: ID does not exist"
Jul 09 14:59:12.875747 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875705    2573 scope.go:117] "RemoveContainer" containerID="4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"
Jul 09 14:59:12.875895 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875881    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e"} err="failed to get container status \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": rpc error: code = NotFound desc = could not find container \"4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e\": container with ID starting with 4b2691d0daf6952a64ea42defd2b7628ba3f6a4fccac5c55f59f96b8daa9385e not found: ID does not exist"
Jul 09 14:59:12.875931 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.875898    2573 scope.go:117] "RemoveContainer" containerID="e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"
Jul 09 14:59:12.876264 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876212    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f"} err="failed to get container status \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": rpc error: code = NotFound desc = could not find container \"e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f\": container with ID starting with e5f68cbce6f8f5367bb13ce77d8ce6f7962024d59f32f69529af8284df15581f not found: ID does not exist"
Jul 09 14:59:12.876264 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876238    2573 scope.go:117] "RemoveContainer" containerID="4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"
Jul 09 14:59:12.876629 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876606    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd"} err="failed to get container status \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": rpc error: code = NotFound desc = could not find container \"4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd\": container with ID starting with 4bd3f840ea4a564d40afd572f26eacda16f8fa2528139b6c107e09ce2abb04cd not found: ID does not exist"
Jul 09 14:59:12.876723 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876632    2573 scope.go:117] "RemoveContainer" containerID="b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"
Jul 09 14:59:12.876938 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876915    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1"} err="failed to get container status \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": rpc error: code = NotFound desc = could not find container \"b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1\": container with ID starting with b5a89afff9581c11079e636e24f70007d9b02d6dc936ce3f2a3d30c96ae4e5d1 not found: ID does not exist"
Jul 09 14:59:12.876996 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.876940    2573 scope.go:117] "RemoveContainer" containerID="8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"
Jul 09 14:59:12.877182 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.877163    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34"} err="failed to get container status \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": rpc error: code = NotFound desc = could not find container \"8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34\": container with ID starting with 8f7c15d0365cf9efdc5461822cf79466f7fc83e4cfd6e0b026df7b42fac5eb34 not found: ID does not exist"
Jul 09 14:59:12.877230 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.877184    2573 scope.go:117] "RemoveContainer" containerID="c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"
Jul 09 14:59:12.877422 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.877404    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f"} err="failed to get container status \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": rpc error: code = NotFound desc = could not find container \"c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f\": container with ID starting with c978094754817cfce8ca671e298d21a576aba00b8c00fa70c9e0f90da506884f not found: ID does not exist"
Jul 09 14:59:12.878047 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878030    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:12.878313 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878302    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="thanos-sidecar"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878314    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="thanos-sidecar"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878331    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="config-reloader"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878336    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="config-reloader"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878343    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-thanos"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878348    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-thanos"
Jul 09 14:59:12.878358 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878359    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="687f8aa5-36e5-49e9-b49a-872ba1981dec" containerName="console"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878364    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="687f8aa5-36e5-49e9-b49a-872ba1981dec" containerName="console"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878372    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-web"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878377    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-web"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878383    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878388    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878396    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="init-config-reloader"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878401    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="init-config-reloader"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878409    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" containerName="registry"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878414    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" containerName="registry"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878421    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="prometheus"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878425    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="prometheus"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878466    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="prometheus"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878472    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878479    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-thanos"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878486    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="713133ab-76bb-4e6b-9144-5beedb66934d" containerName="registry"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878490    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="thanos-sidecar"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878496    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="config-reloader"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878501    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="687f8aa5-36e5-49e9-b49a-872ba1981dec" containerName="console"
Jul 09 14:59:12.878606 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.878507    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" containerName="kube-rbac-proxy-web"
Jul 09 14:59:12.883753 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.883735    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:12.886886 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.886869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 14:59:12.886999 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.886893    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 14:59:12.887132 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887118    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 14:59:12.887450 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887431    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 14:59:12.887555 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887475    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 14:59:12.887555 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887454    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 14:59:12.887761 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887745    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 14:59:12.887904 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887886    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 14:59:12.887904 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.887894    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1s97hgmf7fd47\""
Jul 09 14:59:12.888088 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.888071    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 14:59:12.888144 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.888107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 14:59:12.888502 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.888485    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mnjsf\""
Jul 09 14:59:12.889080 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.889056    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 14:59:12.889266 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.889253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 14:59:12.890822 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.890804    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 14:59:12.892590 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.892572    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 14:59:12.900714 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:12.900694    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:13.044811 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044834    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044861    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-web-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044926    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045015 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.044945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045185    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045263 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045507 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045275    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-config-out\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045507 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045507 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl785\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-kube-api-access-zl785\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045507 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045355    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.045507 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.045380    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.145980 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.145953    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.145989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146008    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146032    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-web-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146116    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146242    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146268    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.146391 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146331    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147086 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146356    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147086 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146443    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147086 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.146962    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147238 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.147175    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147238 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.147214    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-config-out\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147345 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.147237    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147345 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.147282    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl785\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-kube-api-access-zl785\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.147533 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.147491    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.148327 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.148036    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.148903 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.148884    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.149265 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.149240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.149414 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.149240    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.149503 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.149481    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-web-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.150305 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.149950    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-config\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.150305 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.150205    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.150305 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.150281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.150934 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.150878    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.151019 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.150969    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.151083 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.151057    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80ecd0ad-3711-405b-83fa-d280e0ae765d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.151497 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.151479    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80ecd0ad-3711-405b-83fa-d280e0ae765d-config-out\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.151943 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.151918    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.152683 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.152663    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.152762 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.152667    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.153122 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.153105    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80ecd0ad-3711-405b-83fa-d280e0ae765d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.156576 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.156462    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl785\" (UniqueName: \"kubernetes.io/projected/80ecd0ad-3711-405b-83fa-d280e0ae765d-kube-api-access-zl785\") pod \"prometheus-k8s-0\" (UID: \"80ecd0ad-3711-405b-83fa-d280e0ae765d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.193275 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.193243    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 14:59:13.335847 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.335723    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 14:59:13.337870 ip-10-0-133-59 kubenswrapper[2573]: W0709 14:59:13.337848    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ecd0ad_3711_405b_83fa_d280e0ae765d.slice/crio-f878627ad05fe232c950739cdafdae8f234e4f5bf749225239c93e5587ee93de WatchSource:0}: Error finding container f878627ad05fe232c950739cdafdae8f234e4f5bf749225239c93e5587ee93de: Status 404 returned error can't find the container with id f878627ad05fe232c950739cdafdae8f234e4f5bf749225239c93e5587ee93de
Jul 09 14:59:13.823210 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.823120    2573 generic.go:356] "Generic (PLEG): container finished" podID="80ecd0ad-3711-405b-83fa-d280e0ae765d" containerID="0e324af19e77115b81952a3df553837c2df7931ec7fd5035e61c87ef869c3439" exitCode=0
Jul 09 14:59:13.823210 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.823181    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerDied","Data":"0e324af19e77115b81952a3df553837c2df7931ec7fd5035e61c87ef869c3439"}
Jul 09 14:59:13.823381 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.823268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"f878627ad05fe232c950739cdafdae8f234e4f5bf749225239c93e5587ee93de"}
Jul 09 14:59:13.909877 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:13.909850    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4147315b-d23e-4497-9cfc-885f3fafca9a" path="/var/lib/kubelet/pods/4147315b-d23e-4497-9cfc-885f3fafca9a/volumes"
Jul 09 14:59:14.829643 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"011255920fb843cf395e76731f766dc7bb6fa693c87096985f51715a0be6caed"}
Jul 09 14:59:14.830092 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"0767bd731363de37f4b5cb1bff36c0c5b4ddea797be31dea20645e4d4fc4edca"}
Jul 09 14:59:14.830092 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829755    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"f9489f1f9c9069d8f5307ef7e64e57d4a333a6f1fde09f85add4bf8a552ea80c"}
Jul 09 14:59:14.830092 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829802    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"f7e56aa76dd4a4190cb1bdbe22315b4c44e518e7a3865862ccb33a2b0565fd91"}
Jul 09 14:59:14.830092 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829840    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"f98f2654606fab61250c89e6028cd73ec554668f803df3cce5149368f381722b"}
Jul 09 14:59:14.830092 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.829879    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80ecd0ad-3711-405b-83fa-d280e0ae765d","Type":"ContainerStarted","Data":"2c9c2f6758f42c538f6f7cfa8b50073e5ef58da769e908ba249d4a3dabe7e20e"}
Jul 09 14:59:14.865740 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:14.865695    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8472355560000002 podStartE2EDuration="2.865678647s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.443091ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:14.864312244 +0000 UTC m=+231.555725047" watchObservedRunningTime="2026-07-09 14:59:14.865678647 +0000 UTC m=+231.557091427"
Jul 09 14:59:18.193868 ip-10-0-133-59 kubenswrapper[2573]: I0709 14:59:18.193828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 15:00:13.194446 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:13.194408    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 15:00:13.209702 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:13.209678    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 15:00:14.081721 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:14.081695    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 15:00:23.717264 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:23.717229    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:00:23.717730 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:23.717294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:00:23.722508 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:23.722485    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:00:23.722673 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:23.722594    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:00:23.729206 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:00:23.729184    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 15:01:37.466769 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.466685    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"]
Jul 09 15:01:37.469993 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.469964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.473064 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.473041    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 15:01:37.473195 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.473041    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6j8hs\""
Jul 09 15:01:37.474565 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.474547    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 15:01:37.481892 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.481867    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"]
Jul 09 15:01:37.558232 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.558190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.558447 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.558314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82bj\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-kube-api-access-g82bj\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.659164 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.659125    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.659344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.659174    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g82bj\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-kube-api-access-g82bj\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.669214 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.669183    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82bj\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-kube-api-access-g82bj\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.669336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.669185    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ef940cb-a322-4994-87cb-cc9e7071c196-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-t5c6f\" (UID: \"4ef940cb-a322-4994-87cb-cc9e7071c196\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.797268 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.797181    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"
Jul 09 15:01:37.931203 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.931179    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f"]
Jul 09 15:01:37.933495 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:01:37.933472    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ef940cb_a322_4994_87cb_cc9e7071c196.slice/crio-cfa62a1bfdfecf4e7fe9a220c124a2b5ae623e3b7da449d35a15681149904706 WatchSource:0}: Error finding container cfa62a1bfdfecf4e7fe9a220c124a2b5ae623e3b7da449d35a15681149904706: Status 404 returned error can't find the container with id cfa62a1bfdfecf4e7fe9a220c124a2b5ae623e3b7da449d35a15681149904706
Jul 09 15:01:37.935280 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:37.935259    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:01:38.405381 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:38.405347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f" event={"ID":"4ef940cb-a322-4994-87cb-cc9e7071c196","Type":"ContainerStarted","Data":"cfa62a1bfdfecf4e7fe9a220c124a2b5ae623e3b7da449d35a15681149904706"}
Jul 09 15:01:43.434723 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:43.434684    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f" event={"ID":"4ef940cb-a322-4994-87cb-cc9e7071c196","Type":"ContainerStarted","Data":"84732fa37fbd63962f92f935af9cb6a47335abce6ff86b3feebd3253afa1157c"}
Jul 09 15:01:43.454797 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:01:43.454747    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-t5c6f" podStartSLOduration=1.338210359 podStartE2EDuration="6.454731094s" totalImagesPullingTime="5.116520735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:43.45298561 +0000 UTC m=+380.144398389" watchObservedRunningTime="2026-07-09 15:01:43.454731094 +0000 UTC m=+380.146143873"
Jul 09 15:02:24.680569 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.680529    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"]
Jul 09 15:02:24.683029 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.683012    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.686204 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.686178    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 15:02:24.687837 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.687820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 15:02:24.687917 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.687834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 15:02:24.687917 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.687869    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 15:02:24.688028 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.688010    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gqtlg\""
Jul 09 15:02:24.688071 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.688043    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 15:02:24.696353 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.696328    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"]
Jul 09 15:02:24.866271 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.866235    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.866271 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.866274    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-metrics-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.866496 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.866375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624a58bb-a3b9-4115-b8b2-f88093350503-manager-config\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.866496 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.866464    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlvsf\" (UniqueName: \"kubernetes.io/projected/624a58bb-a3b9-4115-b8b2-f88093350503-kube-api-access-jlvsf\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.967733 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.967645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlvsf\" (UniqueName: \"kubernetes.io/projected/624a58bb-a3b9-4115-b8b2-f88093350503-kube-api-access-jlvsf\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.967733 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.967685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.967733 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.967704    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-metrics-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.967733 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.967730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624a58bb-a3b9-4115-b8b2-f88093350503-manager-config\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.968300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.968281    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/624a58bb-a3b9-4115-b8b2-f88093350503-manager-config\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.970138 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.970117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-metrics-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.970239 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.970192    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/624a58bb-a3b9-4115-b8b2-f88093350503-cert\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.982549 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.982506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlvsf\" (UniqueName: \"kubernetes.io/projected/624a58bb-a3b9-4115-b8b2-f88093350503-kube-api-access-jlvsf\") pod \"lws-controller-manager-79ccf9794-x84bh\" (UID: \"624a58bb-a3b9-4115-b8b2-f88093350503\") " pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:24.992454 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:24.992435    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:25.132777 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:25.132748    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"]
Jul 09 15:02:25.135393 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:02:25.135365    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624a58bb_a3b9_4115_b8b2_f88093350503.slice/crio-13578b28634fe96f65122130ef6222ae947800c42510a67b6a7fcf61cd2d8cbe WatchSource:0}: Error finding container 13578b28634fe96f65122130ef6222ae947800c42510a67b6a7fcf61cd2d8cbe: Status 404 returned error can't find the container with id 13578b28634fe96f65122130ef6222ae947800c42510a67b6a7fcf61cd2d8cbe
Jul 09 15:02:25.605701 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:25.605667    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh" event={"ID":"624a58bb-a3b9-4115-b8b2-f88093350503","Type":"ContainerStarted","Data":"13578b28634fe96f65122130ef6222ae947800c42510a67b6a7fcf61cd2d8cbe"}
Jul 09 15:02:28.620837 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:28.620800    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh" event={"ID":"624a58bb-a3b9-4115-b8b2-f88093350503","Type":"ContainerStarted","Data":"e9f0f829ab8879138d62832366a4b1c55ecede76324ee9869c5514d4cab3978e"}
Jul 09 15:02:28.621236 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:28.620873    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:28.640782 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:28.640733    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh" podStartSLOduration=2.197598645 podStartE2EDuration="4.640717378s" totalImagesPullingTime="2.443118733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:28.639952313 +0000 UTC m=+425.331365117" watchObservedRunningTime="2026-07-09 15:02:28.640717378 +0000 UTC m=+425.332130157"
Jul 09 15:02:38.792924 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.792892    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"]
Jul 09 15:02:38.795485 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.795468    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.798778 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.798758    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-28fml\""
Jul 09 15:02:38.798937 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.798919    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 15:02:38.799016 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.799002    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 15:02:38.800306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.800291    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 15:02:38.800359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.800325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 15:02:38.836325 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.836295    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"]
Jul 09 15:02:38.878281 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.878247    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.878469 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.878298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.878469 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.878319    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.878469 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.878375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.878618 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.878471    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fn95\" (UniqueName: \"kubernetes.io/projected/a019d1db-5406-4a07-a030-c931b46b46b5-kube-api-access-6fn95\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.979810 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.979774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fn95\" (UniqueName: \"kubernetes.io/projected/a019d1db-5406-4a07-a030-c931b46b46b5-kube-api-access-6fn95\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.979810 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.979816    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.980015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.979940    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.980015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.979973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.980015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.979991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.980415 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.980385    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-manifests\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.982197 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.982179    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a019d1db-5406-4a07-a030-c931b46b46b5-tmp\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.982414 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.982396    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-webhook-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.982466 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.982401    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a019d1db-5406-4a07-a030-c931b46b46b5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:38.992959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:38.992929    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fn95\" (UniqueName: \"kubernetes.io/projected/a019d1db-5406-4a07-a030-c931b46b46b5-kube-api-access-6fn95\") pod \"opendatahub-operator-controller-manager-69d458487d-5p88m\" (UID: \"a019d1db-5406-4a07-a030-c931b46b46b5\") " pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:39.105608 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:39.105494    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:39.252231 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:39.252205    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"]
Jul 09 15:02:39.254506 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:02:39.254476    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda019d1db_5406_4a07_a030_c931b46b46b5.slice/crio-081f760e77260679be38068c1bbb3bbe5f8b3ca82f6b8827505b3340229b7693 WatchSource:0}: Error finding container 081f760e77260679be38068c1bbb3bbe5f8b3ca82f6b8827505b3340229b7693: Status 404 returned error can't find the container with id 081f760e77260679be38068c1bbb3bbe5f8b3ca82f6b8827505b3340229b7693
Jul 09 15:02:39.626607 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:39.626578    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-79ccf9794-x84bh"
Jul 09 15:02:39.663713 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:39.663676    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m" event={"ID":"a019d1db-5406-4a07-a030-c931b46b46b5","Type":"ContainerStarted","Data":"081f760e77260679be38068c1bbb3bbe5f8b3ca82f6b8827505b3340229b7693"}
Jul 09 15:02:43.685665 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:43.685628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m" event={"ID":"a019d1db-5406-4a07-a030-c931b46b46b5","Type":"ContainerStarted","Data":"50c516af67c60d065b04757f73e459486a7edc2525fd9568ee1f0c1007dc5df5"}
Jul 09 15:02:44.691001 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:44.690968    2573 generic.go:356] "Generic (PLEG): container finished" podID="a019d1db-5406-4a07-a030-c931b46b46b5" containerID="50c516af67c60d065b04757f73e459486a7edc2525fd9568ee1f0c1007dc5df5" exitCode=0
Jul 09 15:02:44.691572 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:44.691043    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m" event={"ID":"a019d1db-5406-4a07-a030-c931b46b46b5","Type":"ContainerDied","Data":"50c516af67c60d065b04757f73e459486a7edc2525fd9568ee1f0c1007dc5df5"}
Jul 09 15:02:45.698108 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:45.698073    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m" event={"ID":"a019d1db-5406-4a07-a030-c931b46b46b5","Type":"ContainerStarted","Data":"4f85719a495a105e77e92af9ddd186b6b1856e9c61948cd68b793d420de1e857"}
Jul 09 15:02:45.698532 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:45.698174    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:02:45.727371 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:45.727304    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m" podStartSLOduration=2.484982301 podStartE2EDuration="7.727284744s" totalImagesPullingTime="4.179020219s" totalInitContainerRuntime="1.063282224s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:02:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:02:45.725456716 +0000 UTC m=+442.416869522" watchObservedRunningTime="2026-07-09 15:02:45.727284744 +0000 UTC m=+442.418697525"
Jul 09 15:02:56.705144 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:02:56.705113    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69d458487d-5p88m"
Jul 09 15:03:00.328301 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.328265    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"]
Jul 09 15:03:00.339705 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.339678    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.344214 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.344189    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 15:03:00.344380 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.344233    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7bvmw\""
Jul 09 15:03:00.344461 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.344261    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 15:03:00.344461 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.344278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 15:03:00.344612 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.344274    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 15:03:00.346791 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.346770    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"]
Jul 09 15:03:00.476650 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.476609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5eda5-5d70-475a-b318-e32651698d20-tls-certs\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.476851 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.476699    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c5eda5-5d70-475a-b318-e32651698d20-tmp\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.476851 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.476723    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgf97\" (UniqueName: \"kubernetes.io/projected/82c5eda5-5d70-475a-b318-e32651698d20-kube-api-access-wgf97\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.577752 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.577716    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5eda5-5d70-475a-b318-e32651698d20-tls-certs\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.577933 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.577774    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c5eda5-5d70-475a-b318-e32651698d20-tmp\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.577933 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.577791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgf97\" (UniqueName: \"kubernetes.io/projected/82c5eda5-5d70-475a-b318-e32651698d20-kube-api-access-wgf97\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.580188 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.580117    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82c5eda5-5d70-475a-b318-e32651698d20-tmp\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.580373 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.580354    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82c5eda5-5d70-475a-b318-e32651698d20-tls-certs\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.596257 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.596221    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgf97\" (UniqueName: \"kubernetes.io/projected/82c5eda5-5d70-475a-b318-e32651698d20-kube-api-access-wgf97\") pod \"kube-auth-proxy-8d68d4884-htcx9\" (UID: \"82c5eda5-5d70-475a-b318-e32651698d20\") " pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.651493 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.651457    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"
Jul 09 15:03:00.887145 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:00.887117    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8d68d4884-htcx9"]
Jul 09 15:03:00.896129 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:03:00.896098    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c5eda5_5d70_475a_b318_e32651698d20.slice/crio-a0b641047088a9bbb67e1ec6cc3434ec5b0544fc3c9aa85ec09283ec87b30109 WatchSource:0}: Error finding container a0b641047088a9bbb67e1ec6cc3434ec5b0544fc3c9aa85ec09283ec87b30109: Status 404 returned error can't find the container with id a0b641047088a9bbb67e1ec6cc3434ec5b0544fc3c9aa85ec09283ec87b30109
Jul 09 15:03:01.772607 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:01.772560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9" event={"ID":"82c5eda5-5d70-475a-b318-e32651698d20","Type":"ContainerStarted","Data":"a0b641047088a9bbb67e1ec6cc3434ec5b0544fc3c9aa85ec09283ec87b30109"}
Jul 09 15:03:04.793359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:04.793318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9" event={"ID":"82c5eda5-5d70-475a-b318-e32651698d20","Type":"ContainerStarted","Data":"421c62f7b86deb09459232cb55826fae02dd84720ebbf27bf21c810f7f918d4d"}
Jul 09 15:03:04.821060 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:03:04.821010    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8d68d4884-htcx9" podStartSLOduration=1.870921211 podStartE2EDuration="4.820994568s" totalImagesPullingTime="2.950073357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:04.820008963 +0000 UTC m=+461.511421787" watchObservedRunningTime="2026-07-09 15:03:04.820994568 +0000 UTC m=+461.512407350"
Jul 09 15:04:25.720670 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.720574    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9cdf8645-h78jm"]
Jul 09 15:04:25.724284 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.724258    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.727351 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.727318    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 15:04:25.728709 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728687    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 15:04:25.728829 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728728    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 15:04:25.728913 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728899    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 15:04:25.728975 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728909    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 15:04:25.728975 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728902    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 15:04:25.728975 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.728968    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 15:04:25.729125 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.729008    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mblkz\""
Jul 09 15:04:25.733410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.733391    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 15:04:25.736999 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.736978    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cdf8645-h78jm"]
Jul 09 15:04:25.793760 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.793945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793775    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.793945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-oauth-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.793945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-service-ca\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.793945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-oauth-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.793945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-trusted-ca-bundle\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.794120 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.793956    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwvv\" (UniqueName: \"kubernetes.io/projected/ccf1300c-9324-44c8-8b2b-f4232b5229df-kube-api-access-4qwvv\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894527 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894488    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-oauth-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-service-ca\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-oauth-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894651    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-trusted-ca-bundle\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894675    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwvv\" (UniqueName: \"kubernetes.io/projected/ccf1300c-9324-44c8-8b2b-f4232b5229df-kube-api-access-4qwvv\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894940 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894739    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.894940 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.894786    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.895401 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.895378    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-oauth-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.895552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.895437    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-service-ca\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.895552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.895546    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.895761 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.895735    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ccf1300c-9324-44c8-8b2b-f4232b5229df-trusted-ca-bundle\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.897061 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.897033    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-oauth-config\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.897186 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.897170    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ccf1300c-9324-44c8-8b2b-f4232b5229df-console-serving-cert\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:25.905104 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:25.905081    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwvv\" (UniqueName: \"kubernetes.io/projected/ccf1300c-9324-44c8-8b2b-f4232b5229df-kube-api-access-4qwvv\") pod \"console-5f9cdf8645-h78jm\" (UID: \"ccf1300c-9324-44c8-8b2b-f4232b5229df\") " pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:26.035739 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:26.035656    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:26.170283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:26.170253    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cdf8645-h78jm"]
Jul 09 15:04:26.173124 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:04:26.173092    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf1300c_9324_44c8_8b2b_f4232b5229df.slice/crio-ab3c58f0a8470963ff48162f131d2e25131818ae0b8fd43b3ad76d6c127e66da WatchSource:0}: Error finding container ab3c58f0a8470963ff48162f131d2e25131818ae0b8fd43b3ad76d6c127e66da: Status 404 returned error can't find the container with id ab3c58f0a8470963ff48162f131d2e25131818ae0b8fd43b3ad76d6c127e66da
Jul 09 15:04:27.155958 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:27.155920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cdf8645-h78jm" event={"ID":"ccf1300c-9324-44c8-8b2b-f4232b5229df","Type":"ContainerStarted","Data":"c87c1423d2d02a68253fcefa2a136e06a4afec2e9a78a4aed7979357ba66292e"}
Jul 09 15:04:27.156336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:27.155978    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cdf8645-h78jm" event={"ID":"ccf1300c-9324-44c8-8b2b-f4232b5229df","Type":"ContainerStarted","Data":"ab3c58f0a8470963ff48162f131d2e25131818ae0b8fd43b3ad76d6c127e66da"}
Jul 09 15:04:27.175867 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:27.175808    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9cdf8645-h78jm" podStartSLOduration=2.175791848 podStartE2EDuration="2.175791848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:27.175457652 +0000 UTC m=+543.866870470" watchObservedRunningTime="2026-07-09 15:04:27.175791848 +0000 UTC m=+543.867204629"
Jul 09 15:04:36.036627 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:36.036578    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:36.037145 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:36.036653    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:36.041410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:36.041387    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:36.199714 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:36.199680    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9cdf8645-h78jm"
Jul 09 15:04:43.753723 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.753682    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"]
Jul 09 15:04:43.756122 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.756102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:43.759314 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.759294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 15:04:43.760384 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.760368    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 15:04:43.760441 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.760381    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nzn42\""
Jul 09 15:04:43.768920 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.768892    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"]
Jul 09 15:04:43.857810 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.857772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j498r\" (UniqueName: \"kubernetes.io/projected/fdc07be5-cef3-4ca6-8a83-782b616410d1-kube-api-access-j498r\") pod \"authorino-operator-75cc8d5cb7-p44ng\" (UID: \"fdc07be5-cef3-4ca6-8a83-782b616410d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:43.958913 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.958873    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j498r\" (UniqueName: \"kubernetes.io/projected/fdc07be5-cef3-4ca6-8a83-782b616410d1-kube-api-access-j498r\") pod \"authorino-operator-75cc8d5cb7-p44ng\" (UID: \"fdc07be5-cef3-4ca6-8a83-782b616410d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:43.968556 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:43.968533    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j498r\" (UniqueName: \"kubernetes.io/projected/fdc07be5-cef3-4ca6-8a83-782b616410d1-kube-api-access-j498r\") pod \"authorino-operator-75cc8d5cb7-p44ng\" (UID: \"fdc07be5-cef3-4ca6-8a83-782b616410d1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:44.067290 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:44.067182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:44.206728 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:44.206706    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"]
Jul 09 15:04:44.208828 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:04:44.208801    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc07be5_cef3_4ca6_8a83_782b616410d1.slice/crio-2ec1333223ebe459176e06dad2b9148247ed518aa3161583a6b74b0dad371c1d WatchSource:0}: Error finding container 2ec1333223ebe459176e06dad2b9148247ed518aa3161583a6b74b0dad371c1d: Status 404 returned error can't find the container with id 2ec1333223ebe459176e06dad2b9148247ed518aa3161583a6b74b0dad371c1d
Jul 09 15:04:44.234178 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:44.234144    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng" event={"ID":"fdc07be5-cef3-4ca6-8a83-782b616410d1","Type":"ContainerStarted","Data":"2ec1333223ebe459176e06dad2b9148247ed518aa3161583a6b74b0dad371c1d"}
Jul 09 15:04:47.251079 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:47.251040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng" event={"ID":"fdc07be5-cef3-4ca6-8a83-782b616410d1","Type":"ContainerStarted","Data":"df5d8e0961aec4a762c2de153ea660486bf07ccffc7a66feb4a7e66336a3a4f6"}
Jul 09 15:04:47.251500 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:47.251190    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:04:47.293822 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:47.293768    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng" podStartSLOduration=1.738236288 podStartE2EDuration="4.293748558s" totalImagesPullingTime="2.55551227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:47.292423981 +0000 UTC m=+563.983836764" watchObservedRunningTime="2026-07-09 15:04:47.293748558 +0000 UTC m=+563.985161337"
Jul 09 15:04:58.258711 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:04:58.258677    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p44ng"
Jul 09 15:05:23.746756 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:23.746726    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:05:23.747944 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:23.747922    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:05:23.751461 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:23.751445    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:05:23.752689 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:23.752667    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:05:31.701180 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.701138    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:31.704958 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.704933    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:31.708693 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.708667    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nvbwl\""
Jul 09 15:05:31.714591 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.714569    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:31.789093 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.789058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9tj8\" (UniqueName: \"kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8\") pod \"authorino-58cd955675-hfwps\" (UID: \"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54\") " pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:31.861797 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.861761    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:05:31.865163 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.865145    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:05:31.878611 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.878587    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:05:31.890136 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.890102    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9tj8\" (UniqueName: \"kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8\") pod \"authorino-58cd955675-hfwps\" (UID: \"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54\") " pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:31.899845 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.899819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9tj8\" (UniqueName: \"kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8\") pod \"authorino-58cd955675-hfwps\" (UID: \"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54\") " pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:31.991257 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:31.991168    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlk2m\" (UniqueName: \"kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m\") pod \"authorino-75d556bd77-hmk8v\" (UID: \"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6\") " pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:05:32.014237 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.014208    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:32.092675 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.092636    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlk2m\" (UniqueName: \"kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m\") pod \"authorino-75d556bd77-hmk8v\" (UID: \"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6\") " pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:05:32.102495 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.102455    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlk2m\" (UniqueName: \"kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m\") pod \"authorino-75d556bd77-hmk8v\" (UID: \"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6\") " pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:05:32.153551 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.153523    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:32.156875 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:05:32.156848    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00ce0dbe_b1d6_420a_81e3_5b1cb913cc54.slice/crio-88a5ee693077092347f016b1c9f103889378c074bc0ebfd0d00a91755091eb84 WatchSource:0}: Error finding container 88a5ee693077092347f016b1c9f103889378c074bc0ebfd0d00a91755091eb84: Status 404 returned error can't find the container with id 88a5ee693077092347f016b1c9f103889378c074bc0ebfd0d00a91755091eb84
Jul 09 15:05:32.174501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.174477    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:05:32.308391 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.308358    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:05:32.311742 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:05:32.311709    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ade2bba_916d_4d95_adb8_12a3b2b3e9f6.slice/crio-f4b50d3a2d08e923f394659e4524d57653d00be0fc7a740a784c0406b782c0ac WatchSource:0}: Error finding container f4b50d3a2d08e923f394659e4524d57653d00be0fc7a740a784c0406b782c0ac: Status 404 returned error can't find the container with id f4b50d3a2d08e923f394659e4524d57653d00be0fc7a740a784c0406b782c0ac
Jul 09 15:05:32.458995 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.458961    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hfwps" event={"ID":"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54","Type":"ContainerStarted","Data":"88a5ee693077092347f016b1c9f103889378c074bc0ebfd0d00a91755091eb84"}
Jul 09 15:05:32.460107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:32.460085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hmk8v" event={"ID":"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6","Type":"ContainerStarted","Data":"f4b50d3a2d08e923f394659e4524d57653d00be0fc7a740a784c0406b782c0ac"}
Jul 09 15:05:36.487583 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:36.487542    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hfwps" event={"ID":"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54","Type":"ContainerStarted","Data":"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"}
Jul 09 15:05:36.489014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:36.488990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hmk8v" event={"ID":"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6","Type":"ContainerStarted","Data":"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"}
Jul 09 15:05:36.510992 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:36.510941    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hfwps" podStartSLOduration=1.528449952 podStartE2EDuration="5.510922809s" totalImagesPullingTime="3.982472857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:36.509940534 +0000 UTC m=+613.201353308" watchObservedRunningTime="2026-07-09 15:05:36.510922809 +0000 UTC m=+613.202335590"
Jul 09 15:05:36.530346 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:36.530293    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hmk8v" podStartSLOduration=1.715379693 podStartE2EDuration="5.530272761s" totalImagesPullingTime="3.814893068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:36.529272989 +0000 UTC m=+613.220685769" watchObservedRunningTime="2026-07-09 15:05:36.530272761 +0000 UTC m=+613.221685543"
Jul 09 15:05:36.559394 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:36.559361    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:38.500977 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:38.500940    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hfwps" podUID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" containerName="authorino" containerID="cri-o://3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d" gracePeriod=30
Jul 09 15:05:38.749115 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:38.749083    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:38.856268 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:38.856174    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9tj8\" (UniqueName: \"kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8\") pod \"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54\" (UID: \"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54\") "
Jul 09 15:05:38.858356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:38.858325    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8" (OuterVolumeSpecName: "kube-api-access-r9tj8") pod "00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" (UID: "00ce0dbe-b1d6-420a-81e3-5b1cb913cc54"). InnerVolumeSpecName "kube-api-access-r9tj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:05:38.957313 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:38.957274    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9tj8\" (UniqueName: \"kubernetes.io/projected/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54-kube-api-access-r9tj8\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:05:39.507447 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.507416    2573 generic.go:356] "Generic (PLEG): container finished" podID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" containerID="3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d" exitCode=0
Jul 09 15:05:39.507939 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.507461    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hfwps"
Jul 09 15:05:39.507939 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.507504    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hfwps" event={"ID":"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54","Type":"ContainerDied","Data":"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"}
Jul 09 15:05:39.507939 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.507579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hfwps" event={"ID":"00ce0dbe-b1d6-420a-81e3-5b1cb913cc54","Type":"ContainerDied","Data":"88a5ee693077092347f016b1c9f103889378c074bc0ebfd0d00a91755091eb84"}
Jul 09 15:05:39.507939 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.507605    2573 scope.go:117] "RemoveContainer" containerID="3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"
Jul 09 15:05:39.517091 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.517073    2573 scope.go:117] "RemoveContainer" containerID="3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"
Jul 09 15:05:39.517356 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:05:39.517335    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d\": container with ID starting with 3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d not found: ID does not exist" containerID="3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"
Jul 09 15:05:39.517399 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.517367    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d"} err="failed to get container status \"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d\": rpc error: code = NotFound desc = could not find container \"3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d\": container with ID starting with 3eddb8f77f65c87cc3d710358f119860ad8d9028c4ec462315296dd58e83912d not found: ID does not exist"
Jul 09 15:05:39.530010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.529974    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:39.532004 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.531978    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hfwps"]
Jul 09 15:05:39.909237 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:05:39.909200    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" path="/var/lib/kubelet/pods/00ce0dbe-b1d6-420a-81e3-5b1cb913cc54/volumes"
Jul 09 15:06:04.483809 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.483778    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:04.484260 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.484127    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" containerName="authorino"
Jul 09 15:06:04.484260 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.484138    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" containerName="authorino"
Jul 09 15:06:04.484260 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.484214    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ce0dbe-b1d6-420a-81e3-5b1cb913cc54" containerName="authorino"
Jul 09 15:06:04.486266 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.486246    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:04.494583 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.494559    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:04.579678 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.579640    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9cnk\" (UniqueName: \"kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk\") pod \"authorino-5d4b67c446-5t657\" (UID: \"cd372913-783f-41d5-915c-47cafbe3b0c6\") " pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:04.680929 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.680893    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9cnk\" (UniqueName: \"kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk\") pod \"authorino-5d4b67c446-5t657\" (UID: \"cd372913-783f-41d5-915c-47cafbe3b0c6\") " pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:04.690527 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.690494    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9cnk\" (UniqueName: \"kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk\") pod \"authorino-5d4b67c446-5t657\" (UID: \"cd372913-783f-41d5-915c-47cafbe3b0c6\") " pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:04.697408 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.697380    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:04.697694 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.697676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:04.735388 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.735303    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:06:04.739220 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.739144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.742471 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.742447    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 15:06:04.745552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.745526    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:06:04.782098 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.782066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwrk\" (UniqueName: \"kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.782254 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.782119    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.837271 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.837242    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:04.839152 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:06:04.839119    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd372913_783f_41d5_915c_47cafbe3b0c6.slice/crio-aa088222a5041f3b14324b4a6f00b0f178c7b97ce9fa8d150e49caa70474bb71 WatchSource:0}: Error finding container aa088222a5041f3b14324b4a6f00b0f178c7b97ce9fa8d150e49caa70474bb71: Status 404 returned error can't find the container with id aa088222a5041f3b14324b4a6f00b0f178c7b97ce9fa8d150e49caa70474bb71
Jul 09 15:06:04.883120 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.883047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czwrk\" (UniqueName: \"kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.883315 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.883166    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.885631 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.885601    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:04.892332 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:04.892268    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwrk\" (UniqueName: \"kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk\") pod \"authorino-646b89d65c-sl4t4\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") " pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:05.051781 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.051697    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:06:05.183757 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.183729    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:06:05.186183 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:06:05.186156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd791bf17_171a_4a99_b559_aa76f1e42fcf.slice/crio-192f3b5420a01a53c698206128eec04debc968e9a216de35e89cf754b0812b92 WatchSource:0}: Error finding container 192f3b5420a01a53c698206128eec04debc968e9a216de35e89cf754b0812b92: Status 404 returned error can't find the container with id 192f3b5420a01a53c698206128eec04debc968e9a216de35e89cf754b0812b92
Jul 09 15:06:05.624621 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.624577    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646b89d65c-sl4t4" event={"ID":"d791bf17-171a-4a99-b559-aa76f1e42fcf","Type":"ContainerStarted","Data":"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"}
Jul 09 15:06:05.624621 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.624627    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646b89d65c-sl4t4" event={"ID":"d791bf17-171a-4a99-b559-aa76f1e42fcf","Type":"ContainerStarted","Data":"192f3b5420a01a53c698206128eec04debc968e9a216de35e89cf754b0812b92"}
Jul 09 15:06:05.626142 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.626117    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t657" event={"ID":"cd372913-783f-41d5-915c-47cafbe3b0c6","Type":"ContainerStarted","Data":"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"}
Jul 09 15:06:05.626277 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.626150    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t657" event={"ID":"cd372913-783f-41d5-915c-47cafbe3b0c6","Type":"ContainerStarted","Data":"aa088222a5041f3b14324b4a6f00b0f178c7b97ce9fa8d150e49caa70474bb71"}
Jul 09 15:06:05.626277 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.626190    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5t657" podUID="cd372913-783f-41d5-915c-47cafbe3b0c6" containerName="authorino" containerID="cri-o://b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860" gracePeriod=30
Jul 09 15:06:05.642271 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.642216    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-646b89d65c-sl4t4" podStartSLOduration=1.349218974 podStartE2EDuration="1.642194281s" totalImagesPullingTime="292.975307ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:05.641493131 +0000 UTC m=+642.332905914" watchObservedRunningTime="2026-07-09 15:06:05.642194281 +0000 UTC m=+642.333607061"
Jul 09 15:06:05.658319 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.658272    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5t657" podStartSLOduration=1.277600619 podStartE2EDuration="1.658255496s" totalImagesPullingTime="380.654877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:05.657758847 +0000 UTC m=+642.349171628" watchObservedRunningTime="2026-07-09 15:06:05.658255496 +0000 UTC m=+642.349668288"
Jul 09 15:06:05.672404 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.672371    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:06:05.672578 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.672554    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hmk8v" podUID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" containerName="authorino" containerID="cri-o://ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f" gracePeriod=30
Jul 09 15:06:05.938913 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.938883    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:05.941907 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.941881    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:06:05.992875 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.992794    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9cnk\" (UniqueName: \"kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk\") pod \"cd372913-783f-41d5-915c-47cafbe3b0c6\" (UID: \"cd372913-783f-41d5-915c-47cafbe3b0c6\") "
Jul 09 15:06:05.992875 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.992845    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlk2m\" (UniqueName: \"kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m\") pod \"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6\" (UID: \"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6\") "
Jul 09 15:06:05.994990 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.994962    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m" (OuterVolumeSpecName: "kube-api-access-nlk2m") pod "0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" (UID: "0ade2bba-916d-4d95-adb8-12a3b2b3e9f6"). InnerVolumeSpecName "kube-api-access-nlk2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:06:05.995082 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:05.994997    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk" (OuterVolumeSpecName: "kube-api-access-d9cnk") pod "cd372913-783f-41d5-915c-47cafbe3b0c6" (UID: "cd372913-783f-41d5-915c-47cafbe3b0c6"). InnerVolumeSpecName "kube-api-access-d9cnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:06:06.094244 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.094209    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9cnk\" (UniqueName: \"kubernetes.io/projected/cd372913-783f-41d5-915c-47cafbe3b0c6-kube-api-access-d9cnk\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:06:06.094244 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.094235    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlk2m\" (UniqueName: \"kubernetes.io/projected/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6-kube-api-access-nlk2m\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:06:06.634731 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.634694    2573 generic.go:356] "Generic (PLEG): container finished" podID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" containerID="ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f" exitCode=0
Jul 09 15:06:06.635209 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.634738    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hmk8v"
Jul 09 15:06:06.635209 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.634778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hmk8v" event={"ID":"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6","Type":"ContainerDied","Data":"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"}
Jul 09 15:06:06.635209 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.634822    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hmk8v" event={"ID":"0ade2bba-916d-4d95-adb8-12a3b2b3e9f6","Type":"ContainerDied","Data":"f4b50d3a2d08e923f394659e4524d57653d00be0fc7a740a784c0406b782c0ac"}
Jul 09 15:06:06.635209 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.634846    2573 scope.go:117] "RemoveContainer" containerID="ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"
Jul 09 15:06:06.636022 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.636004    2573 generic.go:356] "Generic (PLEG): container finished" podID="cd372913-783f-41d5-915c-47cafbe3b0c6" containerID="b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860" exitCode=0
Jul 09 15:06:06.636102 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.636032    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t657" event={"ID":"cd372913-783f-41d5-915c-47cafbe3b0c6","Type":"ContainerDied","Data":"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"}
Jul 09 15:06:06.636102 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.636060    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5t657"
Jul 09 15:06:06.636186 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.636065    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5t657" event={"ID":"cd372913-783f-41d5-915c-47cafbe3b0c6","Type":"ContainerDied","Data":"aa088222a5041f3b14324b4a6f00b0f178c7b97ce9fa8d150e49caa70474bb71"}
Jul 09 15:06:06.651099 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.651080    2573 scope.go:117] "RemoveContainer" containerID="ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"
Jul 09 15:06:06.651403 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:06:06.651383    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f\": container with ID starting with ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f not found: ID does not exist" containerID="ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"
Jul 09 15:06:06.651478 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.651416    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f"} err="failed to get container status \"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f\": rpc error: code = NotFound desc = could not find container \"ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f\": container with ID starting with ff48cc515feb782735f7b3db29b671d474b6c308b985c9d8c631e1ab7b42f53f not found: ID does not exist"
Jul 09 15:06:06.651478 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.651440    2573 scope.go:117] "RemoveContainer" containerID="b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"
Jul 09 15:06:06.659659 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.659642    2573 scope.go:117] "RemoveContainer" containerID="b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"
Jul 09 15:06:06.659898 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:06:06.659879    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860\": container with ID starting with b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860 not found: ID does not exist" containerID="b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"
Jul 09 15:06:06.659960 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.659905    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860"} err="failed to get container status \"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860\": rpc error: code = NotFound desc = could not find container \"b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860\": container with ID starting with b565d32f794412b9c8c36a7f9f7c2ec07a68833bc322aff7eb67e2fb5a0e9860 not found: ID does not exist"
Jul 09 15:06:06.667924 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.667898    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:06:06.672162 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.672140    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hmk8v"]
Jul 09 15:06:06.684367 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.684345    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:06.689010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:06.688987    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5t657"]
Jul 09 15:06:07.908226 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:07.908191    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" path="/var/lib/kubelet/pods/0ade2bba-916d-4d95-adb8-12a3b2b3e9f6/volumes"
Jul 09 15:06:07.908628 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:07.908526    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd372913-783f-41d5-915c-47cafbe3b0c6" path="/var/lib/kubelet/pods/cd372913-783f-41d5-915c-47cafbe3b0c6/volumes"
Jul 09 15:06:46.491451 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491409    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qkxlm"]
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491776    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd372913-783f-41d5-915c-47cafbe3b0c6" containerName="authorino"
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491790    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd372913-783f-41d5-915c-47cafbe3b0c6" containerName="authorino"
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491803    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" containerName="authorino"
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491808    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" containerName="authorino"
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491865    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ade2bba-916d-4d95-adb8-12a3b2b3e9f6" containerName="authorino"
Jul 09 15:06:46.491987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.491875    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd372913-783f-41d5-915c-47cafbe3b0c6" containerName="authorino"
Jul 09 15:06:46.496006 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.495984    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.498990 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.498970    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b7b8w\""
Jul 09 15:06:46.499078 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.498974    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 15:06:46.505937 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.505909    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qkxlm"]
Jul 09 15:06:46.557562 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.557504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxd8g\" (UniqueName: \"kubernetes.io/projected/cec3d102-d738-49c3-93d7-05deeb555b8d-kube-api-access-cxd8g\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.557726 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.557588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec3d102-d738-49c3-93d7-05deeb555b8d-plugins-config-volume\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.658624 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.658587    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxd8g\" (UniqueName: \"kubernetes.io/projected/cec3d102-d738-49c3-93d7-05deeb555b8d-kube-api-access-cxd8g\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.658817 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.658658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec3d102-d738-49c3-93d7-05deeb555b8d-plugins-config-volume\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.659293 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.659274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cec3d102-d738-49c3-93d7-05deeb555b8d-plugins-config-volume\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.670536 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.670484    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxd8g\" (UniqueName: \"kubernetes.io/projected/cec3d102-d738-49c3-93d7-05deeb555b8d-kube-api-access-cxd8g\") pod \"payload-processing-58f86c7798-qkxlm\" (UID: \"cec3d102-d738-49c3-93d7-05deeb555b8d\") " pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.807277 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.807195    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:46.946324 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.946209    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qkxlm"]
Jul 09 15:06:46.949087 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:06:46.949046    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec3d102_d738_49c3_93d7_05deeb555b8d.slice/crio-a9ea786a57d4694ca1dde2b873d5bf1669c043ddd37fe0a2131735cdc0db5eda WatchSource:0}: Error finding container a9ea786a57d4694ca1dde2b873d5bf1669c043ddd37fe0a2131735cdc0db5eda: Status 404 returned error can't find the container with id a9ea786a57d4694ca1dde2b873d5bf1669c043ddd37fe0a2131735cdc0db5eda
Jul 09 15:06:46.950971 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:46.950955    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:06:47.826905 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:47.826864    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm" event={"ID":"cec3d102-d738-49c3-93d7-05deeb555b8d","Type":"ContainerStarted","Data":"a9ea786a57d4694ca1dde2b873d5bf1669c043ddd37fe0a2131735cdc0db5eda"}
Jul 09 15:06:48.832826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:48.832787    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm" event={"ID":"cec3d102-d738-49c3-93d7-05deeb555b8d","Type":"ContainerStarted","Data":"a3089f06a0d1b8dc92f85adb020319abb099f2dc159e2fde404c8c274520a0f2"}
Jul 09 15:06:48.833218 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:48.832940    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:06:48.852617 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:48.852568    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm" podStartSLOduration=1.608395272 podStartE2EDuration="2.85255143s" totalImagesPullingTime="1.244156158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:06:48.850414303 +0000 UTC m=+685.541827105" watchObservedRunningTime="2026-07-09 15:06:48.85255143 +0000 UTC m=+685.543964217"
Jul 09 15:06:59.839718 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:06:59.839686    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qkxlm"
Jul 09 15:07:12.965118 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.965080    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"]
Jul 09 15:07:12.969349 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.969323    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:12.973430 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.973395    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 15:07:12.973430 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.973408    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 15:07:12.973430 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.973423    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 15:07:12.973709 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.973415    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x5qqk\""
Jul 09 15:07:12.978807 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:12.978781    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"]
Jul 09 15:07:13.087126 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087083    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.087126 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.087356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab6809a-503f-4471-af0f-4cfdf13b8401-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.087356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087215    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.087356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74kxg\" (UniqueName: \"kubernetes.io/projected/eab6809a-503f-4471-af0f-4cfdf13b8401-kube-api-access-74kxg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.087356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.087303    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188137 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188094    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188164    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188189    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188228    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab6809a-503f-4471-af0f-4cfdf13b8401-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188276    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188300    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74kxg\" (UniqueName: \"kubernetes.io/projected/eab6809a-503f-4471-af0f-4cfdf13b8401-kube-api-access-74kxg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188687 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188659    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188753 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188708    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.188753 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.188746    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.190584 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.190560    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eab6809a-503f-4471-af0f-4cfdf13b8401-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.190688 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.190658    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eab6809a-503f-4471-af0f-4cfdf13b8401-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.197624 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.197596    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74kxg\" (UniqueName: \"kubernetes.io/projected/eab6809a-503f-4471-af0f-4cfdf13b8401-kube-api-access-74kxg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-trk5s\" (UID: \"eab6809a-503f-4471-af0f-4cfdf13b8401\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.280945 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.280850    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:13.420185 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.420157    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"]
Jul 09 15:07:13.422843 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:07:13.422820    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab6809a_503f_4471_af0f_4cfdf13b8401.slice/crio-1004bcef903a2181c6907e51a4fd9840bcd40faed56988f397320f136f74baa5 WatchSource:0}: Error finding container 1004bcef903a2181c6907e51a4fd9840bcd40faed56988f397320f136f74baa5: Status 404 returned error can't find the container with id 1004bcef903a2181c6907e51a4fd9840bcd40faed56988f397320f136f74baa5
Jul 09 15:07:13.954703 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:13.954654    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s" event={"ID":"eab6809a-503f-4471-af0f-4cfdf13b8401","Type":"ContainerStarted","Data":"1004bcef903a2181c6907e51a4fd9840bcd40faed56988f397320f136f74baa5"}
Jul 09 15:07:14.962455 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:14.962420    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s" event={"ID":"eab6809a-503f-4471-af0f-4cfdf13b8401","Type":"ContainerStarted","Data":"c43dc8c52a301e3324e67734a204666744873d6ece26c9a21590cae4073d0776"}
Jul 09 15:07:14.983759 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:14.983706    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s" podStartSLOduration=1.7714332769999999 podStartE2EDuration="2.983688167s" totalImagesPullingTime="1.21225489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:07:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:07:14.982614761 +0000 UTC m=+711.674027566" watchObservedRunningTime="2026-07-09 15:07:14.983688167 +0000 UTC m=+711.675100938"
Jul 09 15:07:23.281120 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:23.281063    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:23.281781 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:23.281156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:23.293988 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:23.293959    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:24.016223 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.016195    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-trk5s"
Jul 09 15:07:24.377180 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.377107    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"]
Jul 09 15:07:24.380332 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.380314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.383056 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.383036    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 15:07:24.391471 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.391446    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"]
Jul 09 15:07:24.500336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500299    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.500573 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.500573 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500407    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df531ec5-6b61-4e85-8c62-69376661e6a9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.500573 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.500744 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwskh\" (UniqueName: \"kubernetes.io/projected/df531ec5-6b61-4e85-8c62-69376661e6a9-kube-api-access-kwskh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.500744 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.500620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601215    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df531ec5-6b61-4e85-8c62-69376661e6a9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601560 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601321    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601560 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601347    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwskh\" (UniqueName: \"kubernetes.io/projected/df531ec5-6b61-4e85-8c62-69376661e6a9-kube-api-access-kwskh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601560 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601381    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601560 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601419    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601788 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601712    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601788 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601759    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.601859 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.601811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.603635 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.603607    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df531ec5-6b61-4e85-8c62-69376661e6a9-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.603943 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.603925    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df531ec5-6b61-4e85-8c62-69376661e6a9-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.612026 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.612007    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwskh\" (UniqueName: \"kubernetes.io/projected/df531ec5-6b61-4e85-8c62-69376661e6a9-kube-api-access-kwskh\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pzzwn\" (UID: \"df531ec5-6b61-4e85-8c62-69376661e6a9\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.691240 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.691205    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:24.831040 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:24.830971    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"]
Jul 09 15:07:24.833359 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:07:24.833319    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf531ec5_6b61_4e85_8c62_69376661e6a9.slice/crio-086546691a485075b5674c9d076490c15f48a899fd63ae859452dab1076871f8 WatchSource:0}: Error finding container 086546691a485075b5674c9d076490c15f48a899fd63ae859452dab1076871f8: Status 404 returned error can't find the container with id 086546691a485075b5674c9d076490c15f48a899fd63ae859452dab1076871f8
Jul 09 15:07:25.010689 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:25.010579    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn" event={"ID":"df531ec5-6b61-4e85-8c62-69376661e6a9","Type":"ContainerStarted","Data":"086546691a485075b5674c9d076490c15f48a899fd63ae859452dab1076871f8"}
Jul 09 15:07:26.019204 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:26.019161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn" event={"ID":"df531ec5-6b61-4e85-8c62-69376661e6a9","Type":"ContainerStarted","Data":"91ed545c688f09658eef1987c231f25da5ee78105123b319c88e7e9de046515e"}
Jul 09 15:07:26.045992 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:26.045940    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn" podStartSLOduration=1.8229551769999999 podStartE2EDuration="2.045923391s" totalImagesPullingTime="222.968214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:07:26.045039082 +0000 UTC m=+722.736451864" watchObservedRunningTime="2026-07-09 15:07:26.045923391 +0000 UTC m=+722.737336170"
Jul 09 15:07:34.691543 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:34.691467    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:34.692050 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:34.691828    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:34.704157 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:34.704125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:07:35.086781 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:07:35.086693    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pzzwn"
Jul 09 15:08:59.655987 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.655895    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff459b68-gthgj"]
Jul 09 15:08:59.659724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.659700    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.668585 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.668560    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff459b68-gthgj"]
Jul 09 15:08:59.695591 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.695564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/627f3705-ab2e-4d97-b560-b15126f44930-tls-cert\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.695738 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.695638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95w4\" (UniqueName: \"kubernetes.io/projected/627f3705-ab2e-4d97-b560-b15126f44930-kube-api-access-b95w4\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.796868 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.796832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95w4\" (UniqueName: \"kubernetes.io/projected/627f3705-ab2e-4d97-b560-b15126f44930-kube-api-access-b95w4\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.797034 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.796920    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/627f3705-ab2e-4d97-b560-b15126f44930-tls-cert\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.799342 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.799312    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/627f3705-ab2e-4d97-b560-b15126f44930-tls-cert\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.805327 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.805302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95w4\" (UniqueName: \"kubernetes.io/projected/627f3705-ab2e-4d97-b560-b15126f44930-kube-api-access-b95w4\") pod \"authorino-7ff459b68-gthgj\" (UID: \"627f3705-ab2e-4d97-b560-b15126f44930\") " pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:08:59.970713 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:08:59.970629    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff459b68-gthgj"
Jul 09 15:09:00.108240 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:00.108209    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff459b68-gthgj"]
Jul 09 15:09:00.111910 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:09:00.111871    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod627f3705_ab2e_4d97_b560_b15126f44930.slice/crio-c50277ac48e48d81504554220db1f3b26220598ddb9a46b5a45cbb1899c72a8e WatchSource:0}: Error finding container c50277ac48e48d81504554220db1f3b26220598ddb9a46b5a45cbb1899c72a8e: Status 404 returned error can't find the container with id c50277ac48e48d81504554220db1f3b26220598ddb9a46b5a45cbb1899c72a8e
Jul 09 15:09:00.473194 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:00.473158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff459b68-gthgj" event={"ID":"627f3705-ab2e-4d97-b560-b15126f44930","Type":"ContainerStarted","Data":"c50277ac48e48d81504554220db1f3b26220598ddb9a46b5a45cbb1899c72a8e"}
Jul 09 15:09:01.481711 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.481587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff459b68-gthgj" event={"ID":"627f3705-ab2e-4d97-b560-b15126f44930","Type":"ContainerStarted","Data":"df347837ecb3f2406fbac116fd741bfe116eaff150e47d757724c5f8afb54192"}
Jul 09 15:09:01.501528 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.501437    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff459b68-gthgj" podStartSLOduration=1.464468676 podStartE2EDuration="2.501414305s" totalImagesPullingTime="1.036945629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:09:01.499900412 +0000 UTC m=+818.191313194" watchObservedRunningTime="2026-07-09 15:09:01.501414305 +0000 UTC m=+818.192827085"
Jul 09 15:09:01.545291 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.545252    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:09:01.545787 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.545756    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-646b89d65c-sl4t4" podUID="d791bf17-171a-4a99-b559-aa76f1e42fcf" containerName="authorino" containerID="cri-o://16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9" gracePeriod=30
Jul 09 15:09:01.798712 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.798688    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:09:01.814651 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.814612    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert\") pod \"d791bf17-171a-4a99-b559-aa76f1e42fcf\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") "
Jul 09 15:09:01.814841 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.814738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czwrk\" (UniqueName: \"kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk\") pod \"d791bf17-171a-4a99-b559-aa76f1e42fcf\" (UID: \"d791bf17-171a-4a99-b559-aa76f1e42fcf\") "
Jul 09 15:09:01.816692 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.816660    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk" (OuterVolumeSpecName: "kube-api-access-czwrk") pod "d791bf17-171a-4a99-b559-aa76f1e42fcf" (UID: "d791bf17-171a-4a99-b559-aa76f1e42fcf"). InnerVolumeSpecName "kube-api-access-czwrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:09:01.827309 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.827268    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d791bf17-171a-4a99-b559-aa76f1e42fcf" (UID: "d791bf17-171a-4a99-b559-aa76f1e42fcf"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:09:01.921282 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.921245    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czwrk\" (UniqueName: \"kubernetes.io/projected/d791bf17-171a-4a99-b559-aa76f1e42fcf-kube-api-access-czwrk\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:09:01.921282 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:01.921281    2573 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d791bf17-171a-4a99-b559-aa76f1e42fcf-tls-cert\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:09:02.487944 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.487843    2573 generic.go:356] "Generic (PLEG): container finished" podID="d791bf17-171a-4a99-b559-aa76f1e42fcf" containerID="16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9" exitCode=0
Jul 09 15:09:02.487944 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.487912    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-646b89d65c-sl4t4"
Jul 09 15:09:02.488456 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.487951    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646b89d65c-sl4t4" event={"ID":"d791bf17-171a-4a99-b559-aa76f1e42fcf","Type":"ContainerDied","Data":"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"}
Jul 09 15:09:02.488456 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.488020    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-646b89d65c-sl4t4" event={"ID":"d791bf17-171a-4a99-b559-aa76f1e42fcf","Type":"ContainerDied","Data":"192f3b5420a01a53c698206128eec04debc968e9a216de35e89cf754b0812b92"}
Jul 09 15:09:02.488456 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.488043    2573 scope.go:117] "RemoveContainer" containerID="16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"
Jul 09 15:09:02.497560 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.497536    2573 scope.go:117] "RemoveContainer" containerID="16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"
Jul 09 15:09:02.497911 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:09:02.497885    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9\": container with ID starting with 16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9 not found: ID does not exist" containerID="16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"
Jul 09 15:09:02.498016 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.497917    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9"} err="failed to get container status \"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9\": rpc error: code = NotFound desc = could not find container \"16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9\": container with ID starting with 16a187b319e28c7f54470b53204561371a0ed4e9305bba9f82c7c66999f09aa9 not found: ID does not exist"
Jul 09 15:09:02.507581 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.507544    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:09:02.509557 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:02.509531    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-646b89d65c-sl4t4"]
Jul 09 15:09:03.909366 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:09:03.909324    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d791bf17-171a-4a99-b559-aa76f1e42fcf" path="/var/lib/kubelet/pods/d791bf17-171a-4a99-b559-aa76f1e42fcf/volumes"
Jul 09 15:10:23.775580 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:10:23.775543    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:10:23.776487 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:10:23.776464    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:10:23.780303 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:10:23.780283    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:10:23.781158 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:10:23.781141    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:15:00.178701 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.178669    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:15:00.179322 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.179037    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d791bf17-171a-4a99-b559-aa76f1e42fcf" containerName="authorino"
Jul 09 15:15:00.179322 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.179049    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d791bf17-171a-4a99-b559-aa76f1e42fcf" containerName="authorino"
Jul 09 15:15:00.179322 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.179123    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d791bf17-171a-4a99-b559-aa76f1e42fcf" containerName="authorino"
Jul 09 15:15:00.182171 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.182148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:15:00.186743 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.186721    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:15:00.186860 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.186756    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:15:00.188005 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.187989    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vtct2\""
Jul 09 15:15:00.211404 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.211376    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:15:00.226686 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.226630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjw2h\" (UniqueName: \"kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h\") pod \"maas-api-key-cleanup-29726835-9rw7l\" (UID: \"4431111c-690d-421a-b38d-62ded892b728\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:15:00.327713 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.327679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjw2h\" (UniqueName: \"kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h\") pod \"maas-api-key-cleanup-29726835-9rw7l\" (UID: \"4431111c-690d-421a-b38d-62ded892b728\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:15:00.337708 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.337674    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjw2h\" (UniqueName: \"kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h\") pod \"maas-api-key-cleanup-29726835-9rw7l\" (UID: \"4431111c-690d-421a-b38d-62ded892b728\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:15:00.492970 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.492885    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:15:00.648019 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:15:00.647978    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4431111c_690d_421a_b38d_62ded892b728.slice/crio-e7e9881523f29a5ea9c039a56001687ceecd9777db66de9df9497446c8a3b016 WatchSource:0}: Error finding container e7e9881523f29a5ea9c039a56001687ceecd9777db66de9df9497446c8a3b016: Status 404 returned error can't find the container with id e7e9881523f29a5ea9c039a56001687ceecd9777db66de9df9497446c8a3b016
Jul 09 15:15:00.649994 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.649973    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:15:00.655440 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:00.655411    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:15:01.183709 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:01.183670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" event={"ID":"4431111c-690d-421a-b38d-62ded892b728","Type":"ContainerStarted","Data":"e7e9881523f29a5ea9c039a56001687ceecd9777db66de9df9497446c8a3b016"}
Jul 09 15:15:04.201115 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:04.201074    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" event={"ID":"4431111c-690d-421a-b38d-62ded892b728","Type":"ContainerStarted","Data":"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"}
Jul 09 15:15:04.218421 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:04.218375    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" podStartSLOduration=1.631139635 podStartE2EDuration="4.218361206s" totalImagesPullingTime="2.587221571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:15:04.217939081 +0000 UTC m=+1180.909351880" watchObservedRunningTime="2026-07-09 15:15:04.218361206 +0000 UTC m=+1180.909774020"
Jul 09 15:15:23.805349 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:23.805309    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:15:23.805866 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:23.805850    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:15:23.809816 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:23.809795    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:15:23.810171 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:15:23.810148    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:16:00.012327 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:00.012294    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:16:00.012953 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:00.012490    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" podUID="4431111c-690d-421a-b38d-62ded892b728" containerName="cleanup" containerID="cri-o://ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6" gracePeriod=30
Jul 09 15:16:30.225808 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.225774    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:16:30.254727 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.254693    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjw2h\" (UniqueName: \"kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h\") pod \"4431111c-690d-421a-b38d-62ded892b728\" (UID: \"4431111c-690d-421a-b38d-62ded892b728\") "
Jul 09 15:16:30.256862 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.256827    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h" (OuterVolumeSpecName: "kube-api-access-qjw2h") pod "4431111c-690d-421a-b38d-62ded892b728" (UID: "4431111c-690d-421a-b38d-62ded892b728"). InnerVolumeSpecName "kube-api-access-qjw2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:16:30.356576 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.356468    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjw2h\" (UniqueName: \"kubernetes.io/projected/4431111c-690d-421a-b38d-62ded892b728-kube-api-access-qjw2h\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:16:30.620654 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.620551    2573 generic.go:356] "Generic (PLEG): container finished" podID="4431111c-690d-421a-b38d-62ded892b728" containerID="ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6" exitCode=137
Jul 09 15:16:30.620654 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.620623    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"
Jul 09 15:16:30.620856 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.620653    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" event={"ID":"4431111c-690d-421a-b38d-62ded892b728","Type":"ContainerDied","Data":"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"}
Jul 09 15:16:30.620856 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.620717    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l" event={"ID":"4431111c-690d-421a-b38d-62ded892b728","Type":"ContainerDied","Data":"e7e9881523f29a5ea9c039a56001687ceecd9777db66de9df9497446c8a3b016"}
Jul 09 15:16:30.620856 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.620751    2573 scope.go:117] "RemoveContainer" containerID="ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"
Jul 09 15:16:30.629748 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.629715    2573 scope.go:117] "RemoveContainer" containerID="ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"
Jul 09 15:16:30.630062 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:16:30.630024    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6\": container with ID starting with ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6 not found: ID does not exist" containerID="ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"
Jul 09 15:16:30.630140 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.630067    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6"} err="failed to get container status \"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6\": rpc error: code = NotFound desc = could not find container \"ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6\": container with ID starting with ce5688e33fa1232bffe498b9c033f1be11717efebdde3fbe9b95a56c7bfb33f6 not found: ID does not exist"
Jul 09 15:16:30.647526 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.647477    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:16:30.650660 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:30.650634    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-9rw7l"]
Jul 09 15:16:31.909246 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:16:31.909210    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4431111c-690d-421a-b38d-62ded892b728" path="/var/lib/kubelet/pods/4431111c-690d-421a-b38d-62ded892b728/volumes"
Jul 09 15:20:23.835928 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:20:23.835897    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:20:23.838337 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:20:23.838314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:20:23.841410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:20:23.841383    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:20:23.843209 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:20:23.843189    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:25:23.866800 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:23.866773    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:25:23.876013 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:23.875980    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:25:23.878222 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:23.878202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:25:23.880438 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:23.880412    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:25:36.565826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.565796    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:25:36.566306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.566174    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4431111c-690d-421a-b38d-62ded892b728" containerName="cleanup"
Jul 09 15:25:36.566306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.566185    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4431111c-690d-421a-b38d-62ded892b728" containerName="cleanup"
Jul 09 15:25:36.566306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.566258    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4431111c-690d-421a-b38d-62ded892b728" containerName="cleanup"
Jul 09 15:25:36.569189 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.569165    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.579258 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.579226    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bd3840f1\"/\"default-dockercfg-pt4nn\""
Jul 09 15:25:36.579680 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.579655    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bd3840f1\"/\"kube-root-ca.crt\""
Jul 09 15:25:36.580223 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.580203    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-bd3840f1\"/\"openshift-service-ca.crt\""
Jul 09 15:25:36.580781 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.580665    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-bd3840f1\"/\"e2e-lifecycle-model-bd3840f1-kserve-self-signed-certs\""
Jul 09 15:25:36.582667 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.582639    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:25:36.691336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.691552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691349    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9k5n\" (UniqueName: \"kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.691552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691421    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.691552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.691552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.691726 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.691573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792231 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792444 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792239    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9k5n\" (UniqueName: \"kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792444 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792263    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792444 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792667 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792448    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792667 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792474    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792789 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792838 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792819    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.792876 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.792863    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.794546 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.794506    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.794830 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.794811    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.801328 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.801302    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9k5n\" (UniqueName: \"kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n\") pod \"e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") " pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:36.887306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:36.887279    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:37.018161 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:37.018136    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:25:37.020992 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:25:37.020959    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c7b2223_72f7_4214_86d3_61b67add1e1e.slice/crio-f16ef1a08e36b84c7d82273b23423f5acde7025d521cc891e1befe369e7c22e5 WatchSource:0}: Error finding container f16ef1a08e36b84c7d82273b23423f5acde7025d521cc891e1befe369e7c22e5: Status 404 returned error can't find the container with id f16ef1a08e36b84c7d82273b23423f5acde7025d521cc891e1befe369e7c22e5
Jul 09 15:25:37.215655 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:37.215560    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" event={"ID":"5c7b2223-72f7-4214-86d3-61b67add1e1e","Type":"ContainerStarted","Data":"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"}
Jul 09 15:25:37.215655 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:37.215609    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" event={"ID":"5c7b2223-72f7-4214-86d3-61b67add1e1e","Type":"ContainerStarted","Data":"f16ef1a08e36b84c7d82273b23423f5acde7025d521cc891e1befe369e7c22e5"}
Jul 09 15:25:37.233779 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:37.233729    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" podStartSLOduration=1.233713327 podStartE2EDuration="1.233713327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:25:37.233219745 +0000 UTC m=+1813.924632527" watchObservedRunningTime="2026-07-09 15:25:37.233713327 +0000 UTC m=+1813.925126107"
Jul 09 15:25:46.887884 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:46.887839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:46.887884 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:46.887895    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:46.900426 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:46.900402    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:25:47.272095 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:25:47.272011    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:26:12.031079 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:12.031043    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:26:27.051439 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.051383    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerName="main" containerID="cri-o://72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da" gracePeriod=45
Jul 09 15:26:27.301395 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.301371    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:26:27.354281 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354199    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354281 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354306    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354328    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354387    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9k5n\" (UniqueName: \"kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354421    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir\") pod \"5c7b2223-72f7-4214-86d3-61b67add1e1e\" (UID: \"5c7b2223-72f7-4214-86d3-61b67add1e1e\") "
Jul 09 15:26:27.354501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354492    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home" (OuterVolumeSpecName: "home") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:26:27.354818 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354683    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:26:27.354818 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354696    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:26:27.354818 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354796    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.354818 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354815    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.355030 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.354828    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.356528 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.356479    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm" (OuterVolumeSpecName: "dshm") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:26:27.357045 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.357019    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n" (OuterVolumeSpecName: "kube-api-access-q9k5n") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "kube-api-access-q9k5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:26:27.357169 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.357153    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5c7b2223-72f7-4214-86d3-61b67add1e1e" (UID: "5c7b2223-72f7-4214-86d3-61b67add1e1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:26:27.455753 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.455718    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c7b2223-72f7-4214-86d3-61b67add1e1e-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.455753 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.455749    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5c7b2223-72f7-4214-86d3-61b67add1e1e-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.455753 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.455759    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9k5n\" (UniqueName: \"kubernetes.io/projected/5c7b2223-72f7-4214-86d3-61b67add1e1e-kube-api-access-q9k5n\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:26:27.462838 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.462808    2573 generic.go:356] "Generic (PLEG): container finished" podID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerID="72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da" exitCode=0
Jul 09 15:26:27.463003 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.462859    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"
Jul 09 15:26:27.463003 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.462899    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" event={"ID":"5c7b2223-72f7-4214-86d3-61b67add1e1e","Type":"ContainerDied","Data":"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"}
Jul 09 15:26:27.463003 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.462943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" event={"ID":"5c7b2223-72f7-4214-86d3-61b67add1e1e","Type":"ContainerDied","Data":"f16ef1a08e36b84c7d82273b23423f5acde7025d521cc891e1befe369e7c22e5"}
Jul 09 15:26:27.463003 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.462962    2573 scope.go:117] "RemoveContainer" containerID="72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"
Jul 09 15:26:27.472102 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.472088    2573 scope.go:117] "RemoveContainer" containerID="72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"
Jul 09 15:26:27.472340 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:26:27.472325    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da\": container with ID starting with 72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da not found: ID does not exist" containerID="72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"
Jul 09 15:26:27.472379 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.472348    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da"} err="failed to get container status \"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da\": rpc error: code = NotFound desc = could not find container \"72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da\": container with ID starting with 72fb6f70e45c40d014f858bcb1531b8ed0ede84346aa46f60ed2f080ee7cf6da not found: ID does not exist"
Jul 09 15:26:27.487690 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.487662    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:26:27.490274 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.490254    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w"]
Jul 09 15:26:27.908846 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:27.908812    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" path="/var/lib/kubelet/pods/5c7b2223-72f7-4214-86d3-61b67add1e1e/volumes"
Jul 09 15:26:32.261621 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:26:32.261572    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-bd3840f1/e2e-lifecycle-model-bd3840f1-kserve-5c8f954bc5-nhq2w" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerName="main" probeResult="failure" output="Get \"https://10.133.0.38:8000/ready\": context deadline exceeded"
Jul 09 15:28:04.978201 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.978171    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:28:04.978639 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.978564    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerName="main"
Jul 09 15:28:04.978639 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.978576    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerName="main"
Jul 09 15:28:04.978719 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.978655    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c7b2223-72f7-4214-86d3-61b67add1e1e" containerName="main"
Jul 09 15:28:04.981605 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.981587    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:04.984937 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.984913    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2c3892-serving-cert\""
Jul 09 15:28:04.985068 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.985048    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:28:04.986311 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.986294    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:28:04.986427 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.986387    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vtct2\""
Jul 09 15:28:04.993958 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:04.993938    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:28:05.047166 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.047136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.047344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.047179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86vdw\" (UniqueName: \"kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.047344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.047206    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.147767 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.147736    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.147950 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.147778    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86vdw\" (UniqueName: \"kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.147950 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.147798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.147950 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:28:05.147897    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-serving-cert: secret "maas-api-e2e-inf-b-2c3892-serving-cert" not found
Jul 09 15:28:05.148060 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:28:05.148018    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls podName:58cbf530-957d-43ad-8ead-1f5a5f4d2b43 nodeName:}" failed. No retries permitted until 2026-07-09 15:28:05.647996693 +0000 UTC m=+1962.339409451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls") pod "maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" (UID: "58cbf530-957d-43ad-8ead-1f5a5f4d2b43") : secret "maas-api-e2e-inf-b-2c3892-serving-cert" not found
Jul 09 15:28:05.148429 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.148410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.158796 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.158763    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86vdw\" (UniqueName: \"kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.652369 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.652335    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.654812 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.654780    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") pod \"maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:05.893325 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:05.893286    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:06.027332 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:06.027217    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:28:06.030204 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:28:06.030174    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58cbf530_957d_43ad_8ead_1f5a5f4d2b43.slice/crio-6280466d3005700f924c83e92a4ad49bc88f36b81a5f3cb0cc42b5a1c87daea8 WatchSource:0}: Error finding container 6280466d3005700f924c83e92a4ad49bc88f36b81a5f3cb0cc42b5a1c87daea8: Status 404 returned error can't find the container with id 6280466d3005700f924c83e92a4ad49bc88f36b81a5f3cb0cc42b5a1c87daea8
Jul 09 15:28:06.031473 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:06.031457    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:28:06.943063 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:06.943032    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" event={"ID":"58cbf530-957d-43ad-8ead-1f5a5f4d2b43","Type":"ContainerStarted","Data":"6280466d3005700f924c83e92a4ad49bc88f36b81a5f3cb0cc42b5a1c87daea8"}
Jul 09 15:28:07.949417 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:07.949372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" event={"ID":"58cbf530-957d-43ad-8ead-1f5a5f4d2b43","Type":"ContainerStarted","Data":"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"}
Jul 09 15:28:07.949977 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:07.949538    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:07.969272 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:07.969217    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" podStartSLOduration=2.120175322 podStartE2EDuration="3.969200702s" totalImagesPullingTime="1.84902538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:28:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:28:07.968046831 +0000 UTC m=+1964.659459630" watchObservedRunningTime="2026-07-09 15:28:07.969200702 +0000 UTC m=+1964.660613483"
Jul 09 15:28:13.372341 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.372302    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:28:13.375857 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.375841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.378716 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.378698    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d783ed\"/\"kube-root-ca.crt\""
Jul 09 15:28:13.380119 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.380099    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d783ed\"/\"openshift-service-ca.crt\""
Jul 09 15:28:13.380245 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.380200    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d783ed\"/\"default-dockercfg-slb5d\""
Jul 09 15:28:13.380245 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.380219    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d783ed\"/\"test-model-d783ed-kserve-self-signed-certs\""
Jul 09 15:28:13.384882 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.384862    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:28:13.428069 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.428259 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428130    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.428259 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428190    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.428259 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.428405 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428267    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9x2g\" (UniqueName: \"kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.428405 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.428359    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529089 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529048    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529286 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529107    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529286 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529128    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529286 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529158    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529286 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529183    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529286 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529200    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9x2g\" (UniqueName: \"kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529676 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529651    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529746 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529653    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.529746 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.529725    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.531433 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.531410    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.531720 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.531703    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.539183 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.539160    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9x2g\" (UniqueName: \"kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g\") pod \"test-model-d783ed-kserve-6b48f967ff-rn8h7\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") " pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.686565 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.686500    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:13.827218 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.827186    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:28:13.829670 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:28:13.829639    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod255a040b_d1ef_4389_b85c_7809116c1099.slice/crio-8e5a77c8917c353e09c85b34e4b2fc41d6e5f39c590d833a3fbddce3948ebebb WatchSource:0}: Error finding container 8e5a77c8917c353e09c85b34e4b2fc41d6e5f39c590d833a3fbddce3948ebebb: Status 404 returned error can't find the container with id 8e5a77c8917c353e09c85b34e4b2fc41d6e5f39c590d833a3fbddce3948ebebb
Jul 09 15:28:13.960102 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.960012    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:28:13.980934 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.980895    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" event={"ID":"255a040b-d1ef-4389-b85c-7809116c1099","Type":"ContainerStarted","Data":"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"}
Jul 09 15:28:13.980934 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:13.980940    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" event={"ID":"255a040b-d1ef-4389-b85c-7809116c1099","Type":"ContainerStarted","Data":"8e5a77c8917c353e09c85b34e4b2fc41d6e5f39c590d833a3fbddce3948ebebb"}
Jul 09 15:28:14.000712 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:14.000657    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" podStartSLOduration=1.000640974 podStartE2EDuration="1.000640974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:28:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:28:13.999805273 +0000 UTC m=+1970.691218054" watchObservedRunningTime="2026-07-09 15:28:14.000640974 +0000 UTC m=+1970.692053765"
Jul 09 15:28:23.687007 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:23.686912    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:23.687458 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:23.687185    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:23.699381 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:23.699353    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:24.042914 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:24.042834    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:28:32.473587 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.473546    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:28:32.476876 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.476859    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.481124 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.481098    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2c3892\"/\"openshift-service-ca.crt\""
Jul 09 15:28:32.481124 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.481119    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2c3892\"/\"kube-root-ca.crt\""
Jul 09 15:28:32.481324 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.481155    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2c3892\"/\"default-dockercfg-4djb8\""
Jul 09 15:28:32.481324 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.481187    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2c3892\"/\"test-model-2c3892-kserve-self-signed-certs\""
Jul 09 15:28:32.489198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.489174    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:28:32.605419 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605382    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.605645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.605645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.605645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn56n\" (UniqueName: \"kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.605645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.605816 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.605655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.706874 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.706831    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.706874 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.706874    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707131 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.706911    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn56n\" (UniqueName: \"kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707131 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.706939    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707131 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.706979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707131 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.707050    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707377 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.707358    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707443 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.707419    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.707496 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.707441    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.709269 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.709246    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.709434 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.709416    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.716894 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.716870    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn56n\" (UniqueName: \"kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n\") pod \"test-model-2c3892-kserve-57d84f598c-r48gz\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") " pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.786841 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.786750    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:32.924278 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:32.924250    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:28:32.926593 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:28:32.926564    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6105a7d_8d04_47b3_b4b2_4fe8db899184.slice/crio-dd6ca26324530fdd4c08ca63a812ba12184f987b163eb56876a4fa8166e6352c WatchSource:0}: Error finding container dd6ca26324530fdd4c08ca63a812ba12184f987b163eb56876a4fa8166e6352c: Status 404 returned error can't find the container with id dd6ca26324530fdd4c08ca63a812ba12184f987b163eb56876a4fa8166e6352c
Jul 09 15:28:33.075192 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:33.075104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" event={"ID":"d6105a7d-8d04-47b3-b4b2-4fe8db899184","Type":"ContainerStarted","Data":"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"}
Jul 09 15:28:33.075192 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:33.075149    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" event={"ID":"d6105a7d-8d04-47b3-b4b2-4fe8db899184","Type":"ContainerStarted","Data":"dd6ca26324530fdd4c08ca63a812ba12184f987b163eb56876a4fa8166e6352c"}
Jul 09 15:28:33.094608 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:33.094553    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" podStartSLOduration=1.0945367639999999 podStartE2EDuration="1.094536764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:28:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:28:33.093373113 +0000 UTC m=+1989.784785894" watchObservedRunningTime="2026-07-09 15:28:33.094536764 +0000 UTC m=+1989.785949543"
Jul 09 15:28:42.787590 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:42.787548    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:42.787590 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:42.787596    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:42.800555 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:42.800500    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:43.135287 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:43.135199    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:28:52.649986 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:52.649947    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:28:53.582369 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:28:53.582333    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:29:07.670791 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:07.670743    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" podUID="255a040b-d1ef-4389-b85c-7809116c1099" containerName="main" containerID="cri-o://e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1" gracePeriod=45
Jul 09 15:29:07.921661 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:07.921602    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:29:08.026822 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.026784    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.026832    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9x2g\" (UniqueName: \"kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.026916    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.026974    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027015 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027001    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027046    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir\") pod \"255a040b-d1ef-4389-b85c-7809116c1099\" (UID: \"255a040b-d1ef-4389-b85c-7809116c1099\") "
Jul 09 15:29:08.027219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027063    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home" (OuterVolumeSpecName: "home") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.027348 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027314    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache" (OuterVolumeSpecName: "model-cache") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.027409 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027337    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.027488 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027469    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.027589 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027493    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.027589 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.027506    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.029205 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.029181    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:08.029465 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.029449    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm" (OuterVolumeSpecName: "dshm") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.029532 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.029482    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g" (OuterVolumeSpecName: "kube-api-access-k9x2g") pod "255a040b-d1ef-4389-b85c-7809116c1099" (UID: "255a040b-d1ef-4389-b85c-7809116c1099"). InnerVolumeSpecName "kube-api-access-k9x2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:08.128893 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.128854    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9x2g\" (UniqueName: \"kubernetes.io/projected/255a040b-d1ef-4389-b85c-7809116c1099-kube-api-access-k9x2g\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.128893 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.128887    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/255a040b-d1ef-4389-b85c-7809116c1099-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.128893 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.128901    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/255a040b-d1ef-4389-b85c-7809116c1099-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.248989 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.248904    2573 generic.go:356] "Generic (PLEG): container finished" podID="255a040b-d1ef-4389-b85c-7809116c1099" containerID="e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1" exitCode=0
Jul 09 15:29:08.248989 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.248967    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"
Jul 09 15:29:08.248989 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.248978    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" event={"ID":"255a040b-d1ef-4389-b85c-7809116c1099","Type":"ContainerDied","Data":"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"}
Jul 09 15:29:08.249210 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.249017    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7" event={"ID":"255a040b-d1ef-4389-b85c-7809116c1099","Type":"ContainerDied","Data":"8e5a77c8917c353e09c85b34e4b2fc41d6e5f39c590d833a3fbddce3948ebebb"}
Jul 09 15:29:08.249210 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.249040    2573 scope.go:117] "RemoveContainer" containerID="e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"
Jul 09 15:29:08.257974 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.257949    2573 scope.go:117] "RemoveContainer" containerID="e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"
Jul 09 15:29:08.258233 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:29:08.258210    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1\": container with ID starting with e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1 not found: ID does not exist" containerID="e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"
Jul 09 15:29:08.258304 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.258241    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1"} err="failed to get container status \"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1\": rpc error: code = NotFound desc = could not find container \"e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1\": container with ID starting with e81a419c8cc3634c7357afe0e4b4e6cbf799fb4ec5d66146e333911c1c6c9dc1 not found: ID does not exist"
Jul 09 15:29:08.272332 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.272309    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:29:08.276902 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.276880    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d783ed/test-model-d783ed-kserve-6b48f967ff-rn8h7"]
Jul 09 15:29:08.603358 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.603252    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" podUID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" containerName="main" containerID="cri-o://44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7" gracePeriod=45
Jul 09 15:29:08.853778 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.853716    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:29:08.935933 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.935903    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936130 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.935957    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936130 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936002    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn56n\" (UniqueName: \"kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936130 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936023    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936130 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936104    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936135    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm\") pod \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\" (UID: \"d6105a7d-8d04-47b3-b4b2-4fe8db899184\") "
Jul 09 15:29:08.936357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936169    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.936357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936288    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home" (OuterVolumeSpecName: "home") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.936357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936335    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:08.936590 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936455    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.936590 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936471    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.936590 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.936480    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:08.938294 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.938267    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:08.938408 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.938321    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n" (OuterVolumeSpecName: "kube-api-access-pn56n") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "kube-api-access-pn56n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:08.938408 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:08.938329    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm" (OuterVolumeSpecName: "dshm") pod "d6105a7d-8d04-47b3-b4b2-4fe8db899184" (UID: "d6105a7d-8d04-47b3-b4b2-4fe8db899184"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:29:09.037126 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.037098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn56n\" (UniqueName: \"kubernetes.io/projected/d6105a7d-8d04-47b3-b4b2-4fe8db899184-kube-api-access-pn56n\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:09.037126 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.037123    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6105a7d-8d04-47b3-b4b2-4fe8db899184-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:09.037126 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.037133    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6105a7d-8d04-47b3-b4b2-4fe8db899184-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:09.256989 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.256952    2573 generic.go:356] "Generic (PLEG): container finished" podID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" containerID="44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7" exitCode=0
Jul 09 15:29:09.257198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.256998    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"
Jul 09 15:29:09.257198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.257029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" event={"ID":"d6105a7d-8d04-47b3-b4b2-4fe8db899184","Type":"ContainerDied","Data":"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"}
Jul 09 15:29:09.257198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.257068    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz" event={"ID":"d6105a7d-8d04-47b3-b4b2-4fe8db899184","Type":"ContainerDied","Data":"dd6ca26324530fdd4c08ca63a812ba12184f987b163eb56876a4fa8166e6352c"}
Jul 09 15:29:09.257198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.257088    2573 scope.go:117] "RemoveContainer" containerID="44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"
Jul 09 15:29:09.266013 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.265993    2573 scope.go:117] "RemoveContainer" containerID="44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"
Jul 09 15:29:09.266283 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:29:09.266264    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7\": container with ID starting with 44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7 not found: ID does not exist" containerID="44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"
Jul 09 15:29:09.266350 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.266295    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7"} err="failed to get container status \"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7\": rpc error: code = NotFound desc = could not find container \"44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7\": container with ID starting with 44a860a6cdedd75871ecb38cae0a25d5643c6f339ec67c92b080cc8cb8522ad7 not found: ID does not exist"
Jul 09 15:29:09.282482 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.282458    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:29:09.287813 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.287792    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2c3892/test-model-2c3892-kserve-57d84f598c-r48gz"]
Jul 09 15:29:09.909684 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.909651    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255a040b-d1ef-4389-b85c-7809116c1099" path="/var/lib/kubelet/pods/255a040b-d1ef-4389-b85c-7809116c1099/volumes"
Jul 09 15:29:09.910079 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:09.910064    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" path="/var/lib/kubelet/pods/d6105a7d-8d04-47b3-b4b2-4fe8db899184/volumes"
Jul 09 15:29:39.017011 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.016977    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:29:39.017610 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.017193    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" podUID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" containerName="maas-api" containerID="cri-o://8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b" gracePeriod=30
Jul 09 15:29:39.263430 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.263403    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:29:39.302054 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.301959    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca\") pod \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") "
Jul 09 15:29:39.302222 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.302069    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86vdw\" (UniqueName: \"kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw\") pod \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") "
Jul 09 15:29:39.302222 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.302139    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") pod \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\" (UID: \"58cbf530-957d-43ad-8ead-1f5a5f4d2b43\") "
Jul 09 15:29:39.302406 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.302378    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58cbf530-957d-43ad-8ead-1f5a5f4d2b43" (UID: "58cbf530-957d-43ad-8ead-1f5a5f4d2b43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:39.304214 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.304184    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw" (OuterVolumeSpecName: "kube-api-access-86vdw") pod "58cbf530-957d-43ad-8ead-1f5a5f4d2b43" (UID: "58cbf530-957d-43ad-8ead-1f5a5f4d2b43"). InnerVolumeSpecName "kube-api-access-86vdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:39.304393 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.304378    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58cbf530-957d-43ad-8ead-1f5a5f4d2b43" (UID: "58cbf530-957d-43ad-8ead-1f5a5f4d2b43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:39.403410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.403380    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-openshift-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:39.403410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.403408    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86vdw\" (UniqueName: \"kubernetes.io/projected/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-kube-api-access-86vdw\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:39.403410 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.403418    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58cbf530-957d-43ad-8ead-1f5a5f4d2b43-maas-api-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:29:39.404889 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.404864    2573 generic.go:356] "Generic (PLEG): container finished" podID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" containerID="8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b" exitCode=0
Jul 09 15:29:39.404996 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.404908    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"
Jul 09 15:29:39.404996 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.404950    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" event={"ID":"58cbf530-957d-43ad-8ead-1f5a5f4d2b43","Type":"ContainerDied","Data":"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"}
Jul 09 15:29:39.405077 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.404997    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7" event={"ID":"58cbf530-957d-43ad-8ead-1f5a5f4d2b43","Type":"ContainerDied","Data":"6280466d3005700f924c83e92a4ad49bc88f36b81a5f3cb0cc42b5a1c87daea8"}
Jul 09 15:29:39.405077 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.405018    2573 scope.go:117] "RemoveContainer" containerID="8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"
Jul 09 15:29:39.413820 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.413803    2573 scope.go:117] "RemoveContainer" containerID="8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"
Jul 09 15:29:39.414067 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:29:39.414051    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b\": container with ID starting with 8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b not found: ID does not exist" containerID="8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"
Jul 09 15:29:39.414127 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.414074    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b"} err="failed to get container status \"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b\": rpc error: code = NotFound desc = could not find container \"8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b\": container with ID starting with 8815b4f0c1095b87e98c54a49881d9c5ebac07072205af89ceed40f24efcec4b not found: ID does not exist"
Jul 09 15:29:39.427474 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.427448    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:29:39.433733 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.433708    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2c3892-76df4c5595-95gz7"]
Jul 09 15:29:39.908962 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:39.908932    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" path="/var/lib/kubelet/pods/58cbf530-957d-43ad-8ead-1f5a5f4d2b43/volumes"
Jul 09 15:29:51.894755 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.894723    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:29:51.895144 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895131    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255a040b-d1ef-4389-b85c-7809116c1099" containerName="main"
Jul 09 15:29:51.895144 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895145    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="255a040b-d1ef-4389-b85c-7809116c1099" containerName="main"
Jul 09 15:29:51.895219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895160    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" containerName="maas-api"
Jul 09 15:29:51.895219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895166    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" containerName="maas-api"
Jul 09 15:29:51.895219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895186    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" containerName="main"
Jul 09 15:29:51.895219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895192    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" containerName="main"
Jul 09 15:29:51.895344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895245    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="58cbf530-957d-43ad-8ead-1f5a5f4d2b43" containerName="maas-api"
Jul 09 15:29:51.895344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895254    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6105a7d-8d04-47b3-b4b2-4fe8db899184" containerName="main"
Jul 09 15:29:51.895344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.895261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="255a040b-d1ef-4389-b85c-7809116c1099" containerName="main"
Jul 09 15:29:51.899600 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.899580    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:51.902318 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.902294    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-88802e-serving-cert\""
Jul 09 15:29:51.902559 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.902542    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vtct2\""
Jul 09 15:29:51.903663 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.903638    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:29:51.903778 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.903677    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:29:51.912424 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:51.912402    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:29:52.024575 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.024504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdtpv\" (UniqueName: \"kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.024793 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.024587    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.024793 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.024641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.125661 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.125616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.125825 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.125706    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdtpv\" (UniqueName: \"kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.125825 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.125733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.126345 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.126319    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.128062 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.128043    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.135241 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.135214    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdtpv\" (UniqueName: \"kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv\") pod \"maas-api-e2e-api-a-88802e-68f8978dff-gtfxg\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.211189 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.211091    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:52.346591 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.346430    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:29:52.349505 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:29:52.349463    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9086891_9fb9_4469_b615_ba53fdae8cf7.slice/crio-6ed9c288060c6a8b5249d4ffc29eb9161be32bde3498cf5dfb30c220874dab23 WatchSource:0}: Error finding container 6ed9c288060c6a8b5249d4ffc29eb9161be32bde3498cf5dfb30c220874dab23: Status 404 returned error can't find the container with id 6ed9c288060c6a8b5249d4ffc29eb9161be32bde3498cf5dfb30c220874dab23
Jul 09 15:29:52.465655 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:52.465567    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" event={"ID":"a9086891-9fb9-4469-b615-ba53fdae8cf7","Type":"ContainerStarted","Data":"6ed9c288060c6a8b5249d4ffc29eb9161be32bde3498cf5dfb30c220874dab23"}
Jul 09 15:29:53.471474 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:53.471437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" event={"ID":"a9086891-9fb9-4469-b615-ba53fdae8cf7","Type":"ContainerStarted","Data":"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"}
Jul 09 15:29:53.471892 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:53.471555    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:29:53.492004 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:53.491953    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" podStartSLOduration=1.967184299 podStartE2EDuration="2.491937674s" totalImagesPullingTime="524.753375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:53.489800367 +0000 UTC m=+2070.181213160" watchObservedRunningTime="2026-07-09 15:29:53.491937674 +0000 UTC m=+2070.183350454"
Jul 09 15:29:59.482160 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:29:59.482125    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:30:00.138304 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.138268    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:00.140861 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.140844    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:00.147353 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.147322    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:30:00.149704 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.149687    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:30:00.156561 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.156536    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:00.162489 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.162469    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:30:00.305671 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.305634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67pd\" (UniqueName: \"kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd\") pod \"maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc\" (UID: \"79008d49-f2c0-4002-a0fb-4a75763d068a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:00.305842 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.305677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v8jp\" (UniqueName: \"kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp\") pod \"maas-api-key-cleanup-29726850-zc7g6\" (UID: \"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:30:00.407083 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.406989    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67pd\" (UniqueName: \"kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd\") pod \"maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc\" (UID: \"79008d49-f2c0-4002-a0fb-4a75763d068a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:00.407083 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.407033    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v8jp\" (UniqueName: \"kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp\") pod \"maas-api-key-cleanup-29726850-zc7g6\" (UID: \"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:30:00.419955 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.419930    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v8jp\" (UniqueName: \"kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp\") pod \"maas-api-key-cleanup-29726850-zc7g6\" (UID: \"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:30:00.422046 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.422023    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67pd\" (UniqueName: \"kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd\") pod \"maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc\" (UID: \"79008d49-f2c0-4002-a0fb-4a75763d068a\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:00.451603 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.451576    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:00.461505 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.461489    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:30:00.607257 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.607224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:00.610487 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:30:00.610462    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79008d49_f2c0_4002_a0fb_4a75763d068a.slice/crio-5c517a8dd68139d838f55fb1fcf5f3869c2a949e90cffa68d0719b42ad842499 WatchSource:0}: Error finding container 5c517a8dd68139d838f55fb1fcf5f3869c2a949e90cffa68d0719b42ad842499: Status 404 returned error can't find the container with id 5c517a8dd68139d838f55fb1fcf5f3869c2a949e90cffa68d0719b42ad842499
Jul 09 15:30:00.633586 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.633501    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:30:00.640559 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:30:00.640534    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa8faab_1ac5_4273_b06f_59d2b4ec6ebe.slice/crio-a98f4cef34cbdd95b3b721ef949a6789c9fd7663cbd60663527e8ae0a24a303e WatchSource:0}: Error finding container a98f4cef34cbdd95b3b721ef949a6789c9fd7663cbd60663527e8ae0a24a303e: Status 404 returned error can't find the container with id a98f4cef34cbdd95b3b721ef949a6789c9fd7663cbd60663527e8ae0a24a303e
Jul 09 15:30:00.776963 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.776937    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:00.780306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.780287    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:00.784298 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.784271    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cf8dad-serving-cert\""
Jul 09 15:30:00.793246 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.793224    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:00.911637 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.911604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:00.911833 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.911669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fczd\" (UniqueName: \"kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:00.911833 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:00.911757    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.012267 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.012220    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fczd\" (UniqueName: \"kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.012482 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.012302    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.012482 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.012323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.012482 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:01.012433    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-serving-cert: secret "maas-api-e2e-api-b-cf8dad-serving-cert" not found
Jul 09 15:30:01.012670 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:01.012496    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls podName:30b7e949-a591-4050-a9e8-b0e373155714 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.512472688 +0000 UTC m=+2078.203885459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls") pod "maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" (UID: "30b7e949-a591-4050-a9e8-b0e373155714") : secret "maas-api-e2e-api-b-cf8dad-serving-cert" not found
Jul 09 15:30:01.013048 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.013029    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.045823 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.045794    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fczd\" (UniqueName: \"kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.511257 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.511216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" event={"ID":"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe","Type":"ContainerStarted","Data":"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"}
Jul 09 15:30:01.511467 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.511318    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" event={"ID":"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe","Type":"ContainerStarted","Data":"a98f4cef34cbdd95b3b721ef949a6789c9fd7663cbd60663527e8ae0a24a303e"}
Jul 09 15:30:01.512795 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.512766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" event={"ID":"79008d49-f2c0-4002-a0fb-4a75763d068a","Type":"ContainerStarted","Data":"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"}
Jul 09 15:30:01.512898 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.512812    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" event={"ID":"79008d49-f2c0-4002-a0fb-4a75763d068a","Type":"ContainerStarted","Data":"5c517a8dd68139d838f55fb1fcf5f3869c2a949e90cffa68d0719b42ad842499"}
Jul 09 15:30:01.517496 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.517465    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.519796 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.519775    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") pod \"maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.529349 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.529312    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" podStartSLOduration=1.529299016 podStartE2EDuration="1.529299016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.528068645 +0000 UTC m=+2078.219481468" watchObservedRunningTime="2026-07-09 15:30:01.529299016 +0000 UTC m=+2078.220711797"
Jul 09 15:30:01.545188 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.545145    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" podStartSLOduration=1.545132398 podStartE2EDuration="1.545132398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.543365858 +0000 UTC m=+2078.234778652" watchObservedRunningTime="2026-07-09 15:30:01.545132398 +0000 UTC m=+2078.236545178"
Jul 09 15:30:01.690861 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.690831    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:01.824006 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:01.823983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:01.825905 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:30:01.825875    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b7e949_a591_4050_a9e8_b0e373155714.slice/crio-126a144c4ba2666971c1b58999747bf1312a6e83f410a208ca16f66901fa34fd WatchSource:0}: Error finding container 126a144c4ba2666971c1b58999747bf1312a6e83f410a208ca16f66901fa34fd: Status 404 returned error can't find the container with id 126a144c4ba2666971c1b58999747bf1312a6e83f410a208ca16f66901fa34fd
Jul 09 15:30:02.521333 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:02.521237    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" event={"ID":"30b7e949-a591-4050-a9e8-b0e373155714","Type":"ContainerStarted","Data":"aa53707b45969d3383d1e63d85cba1aa7fbc33f5ddf20f5cdaa3a9868b55e9ab"}
Jul 09 15:30:02.521333 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:02.521312    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" event={"ID":"30b7e949-a591-4050-a9e8-b0e373155714","Type":"ContainerStarted","Data":"126a144c4ba2666971c1b58999747bf1312a6e83f410a208ca16f66901fa34fd"}
Jul 09 15:30:02.546182 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:02.546129    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" podStartSLOduration=2.19630472 podStartE2EDuration="2.546113591s" totalImagesPullingTime="349.808871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:02.544588487 +0000 UTC m=+2079.236001287" watchObservedRunningTime="2026-07-09 15:30:02.546113591 +0000 UTC m=+2079.237526370"
Jul 09 15:30:03.525985 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:03.525957    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:09.538383 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:09.538327    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:13.769597 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:13.769561    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:30:13.770038 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:13.769772    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" podUID="a9086891-9fb9-4469-b615-ba53fdae8cf7" containerName="maas-api" containerID="cri-o://15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816" gracePeriod=30
Jul 09 15:30:13.793369 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:13.793342    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:13.793634 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:13.793603    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" podUID="79008d49-f2c0-4002-a0fb-4a75763d068a" containerName="cleanup" containerID="cri-o://bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89" gracePeriod=30
Jul 09 15:30:14.012534 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.012494    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:30:14.022062 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.021992    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca\") pod \"a9086891-9fb9-4469-b615-ba53fdae8cf7\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") "
Jul 09 15:30:14.022192 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.022118    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdtpv\" (UniqueName: \"kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv\") pod \"a9086891-9fb9-4469-b615-ba53fdae8cf7\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") "
Jul 09 15:30:14.022192 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.022148    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls\") pod \"a9086891-9fb9-4469-b615-ba53fdae8cf7\" (UID: \"a9086891-9fb9-4469-b615-ba53fdae8cf7\") "
Jul 09 15:30:14.022321 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.022300    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9086891-9fb9-4469-b615-ba53fdae8cf7" (UID: "a9086891-9fb9-4469-b615-ba53fdae8cf7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:30:14.024089 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.024068    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9086891-9fb9-4469-b615-ba53fdae8cf7" (UID: "a9086891-9fb9-4469-b615-ba53fdae8cf7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:30:14.024236 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.024217    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv" (OuterVolumeSpecName: "kube-api-access-bdtpv") pod "a9086891-9fb9-4469-b615-ba53fdae8cf7" (UID: "a9086891-9fb9-4469-b615-ba53fdae8cf7"). InnerVolumeSpecName "kube-api-access-bdtpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:14.123129 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.123098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdtpv\" (UniqueName: \"kubernetes.io/projected/a9086891-9fb9-4469-b615-ba53fdae8cf7-kube-api-access-bdtpv\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:14.123129 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.123128    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9086891-9fb9-4469-b615-ba53fdae8cf7-maas-api-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:14.123129 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.123137    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9086891-9fb9-4469-b615-ba53fdae8cf7-openshift-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:14.581069 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.581032    2573 generic.go:356] "Generic (PLEG): container finished" podID="a9086891-9fb9-4469-b615-ba53fdae8cf7" containerID="15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816" exitCode=0
Jul 09 15:30:14.581258 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.581080    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"
Jul 09 15:30:14.581258 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.581116    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" event={"ID":"a9086891-9fb9-4469-b615-ba53fdae8cf7","Type":"ContainerDied","Data":"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"}
Jul 09 15:30:14.581258 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.581171    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg" event={"ID":"a9086891-9fb9-4469-b615-ba53fdae8cf7","Type":"ContainerDied","Data":"6ed9c288060c6a8b5249d4ffc29eb9161be32bde3498cf5dfb30c220874dab23"}
Jul 09 15:30:14.581258 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.581199    2573 scope.go:117] "RemoveContainer" containerID="15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"
Jul 09 15:30:14.591180 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.591161    2573 scope.go:117] "RemoveContainer" containerID="15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"
Jul 09 15:30:14.591437 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:14.591417    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816\": container with ID starting with 15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816 not found: ID does not exist" containerID="15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"
Jul 09 15:30:14.591485 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.591447    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816"} err="failed to get container status \"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816\": rpc error: code = NotFound desc = could not find container \"15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816\": container with ID starting with 15d8ce5279aab596c611a73e857ccbfa68195704710cd611a96f1fe45aed9816 not found: ID does not exist"
Jul 09 15:30:14.606993 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.606966    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:30:14.612754 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:14.612730    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-88802e-68f8978dff-gtfxg"]
Jul 09 15:30:15.909625 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:15.909593    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9086891-9fb9-4469-b615-ba53fdae8cf7" path="/var/lib/kubelet/pods/a9086891-9fb9-4469-b615-ba53fdae8cf7/volumes"
Jul 09 15:30:22.459024 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.458990    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:22.459470 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.459192    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" podUID="30b7e949-a591-4050-a9e8-b0e373155714" containerName="maas-api" containerID="cri-o://aa53707b45969d3383d1e63d85cba1aa7fbc33f5ddf20f5cdaa3a9868b55e9ab" gracePeriod=30
Jul 09 15:30:22.622619 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.622578    2573 generic.go:356] "Generic (PLEG): container finished" podID="30b7e949-a591-4050-a9e8-b0e373155714" containerID="aa53707b45969d3383d1e63d85cba1aa7fbc33f5ddf20f5cdaa3a9868b55e9ab" exitCode=0
Jul 09 15:30:22.622809 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.622630    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" event={"ID":"30b7e949-a591-4050-a9e8-b0e373155714","Type":"ContainerDied","Data":"aa53707b45969d3383d1e63d85cba1aa7fbc33f5ddf20f5cdaa3a9868b55e9ab"}
Jul 09 15:30:22.720005 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.719950    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:22.790614 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.790580    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fczd\" (UniqueName: \"kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd\") pod \"30b7e949-a591-4050-a9e8-b0e373155714\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") "
Jul 09 15:30:22.790614 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.790616    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") pod \"30b7e949-a591-4050-a9e8-b0e373155714\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") "
Jul 09 15:30:22.790817 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.790663    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca\") pod \"30b7e949-a591-4050-a9e8-b0e373155714\" (UID: \"30b7e949-a591-4050-a9e8-b0e373155714\") "
Jul 09 15:30:22.791063 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.791020    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "30b7e949-a591-4050-a9e8-b0e373155714" (UID: "30b7e949-a591-4050-a9e8-b0e373155714"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:30:22.792693 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.792668    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "30b7e949-a591-4050-a9e8-b0e373155714" (UID: "30b7e949-a591-4050-a9e8-b0e373155714"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:30:22.792782 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.792720    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd" (OuterVolumeSpecName: "kube-api-access-7fczd") pod "30b7e949-a591-4050-a9e8-b0e373155714" (UID: "30b7e949-a591-4050-a9e8-b0e373155714"). InnerVolumeSpecName "kube-api-access-7fczd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:22.891926 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.891893    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b7e949-a591-4050-a9e8-b0e373155714-openshift-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:22.891926 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.891920    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fczd\" (UniqueName: \"kubernetes.io/projected/30b7e949-a591-4050-a9e8-b0e373155714-kube-api-access-7fczd\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:22.891926 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:22.891930    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30b7e949-a591-4050-a9e8-b0e373155714-maas-api-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:23.629336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.629305    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"
Jul 09 15:30:23.629336 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.629326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c" event={"ID":"30b7e949-a591-4050-a9e8-b0e373155714","Type":"ContainerDied","Data":"126a144c4ba2666971c1b58999747bf1312a6e83f410a208ca16f66901fa34fd"}
Jul 09 15:30:23.629893 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.629381    2573 scope.go:117] "RemoveContainer" containerID="aa53707b45969d3383d1e63d85cba1aa7fbc33f5ddf20f5cdaa3a9868b55e9ab"
Jul 09 15:30:23.653699 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.653672    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:23.662246 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.662222    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cf8dad-7cb7d85fc-dcq2c"]
Jul 09 15:30:23.904425 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.904398    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:30:23.908981 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.908956    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:30:23.909642 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.909621    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:30:23.909995 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.909972    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b7e949-a591-4050-a9e8-b0e373155714" path="/var/lib/kubelet/pods/30b7e949-a591-4050-a9e8-b0e373155714/volumes"
Jul 09 15:30:23.913932 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:23.913917    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:30:33.172647 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.172610    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.172998    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b7e949-a591-4050-a9e8-b0e373155714" containerName="maas-api"
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.173009    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b7e949-a591-4050-a9e8-b0e373155714" containerName="maas-api"
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.173023    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9086891-9fb9-4469-b615-ba53fdae8cf7" containerName="maas-api"
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.173029    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9086891-9fb9-4469-b615-ba53fdae8cf7" containerName="maas-api"
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.173091    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b7e949-a591-4050-a9e8-b0e373155714" containerName="maas-api"
Jul 09 15:30:33.173107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.173102    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9086891-9fb9-4469-b615-ba53fdae8cf7" containerName="maas-api"
Jul 09 15:30:33.176205 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.176189    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.181107 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.181085    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-bf561e-serving-cert\""
Jul 09 15:30:33.187841 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.187821    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:30:33.285662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.285621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s554\" (UniqueName: \"kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.285843 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.285669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.285843 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.285823    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.386290 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.386250    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.386460 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.386295    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s554\" (UniqueName: \"kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.386460 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.386423    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.386641 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:33.386549    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-serving-cert: secret "maas-api-e2e-shared-a-bf561e-serving-cert" not found
Jul 09 15:30:33.386641 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:33.386604    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls podName:6ccc6033-a60f-44b8-9a36-7435caa1fc06 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:33.886588614 +0000 UTC m=+2110.578001372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls") pod "maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" (UID: "6ccc6033-a60f-44b8-9a36-7435caa1fc06") : secret "maas-api-e2e-shared-a-bf561e-serving-cert" not found
Jul 09 15:30:33.386926 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.386908    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.397300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.397274    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s554\" (UniqueName: \"kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.891396 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.891357    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:33.893828 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:33.893807    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") pod \"maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:34.086241 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:34.086212    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:34.217118 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:34.217090    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:30:34.219909 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:30:34.219878    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ccc6033_a60f_44b8_9a36_7435caa1fc06.slice/crio-a2c50e872ea69198845121513b1759d8f364bcf526b0ed79ffc4486e89176bd3 WatchSource:0}: Error finding container a2c50e872ea69198845121513b1759d8f364bcf526b0ed79ffc4486e89176bd3: Status 404 returned error can't find the container with id a2c50e872ea69198845121513b1759d8f364bcf526b0ed79ffc4486e89176bd3
Jul 09 15:30:34.682650 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:34.682615    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" event={"ID":"6ccc6033-a60f-44b8-9a36-7435caa1fc06","Type":"ContainerStarted","Data":"a2c50e872ea69198845121513b1759d8f364bcf526b0ed79ffc4486e89176bd3"}
Jul 09 15:30:35.689173 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:35.689137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" event={"ID":"6ccc6033-a60f-44b8-9a36-7435caa1fc06","Type":"ContainerStarted","Data":"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"}
Jul 09 15:30:35.689646 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:35.689221    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:35.711979 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:35.711925    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" podStartSLOduration=1.9939600560000001 podStartE2EDuration="2.711910299s" totalImagesPullingTime="717.950243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:35.709441968 +0000 UTC m=+2112.400854761" watchObservedRunningTime="2026-07-09 15:30:35.711910299 +0000 UTC m=+2112.403323079"
Jul 09 15:30:41.699196 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:41.699165    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:30:41.974122 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:41.974037    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:30:41.977659 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:41.977640    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:41.981524 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:41.981493    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-497419-serving-cert\""
Jul 09 15:30:41.997058 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:41.997032    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:30:42.065252 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.065208    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hbql\" (UniqueName: \"kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.065444 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.065331    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.065444 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.065360    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.166735 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.166688    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hbql\" (UniqueName: \"kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.166890 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.166782    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.166890 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.166801    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.166986 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:42.166925    2573 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-serving-cert: secret "maas-api-e2e-shared-b-497419-serving-cert" not found
Jul 09 15:30:42.167019 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:42.166991    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls podName:e2377bbc-38e9-4ff0-8fcd-1c410e732107 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:42.666971971 +0000 UTC m=+2119.358384728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls") pod "maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" (UID: "e2377bbc-38e9-4ff0-8fcd-1c410e732107") : secret "maas-api-e2e-shared-b-497419-serving-cert" not found
Jul 09 15:30:42.167398 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.167380    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.182931 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.182899    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hbql\" (UniqueName: \"kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.672231 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.672184    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.674615 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.674588    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") pod \"maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:42.887566 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:42.887502    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:43.022479 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:43.022455    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:30:43.024361 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:30:43.024333    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2377bbc_38e9_4ff0_8fcd_1c410e732107.slice/crio-c0ce012644a52f97c04d17c0012fcff21a54786b8f21d438131d86a8f0a1f18a WatchSource:0}: Error finding container c0ce012644a52f97c04d17c0012fcff21a54786b8f21d438131d86a8f0a1f18a: Status 404 returned error can't find the container with id c0ce012644a52f97c04d17c0012fcff21a54786b8f21d438131d86a8f0a1f18a
Jul 09 15:30:43.728257 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:43.728228    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" event={"ID":"e2377bbc-38e9-4ff0-8fcd-1c410e732107","Type":"ContainerStarted","Data":"c0ce012644a52f97c04d17c0012fcff21a54786b8f21d438131d86a8f0a1f18a"}
Jul 09 15:30:43.993902 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:43.993815    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:44.084324 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.084292    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b67pd\" (UniqueName: \"kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd\") pod \"79008d49-f2c0-4002-a0fb-4a75763d068a\" (UID: \"79008d49-f2c0-4002-a0fb-4a75763d068a\") "
Jul 09 15:30:44.086331 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.086303    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd" (OuterVolumeSpecName: "kube-api-access-b67pd") pod "79008d49-f2c0-4002-a0fb-4a75763d068a" (UID: "79008d49-f2c0-4002-a0fb-4a75763d068a"). InnerVolumeSpecName "kube-api-access-b67pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:44.185311 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.185254    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b67pd\" (UniqueName: \"kubernetes.io/projected/79008d49-f2c0-4002-a0fb-4a75763d068a-kube-api-access-b67pd\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:30:44.735036 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.734990    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" event={"ID":"e2377bbc-38e9-4ff0-8fcd-1c410e732107","Type":"ContainerStarted","Data":"21d8e27e0e7ac56d7a6656ceff6affc1ab44f837f711a3971381f6e84aac266b"}
Jul 09 15:30:44.735236 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.735049    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:30:44.736206 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.736173    2573 generic.go:356] "Generic (PLEG): container finished" podID="79008d49-f2c0-4002-a0fb-4a75763d068a" containerID="bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89" exitCode=137
Jul 09 15:30:44.736273 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.736206    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"
Jul 09 15:30:44.736273 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.736222    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" event={"ID":"79008d49-f2c0-4002-a0fb-4a75763d068a","Type":"ContainerDied","Data":"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"}
Jul 09 15:30:44.736273 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.736265    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc" event={"ID":"79008d49-f2c0-4002-a0fb-4a75763d068a","Type":"ContainerDied","Data":"5c517a8dd68139d838f55fb1fcf5f3869c2a949e90cffa68d0719b42ad842499"}
Jul 09 15:30:44.736385 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.736289    2573 scope.go:117] "RemoveContainer" containerID="bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"
Jul 09 15:30:44.745002 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.744984    2573 scope.go:117] "RemoveContainer" containerID="bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"
Jul 09 15:30:44.745281 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:30:44.745260    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89\": container with ID starting with bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89 not found: ID does not exist" containerID="bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"
Jul 09 15:30:44.745378 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.745287    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89"} err="failed to get container status \"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89\": rpc error: code = NotFound desc = could not find container \"bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89\": container with ID starting with bd0da8d2825169663376ec3b5eadf99cab35f696f832b1ba15c83386ed2d9e89 not found: ID does not exist"
Jul 09 15:30:44.754904 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.754858    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" podStartSLOduration=3.052564114 podStartE2EDuration="3.754831478s" totalImagesPullingTime="702.267364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:44.753844139 +0000 UTC m=+2121.445256919" watchObservedRunningTime="2026-07-09 15:30:44.754831478 +0000 UTC m=+2121.446244257"
Jul 09 15:30:44.769370 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.769328    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:44.771074 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:44.771052    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-88802e-29726850-sgtqc"]
Jul 09 15:30:45.909131 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:45.909098    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79008d49-f2c0-4002-a0fb-4a75763d068a" path="/var/lib/kubelet/pods/79008d49-f2c0-4002-a0fb-4a75763d068a/volumes"
Jul 09 15:30:50.747876 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:30:50.747848    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:31:00.013060 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.013022    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:31:00.013504 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.013216    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" podUID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" containerName="cleanup" containerID="cri-o://946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132" gracePeriod=30
Jul 09 15:31:00.981165 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.981125    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:31:00.981647 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.981630    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79008d49-f2c0-4002-a0fb-4a75763d068a" containerName="cleanup"
Jul 09 15:31:00.981728 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.981649    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="79008d49-f2c0-4002-a0fb-4a75763d068a" containerName="cleanup"
Jul 09 15:31:00.981728 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.981718    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="79008d49-f2c0-4002-a0fb-4a75763d068a" containerName="cleanup"
Jul 09 15:31:00.984496 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.984476    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:00.988910 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.988884    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"kube-root-ca.crt\""
Jul 09 15:31:00.989091 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.988909    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"default-dockercfg-9xd5k\""
Jul 09 15:31:00.989091 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.988883    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"auth-test-model-bf561e-kserve-self-signed-certs\""
Jul 09 15:31:00.989091 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.988883    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bf561e\"/\"openshift-service-ca.crt\""
Jul 09 15:31:00.995268 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:00.995245    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:31:01.146247 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.146662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146264    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.146662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146353    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.146662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvw7n\" (UniqueName: \"kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.146662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.146662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.146448    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.246967 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.246876    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.246967 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.246917    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.246967 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.246948    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247241 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.246991    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247241 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.247058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247241 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.247104    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvw7n\" (UniqueName: \"kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247405 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.247331    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247405 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.247366    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.247506 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.247413    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.249327 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.249306    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.249579 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.249559    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.256618 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.256594    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvw7n\" (UniqueName: \"kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n\") pod \"auth-test-model-bf561e-kserve-7449689f-2w4vr\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") " pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.295197 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.295156    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:01.451651 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.451623    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:31:01.453888 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:31:01.453864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5be59b99_faeb_480e_9e55_a9760545db9f.slice/crio-a04f16ca6ac923dc6733d07326bb3f9eaebec8e6ac8de86bb8ed50ff814a67aa WatchSource:0}: Error finding container a04f16ca6ac923dc6733d07326bb3f9eaebec8e6ac8de86bb8ed50ff814a67aa: Status 404 returned error can't find the container with id a04f16ca6ac923dc6733d07326bb3f9eaebec8e6ac8de86bb8ed50ff814a67aa
Jul 09 15:31:01.821694 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.821598    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" event={"ID":"5be59b99-faeb-480e-9e55-a9760545db9f","Type":"ContainerStarted","Data":"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"}
Jul 09 15:31:01.821694 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.821652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" event={"ID":"5be59b99-faeb-480e-9e55-a9760545db9f","Type":"ContainerStarted","Data":"a04f16ca6ac923dc6733d07326bb3f9eaebec8e6ac8de86bb8ed50ff814a67aa"}
Jul 09 15:31:01.843088 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:01.843030    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" podStartSLOduration=1.8430130230000001 podStartE2EDuration="1.843013023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:01.840998998 +0000 UTC m=+2138.532411780" watchObservedRunningTime="2026-07-09 15:31:01.843013023 +0000 UTC m=+2138.534425802"
Jul 09 15:31:11.295501 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:11.295451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:11.296036 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:11.295541    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:11.308381 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:11.308348    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:11.881851 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:11.881824    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:31:30.192311 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.192285    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:31:30.318443 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.318356    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v8jp\" (UniqueName: \"kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp\") pod \"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe\" (UID: \"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe\") "
Jul 09 15:31:30.320475 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.320450    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp" (OuterVolumeSpecName: "kube-api-access-4v8jp") pod "ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" (UID: "ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe"). InnerVolumeSpecName "kube-api-access-4v8jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:31:30.419621 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.419583    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v8jp\" (UniqueName: \"kubernetes.io/projected/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe-kube-api-access-4v8jp\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:31:30.966230 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.966191    2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" containerID="946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132" exitCode=137
Jul 09 15:31:30.966414 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.966235    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"
Jul 09 15:31:30.966414 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.966261    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" event={"ID":"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe","Type":"ContainerDied","Data":"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"}
Jul 09 15:31:30.966414 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.966305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6" event={"ID":"ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe","Type":"ContainerDied","Data":"a98f4cef34cbdd95b3b721ef949a6789c9fd7663cbd60663527e8ae0a24a303e"}
Jul 09 15:31:30.966414 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.966327    2573 scope.go:117] "RemoveContainer" containerID="946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"
Jul 09 15:31:30.974959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.974938    2573 scope.go:117] "RemoveContainer" containerID="946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"
Jul 09 15:31:30.975236 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:31:30.975217    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132\": container with ID starting with 946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132 not found: ID does not exist" containerID="946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"
Jul 09 15:31:30.975281 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.975246    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132"} err="failed to get container status \"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132\": rpc error: code = NotFound desc = could not find container \"946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132\": container with ID starting with 946f524b993237e7444acc02a75baba0140a5df322e515fff8d50f47c8690132 not found: ID does not exist"
Jul 09 15:31:30.990138 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.990111    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:31:30.994751 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:30.994726    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726850-zc7g6"]
Jul 09 15:31:31.909793 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:31.909760    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" path="/var/lib/kubelet/pods/ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe/volumes"
Jul 09 15:31:35.080829 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.080797    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:31:35.081206 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.081189    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" containerName="cleanup"
Jul 09 15:31:35.081206 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.081199    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" containerName="cleanup"
Jul 09 15:31:35.081278 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.081259    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa8faab-1ac5-4273-b06f-59d2b4ec6ebe" containerName="cleanup"
Jul 09 15:31:35.085561 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.085540    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.090012 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.089992    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"kube-root-ca.crt\""
Jul 09 15:31:35.091380 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.091357    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"default-dockercfg-p6rjm\""
Jul 09 15:31:35.091380 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.091361    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"auth-test-model-497419-kserve-self-signed-certs\""
Jul 09 15:31:35.091617 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.091391    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"openshift-service-ca.crt\""
Jul 09 15:31:35.098900 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.098868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:31:35.162359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162320    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.162359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.162672 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162452    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.162672 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162475    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.162672 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162609    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.162672 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.162655    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpkxl\" (UniqueName: \"kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264018 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.263983    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264018 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264020    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpkxl\" (UniqueName: \"kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264163    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264306 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264211    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264426 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264310    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264426 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264348    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264565 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264507    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264630 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264563    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.264691 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.264665    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.266378 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.266355    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.266720 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.266702    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.274156 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.274137    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpkxl\" (UniqueName: \"kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl\") pod \"auth-test-model-497419-kserve-787bc664cf-57qpf\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") " pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.394228 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.394198    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:35.545280 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.545246    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:31:35.549009 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:31:35.548982    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15c31bbc_2259_4877_9107_ef52ad1dfb2a.slice/crio-51088972f063e1b3e53f3b2afd169e528f145a15c8240096c484dfdc8d57558e WatchSource:0}: Error finding container 51088972f063e1b3e53f3b2afd169e528f145a15c8240096c484dfdc8d57558e: Status 404 returned error can't find the container with id 51088972f063e1b3e53f3b2afd169e528f145a15c8240096c484dfdc8d57558e
Jul 09 15:31:35.992912 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.992878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" event={"ID":"15c31bbc-2259-4877-9107-ef52ad1dfb2a","Type":"ContainerStarted","Data":"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"}
Jul 09 15:31:35.993106 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:35.992923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" event={"ID":"15c31bbc-2259-4877-9107-ef52ad1dfb2a","Type":"ContainerStarted","Data":"51088972f063e1b3e53f3b2afd169e528f145a15c8240096c484dfdc8d57558e"}
Jul 09 15:31:36.019755 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:36.019697    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" podStartSLOduration=1.019682349 podStartE2EDuration="1.019682349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:36.017559935 +0000 UTC m=+2172.708972716" watchObservedRunningTime="2026-07-09 15:31:36.019682349 +0000 UTC m=+2172.711095129"
Jul 09 15:31:45.394776 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:45.394742    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:45.395281 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:45.394806    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:45.407658 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:45.407623    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:31:46.053246 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:31:46.053209    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:33:38.666662 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:38.666627    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:33:39.670016 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:39.669984    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:33:53.686767 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.686728    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" podUID="5be59b99-faeb-480e-9e55-a9760545db9f" containerName="main" containerID="cri-o://e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e" gracePeriod=45
Jul 09 15:33:53.944310 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.944250    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:33:53.997339 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997306    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997509 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997411    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvw7n\" (UniqueName: \"kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997509 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997441    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997509 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997458    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997509 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997496    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997727 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997537    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm\") pod \"5be59b99-faeb-480e-9e55-a9760545db9f\" (UID: \"5be59b99-faeb-480e-9e55-a9760545db9f\") "
Jul 09 15:33:53.997727 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997659    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache" (OuterVolumeSpecName: "model-cache") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:53.997801 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997778    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:53.997837 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997793    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home" (OuterVolumeSpecName: "home") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:53.997877 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.997834    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:53.999873 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.999846    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:33:53.999991 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.999916    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm" (OuterVolumeSpecName: "dshm") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:53.999991 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:53.999927    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n" (OuterVolumeSpecName: "kube-api-access-kvw7n") pod "5be59b99-faeb-480e-9e55-a9760545db9f" (UID: "5be59b99-faeb-480e-9e55-a9760545db9f"). InnerVolumeSpecName "kube-api-access-kvw7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:33:54.099146 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.099116    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:54.099146 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.099144    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:54.099146 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.099154    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvw7n\" (UniqueName: \"kubernetes.io/projected/5be59b99-faeb-480e-9e55-a9760545db9f-kube-api-access-kvw7n\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:54.099389 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.099164    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5be59b99-faeb-480e-9e55-a9760545db9f-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:54.099389 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.099175    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5be59b99-faeb-480e-9e55-a9760545db9f-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:54.671128 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.671089    2573 generic.go:356] "Generic (PLEG): container finished" podID="5be59b99-faeb-480e-9e55-a9760545db9f" containerID="e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e" exitCode=0
Jul 09 15:33:54.671300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.671144    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"
Jul 09 15:33:54.671300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.671178    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" event={"ID":"5be59b99-faeb-480e-9e55-a9760545db9f","Type":"ContainerDied","Data":"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"}
Jul 09 15:33:54.671300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.671216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr" event={"ID":"5be59b99-faeb-480e-9e55-a9760545db9f","Type":"ContainerDied","Data":"a04f16ca6ac923dc6733d07326bb3f9eaebec8e6ac8de86bb8ed50ff814a67aa"}
Jul 09 15:33:54.671300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.671233    2573 scope.go:117] "RemoveContainer" containerID="e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"
Jul 09 15:33:54.680867 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.680847    2573 scope.go:117] "RemoveContainer" containerID="e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"
Jul 09 15:33:54.681106 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:33:54.681086    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e\": container with ID starting with e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e not found: ID does not exist" containerID="e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"
Jul 09 15:33:54.681149 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.681116    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e"} err="failed to get container status \"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e\": rpc error: code = NotFound desc = could not find container \"e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e\": container with ID starting with e0b0130a064e90998134fe36b615710d3b83e50f68b44b6cdbc334a84d263b7e not found: ID does not exist"
Jul 09 15:33:54.690057 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.690031    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" podUID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" containerName="main" containerID="cri-o://6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b" gracePeriod=45
Jul 09 15:33:54.694204 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.694182    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:33:54.701781 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.701754    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bf561e/auth-test-model-bf561e-kserve-7449689f-2w4vr"]
Jul 09 15:33:54.941855 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:54.941827    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:33:55.007820 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.007779    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.007866    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.007896    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.007948    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.007973    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpkxl\" (UniqueName: \"kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008014 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008015    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir\") pod \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\" (UID: \"15c31bbc-2259-4877-9107-ef52ad1dfb2a\") "
Jul 09 15:33:55.008296 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008038    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home" (OuterVolumeSpecName: "home") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:55.008296 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008124    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache" (OuterVolumeSpecName: "model-cache") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:55.008296 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008283    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:55.008446 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008349    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.008446 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008382    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.008446 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.008390    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.010224 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.010200    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:33:55.010328 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.010236    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm" (OuterVolumeSpecName: "dshm") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:33:55.010328 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.010260    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl" (OuterVolumeSpecName: "kube-api-access-zpkxl") pod "15c31bbc-2259-4877-9107-ef52ad1dfb2a" (UID: "15c31bbc-2259-4877-9107-ef52ad1dfb2a"). InnerVolumeSpecName "kube-api-access-zpkxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:33:55.109836 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.109783    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/15c31bbc-2259-4877-9107-ef52ad1dfb2a-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.109836 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.109831    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/15c31bbc-2259-4877-9107-ef52ad1dfb2a-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.109836 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.109844    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpkxl\" (UniqueName: \"kubernetes.io/projected/15c31bbc-2259-4877-9107-ef52ad1dfb2a-kube-api-access-zpkxl\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:33:55.677580 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.677546    2573 generic.go:356] "Generic (PLEG): container finished" podID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" containerID="6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b" exitCode=0
Jul 09 15:33:55.677769 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.677587    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"
Jul 09 15:33:55.677769 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.677626    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" event={"ID":"15c31bbc-2259-4877-9107-ef52ad1dfb2a","Type":"ContainerDied","Data":"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"}
Jul 09 15:33:55.677769 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.677670    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf" event={"ID":"15c31bbc-2259-4877-9107-ef52ad1dfb2a","Type":"ContainerDied","Data":"51088972f063e1b3e53f3b2afd169e528f145a15c8240096c484dfdc8d57558e"}
Jul 09 15:33:55.677769 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.677693    2573 scope.go:117] "RemoveContainer" containerID="6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"
Jul 09 15:33:55.686927 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.686901    2573 scope.go:117] "RemoveContainer" containerID="6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"
Jul 09 15:33:55.687193 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:33:55.687172    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b\": container with ID starting with 6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b not found: ID does not exist" containerID="6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"
Jul 09 15:33:55.687250 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.687199    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b"} err="failed to get container status \"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b\": rpc error: code = NotFound desc = could not find container \"6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b\": container with ID starting with 6ada8e30c4996803dab39fc8fc7dd18fa22ede7982cf8e4906d4ac57faeafd4b not found: ID does not exist"
Jul 09 15:33:55.702140 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.702103    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:33:55.704477 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.704446    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-497419/auth-test-model-497419-kserve-787bc664cf-57qpf"]
Jul 09 15:33:55.908578 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.908543    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" path="/var/lib/kubelet/pods/15c31bbc-2259-4877-9107-ef52ad1dfb2a/volumes"
Jul 09 15:33:55.908949 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:33:55.908936    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5be59b99-faeb-480e-9e55-a9760545db9f" path="/var/lib/kubelet/pods/5be59b99-faeb-480e-9e55-a9760545db9f/volumes"
Jul 09 15:34:30.781845 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.781809    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782201    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" containerName="main"
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782212    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" containerName="main"
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782235    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be59b99-faeb-480e-9e55-a9760545db9f" containerName="main"
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782241    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be59b99-faeb-480e-9e55-a9760545db9f" containerName="main"
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782294    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5be59b99-faeb-480e-9e55-a9760545db9f" containerName="main"
Jul 09 15:34:30.782300 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.782303    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c31bbc-2259-4877-9107-ef52ad1dfb2a" containerName="main"
Jul 09 15:34:30.785378 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.785362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.789725 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.789699    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"sub-test-model-497419-kserve-self-signed-certs\""
Jul 09 15:34:30.789852 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.789699    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"kube-root-ca.crt\""
Jul 09 15:34:30.789852 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.789739    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"default-dockercfg-p6rjm\""
Jul 09 15:34:30.789852 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.789794    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"openshift-service-ca.crt\""
Jul 09 15:34:30.798288 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.798268    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:34:30.842264 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.842264 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842263    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgdlc\" (UniqueName: \"kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.842508 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.842508 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842298    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.842508 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842391    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.842508 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.842445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943431 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943400    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943652 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943480    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943652 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943502    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgdlc\" (UniqueName: \"kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943652 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943551    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943846 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943695    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943846 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943788    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943906    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.943959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.943932    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.944165 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.944147    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.945907 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.945887    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.946063 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.946047    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:30.952471 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:30.952448    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgdlc\" (UniqueName: \"kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc\") pod \"sub-test-model-497419-kserve-9f46d488c-8bgw4\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") " pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:31.094922 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:31.094841    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:31.235219 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:31.235192    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:34:31.237331 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:34:31.237302    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55a34e77_24c5_41b3_a6df_ecc998b430ff.slice/crio-ecd097541219150f28d41f1e4cbd48ef0d55175caebdf36e0a452a0c9d487011 WatchSource:0}: Error finding container ecd097541219150f28d41f1e4cbd48ef0d55175caebdf36e0a452a0c9d487011: Status 404 returned error can't find the container with id ecd097541219150f28d41f1e4cbd48ef0d55175caebdf36e0a452a0c9d487011
Jul 09 15:34:31.858497 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:31.858453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" event={"ID":"55a34e77-24c5-41b3-a6df-ecc998b430ff","Type":"ContainerStarted","Data":"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"}
Jul 09 15:34:31.858497 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:31.858506    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" event={"ID":"55a34e77-24c5-41b3-a6df-ecc998b430ff","Type":"ContainerStarted","Data":"ecd097541219150f28d41f1e4cbd48ef0d55175caebdf36e0a452a0c9d487011"}
Jul 09 15:34:31.883766 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:31.883715    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" podStartSLOduration=1.883698065 podStartE2EDuration="1.883698065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:31.883183236 +0000 UTC m=+2348.574596041" watchObservedRunningTime="2026-07-09 15:34:31.883698065 +0000 UTC m=+2348.575110846"
Jul 09 15:34:41.095043 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:41.095008    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:41.095447 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:41.095058    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:41.107863 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:41.107839    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:34:41.922752 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:34:41.922724    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:35:14.072592 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:14.071874    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:35:23.941069 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:23.941038    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:35:23.945921 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:23.945899    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:35:23.947194 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:23.947175    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:35:23.951799 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:23.951780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xqv5q_d68174b9-e26b-4000-a7c5-ac99aff8fbf0/ovn-acl-logging/0.log"
Jul 09 15:35:29.094677 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.094638    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" podUID="55a34e77-24c5-41b3-a6df-ecc998b430ff" containerName="main" containerID="cri-o://871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f" gracePeriod=45
Jul 09 15:35:29.343632 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.343605    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:35:29.485368 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485326    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485368 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485675 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485391    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgdlc\" (UniqueName: \"kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485675 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485444    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485675 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485497    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485675 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485560    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir\") pod \"55a34e77-24c5-41b3-a6df-ecc998b430ff\" (UID: \"55a34e77-24c5-41b3-a6df-ecc998b430ff\") "
Jul 09 15:35:29.485877 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485764    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home" (OuterVolumeSpecName: "home") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:29.485877 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485794    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:29.485949 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485890    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.485949 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.485882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:29.487647 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.487628    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:35:29.487768 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.487750    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm" (OuterVolumeSpecName: "dshm") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:35:29.487898 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.487882    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc" (OuterVolumeSpecName: "kube-api-access-tgdlc") pod "55a34e77-24c5-41b3-a6df-ecc998b430ff" (UID: "55a34e77-24c5-41b3-a6df-ecc998b430ff"). InnerVolumeSpecName "kube-api-access-tgdlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:35:29.587255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.587216    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.587255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.587247    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.587255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.587256    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55a34e77-24c5-41b3-a6df-ecc998b430ff-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.587255 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.587264    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55a34e77-24c5-41b3-a6df-ecc998b430ff-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:29.587552 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:29.587274    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgdlc\" (UniqueName: \"kubernetes.io/projected/55a34e77-24c5-41b3-a6df-ecc998b430ff-kube-api-access-tgdlc\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:35:30.149897 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.149860    2573 generic.go:356] "Generic (PLEG): container finished" podID="55a34e77-24c5-41b3-a6df-ecc998b430ff" containerID="871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f" exitCode=0
Jul 09 15:35:30.150301 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.149921    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"
Jul 09 15:35:30.150301 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.149921    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" event={"ID":"55a34e77-24c5-41b3-a6df-ecc998b430ff","Type":"ContainerDied","Data":"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"}
Jul 09 15:35:30.150301 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.150032    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4" event={"ID":"55a34e77-24c5-41b3-a6df-ecc998b430ff","Type":"ContainerDied","Data":"ecd097541219150f28d41f1e4cbd48ef0d55175caebdf36e0a452a0c9d487011"}
Jul 09 15:35:30.150301 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.150050    2573 scope.go:117] "RemoveContainer" containerID="871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"
Jul 09 15:35:30.158961 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.158939    2573 scope.go:117] "RemoveContainer" containerID="871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"
Jul 09 15:35:30.159216 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:35:30.159195    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f\": container with ID starting with 871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f not found: ID does not exist" containerID="871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"
Jul 09 15:35:30.159266 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.159225    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f"} err="failed to get container status \"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f\": rpc error: code = NotFound desc = could not find container \"871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f\": container with ID starting with 871f94c6905dce4115a6260dff4a801d6539699a1992f14b0c2f9204404beb4f not found: ID does not exist"
Jul 09 15:35:30.168568 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.168502    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:35:30.174051 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:30.173975    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-497419/sub-test-model-497419-kserve-9f46d488c-8bgw4"]
Jul 09 15:35:31.909143 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:31.909108    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a34e77-24c5-41b3-a6df-ecc998b430ff" path="/var/lib/kubelet/pods/55a34e77-24c5-41b3-a6df-ecc998b430ff/volumes"
Jul 09 15:35:41.691580 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.691538    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:35:41.691956 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.691933    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a34e77-24c5-41b3-a6df-ecc998b430ff" containerName="main"
Jul 09 15:35:41.691956 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.691944    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a34e77-24c5-41b3-a6df-ecc998b430ff" containerName="main"
Jul 09 15:35:41.692033 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.692017    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a34e77-24c5-41b3-a6df-ecc998b430ff" containerName="main"
Jul 09 15:35:41.696334 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.696310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.699989 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.699965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"default-dockercfg-p6rjm\""
Jul 09 15:35:41.701354 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.701333    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"rate-test-model-497419-kserve-self-signed-certs\""
Jul 09 15:35:41.701485 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.701335    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"openshift-service-ca.crt\""
Jul 09 15:35:41.701485 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.701369    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-497419\"/\"kube-root-ca.crt\""
Jul 09 15:35:41.709682 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.709657    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:35:41.799669 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799630    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.799669 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799667    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.799897 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.799897 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.799897 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.799897 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.799837    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp9mh\" (UniqueName: \"kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900651 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900665    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900692    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp9mh\" (UniqueName: \"kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900733    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900749    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.900826 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.900779    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.901114 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.901077    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.901114 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.901096    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.901211 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.901114    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.903004 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.902977    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.903403 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.903382    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:41.909876 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:41.909852    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp9mh\" (UniqueName: \"kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh\") pod \"rate-test-model-497419-kserve-6954db54c5-rd6fr\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") " pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:42.006149 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:42.006052    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:42.142134 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:42.142107    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:35:42.147386 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:35:42.147354    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02fed090_b317_4cd3_9aae_3afa4acec537.slice/crio-291358774e281310dc6df37d7d22e8d7465f1622406779dddace592af05cdf32 WatchSource:0}: Error finding container 291358774e281310dc6df37d7d22e8d7465f1622406779dddace592af05cdf32: Status 404 returned error can't find the container with id 291358774e281310dc6df37d7d22e8d7465f1622406779dddace592af05cdf32
Jul 09 15:35:42.209442 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:42.209410    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" event={"ID":"02fed090-b317-4cd3-9aae-3afa4acec537","Type":"ContainerStarted","Data":"661aed51f1ea7163b1dfc8aa0be25fbe2d28ba21b6dadf3b8e200f456ba1b978"}
Jul 09 15:35:42.209583 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:42.209453    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" event={"ID":"02fed090-b317-4cd3-9aae-3afa4acec537","Type":"ContainerStarted","Data":"291358774e281310dc6df37d7d22e8d7465f1622406779dddace592af05cdf32"}
Jul 09 15:35:42.231449 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:42.231391    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" podStartSLOduration=1.231368744 podStartE2EDuration="1.231368744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:35:42.229788464 +0000 UTC m=+2418.921201244" watchObservedRunningTime="2026-07-09 15:35:42.231368744 +0000 UTC m=+2418.922781525"
Jul 09 15:35:52.007040 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:52.006994    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:52.007040 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:52.007053    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:52.020051 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:52.020024    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:35:52.269712 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:35:52.269627    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:36:28.315419 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:28.315379    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:36:29.341657 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.341624    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504079282480"]
Jul 09 15:36:29.346536 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.346503    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:29.349373 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.349344    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-nnw6g\""
Jul 09 15:36:29.352870 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.352849    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504079282480"]
Jul 09 15:36:29.438760 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.438724    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpph4\" (UniqueName: \"kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4\") pod \"test-curl-7266-140504079282480\" (UID: \"ffae90a8-5f7b-42dd-9539-8f6e1439cd98\") " pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:29.539356 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.539319    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpph4\" (UniqueName: \"kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4\") pod \"test-curl-7266-140504079282480\" (UID: \"ffae90a8-5f7b-42dd-9539-8f6e1439cd98\") " pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:29.548472 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.548445    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpph4\" (UniqueName: \"kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4\") pod \"test-curl-7266-140504079282480\" (UID: \"ffae90a8-5f7b-42dd-9539-8f6e1439cd98\") " pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:29.656230 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.656196    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:29.791179 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.791151    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504079282480"]
Jul 09 15:36:29.793858 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:36:29.793816    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffae90a8_5f7b_42dd_9539_8f6e1439cd98.slice/crio-31ab39353cb9b2dafb64247d0aa8de4048636bc5ddf2673d810e8d1950cb6891 WatchSource:0}: Error finding container 31ab39353cb9b2dafb64247d0aa8de4048636bc5ddf2673d810e8d1950cb6891: Status 404 returned error can't find the container with id 31ab39353cb9b2dafb64247d0aa8de4048636bc5ddf2673d810e8d1950cb6891
Jul 09 15:36:29.795227 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:29.795208    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:36:30.446795 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:30.446760    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504079282480" event={"ID":"ffae90a8-5f7b-42dd-9539-8f6e1439cd98","Type":"ContainerStarted","Data":"31ab39353cb9b2dafb64247d0aa8de4048636bc5ddf2673d810e8d1950cb6891"}
Jul 09 15:36:31.452717 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:31.452684    2573 generic.go:356] "Generic (PLEG): container finished" podID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" containerID="bc56f4948458f849cff5cde68d95e4e932786dad482efa9a551bf95beac30816" exitCode=0
Jul 09 15:36:31.453105 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:31.452722    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504079282480" event={"ID":"ffae90a8-5f7b-42dd-9539-8f6e1439cd98","Type":"ContainerDied","Data":"bc56f4948458f849cff5cde68d95e4e932786dad482efa9a551bf95beac30816"}
Jul 09 15:36:32.602171 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.602143    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:32.642230 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.642203    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504079282480_ffae90a8-5f7b-42dd-9539-8f6e1439cd98/test-curl-7266-140504079282480/0.log"
Jul 09 15:36:32.666260 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.666224    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504079282480"]
Jul 09 15:36:32.669845 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.669816    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504079282480"]
Jul 09 15:36:32.771159 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.771076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpph4\" (UniqueName: \"kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4\") pod \"ffae90a8-5f7b-42dd-9539-8f6e1439cd98\" (UID: \"ffae90a8-5f7b-42dd-9539-8f6e1439cd98\") "
Jul 09 15:36:32.773277 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.773245    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4" (OuterVolumeSpecName: "kube-api-access-bpph4") pod "ffae90a8-5f7b-42dd-9539-8f6e1439cd98" (UID: "ffae90a8-5f7b-42dd-9539-8f6e1439cd98"). InnerVolumeSpecName "kube-api-access-bpph4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:32.872829 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:32.872785    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpph4\" (UniqueName: \"kubernetes.io/projected/ffae90a8-5f7b-42dd-9539-8f6e1439cd98-kube-api-access-bpph4\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:33.463002 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:33.462973    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:33.463002 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:33.463002    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31ab39353cb9b2dafb64247d0aa8de4048636bc5ddf2673d810e8d1950cb6891"
Jul 09 15:36:33.473298 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:36:33.473264    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7266-140504079282480\" is forbidden: User \"system:node:ip-10-0-133-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-59.ec2.internal' and this object" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:33.909425 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:36:33.909386    2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7266-140504079282480\" is forbidden: User \"system:node:ip-10-0-133-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-59.ec2.internal' and this object" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" pod="openshift-ingress/test-curl-7266-140504079282480"
Jul 09 15:36:33.910368 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:33.910347    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" path="/var/lib/kubelet/pods/ffae90a8-5f7b-42dd-9539-8f6e1439cd98/volumes"
Jul 09 15:36:43.335207 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.335122    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" podUID="02fed090-b317-4cd3-9aae-3afa4acec537" containerName="main" containerID="cri-o://661aed51f1ea7163b1dfc8aa0be25fbe2d28ba21b6dadf3b8e200f456ba1b978" gracePeriod=45
Jul 09 15:36:43.519051 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.519020    2573 generic.go:356] "Generic (PLEG): container finished" podID="02fed090-b317-4cd3-9aae-3afa4acec537" containerID="661aed51f1ea7163b1dfc8aa0be25fbe2d28ba21b6dadf3b8e200f456ba1b978" exitCode=0
Jul 09 15:36:43.519234 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.519091    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" event={"ID":"02fed090-b317-4cd3-9aae-3afa4acec537","Type":"ContainerDied","Data":"661aed51f1ea7163b1dfc8aa0be25fbe2d28ba21b6dadf3b8e200f456ba1b978"}
Jul 09 15:36:43.590459 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.590391    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:36:43.673984 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.673948    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674175 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674012    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674175 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674054    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674175 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674076    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dp9mh\" (UniqueName: \"kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674175 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674104    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674399 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674225    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home\") pod \"02fed090-b317-4cd3-9aae-3afa4acec537\" (UID: \"02fed090-b317-4cd3-9aae-3afa4acec537\") "
Jul 09 15:36:43.674399 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674270    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:36:43.674399 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674371    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache" (OuterVolumeSpecName: "model-cache") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:36:43.674584 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674497    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home" (OuterVolumeSpecName: "home") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:36:43.674584 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674552    2573 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-tmp-dir\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:43.674584 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.674570    2573 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-model-cache\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:43.676220 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.676196    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm" (OuterVolumeSpecName: "dshm") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:36:43.676315 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.676274    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:36:43.676357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.676340    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh" (OuterVolumeSpecName: "kube-api-access-dp9mh") pod "02fed090-b317-4cd3-9aae-3afa4acec537" (UID: "02fed090-b317-4cd3-9aae-3afa4acec537"). InnerVolumeSpecName "kube-api-access-dp9mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:43.775760 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.775716    2573 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-home\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:43.775760 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.775753    2573 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/02fed090-b317-4cd3-9aae-3afa4acec537-dshm\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:43.775760 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.775764    2573 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02fed090-b317-4cd3-9aae-3afa4acec537-tls-certs\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:43.775997 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:43.775777    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dp9mh\" (UniqueName: \"kubernetes.io/projected/02fed090-b317-4cd3-9aae-3afa4acec537-kube-api-access-dp9mh\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:44.526450 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:44.526409    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr" event={"ID":"02fed090-b317-4cd3-9aae-3afa4acec537","Type":"ContainerDied","Data":"291358774e281310dc6df37d7d22e8d7465f1622406779dddace592af05cdf32"}
Jul 09 15:36:44.526450 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:44.526448    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"
Jul 09 15:36:44.526936 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:44.526469    2573 scope.go:117] "RemoveContainer" containerID="661aed51f1ea7163b1dfc8aa0be25fbe2d28ba21b6dadf3b8e200f456ba1b978"
Jul 09 15:36:44.544801 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:44.544771    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:36:44.551340 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:44.551310    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-497419/rate-test-model-497419-kserve-6954db54c5-rd6fr"]
Jul 09 15:36:45.012761 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.012731    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:45.013144 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013131    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" containerName="test-curl-7266-140504079282480"
Jul 09 15:36:45.013189 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013146    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" containerName="test-curl-7266-140504079282480"
Jul 09 15:36:45.013189 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013160    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02fed090-b317-4cd3-9aae-3afa4acec537" containerName="main"
Jul 09 15:36:45.013189 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013166    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="02fed090-b317-4cd3-9aae-3afa4acec537" containerName="main"
Jul 09 15:36:45.013282 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013230    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffae90a8-5f7b-42dd-9539-8f6e1439cd98" containerName="test-curl-7266-140504079282480"
Jul 09 15:36:45.013282 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.013242    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="02fed090-b317-4cd3-9aae-3afa4acec537" containerName="main"
Jul 09 15:36:45.017564 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.017543    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.020840 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.020819    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-nnw6g\""
Jul 09 15:36:45.025073 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.025048    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:45.089231 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.089196    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4gl6\" (UniqueName: \"kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6\") pod \"test-curl-7266-140504081378448\" (UID: \"531408df-67a5-46d5-b390-9e91982ca396\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.190564 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.190494    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4gl6\" (UniqueName: \"kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6\") pod \"test-curl-7266-140504081378448\" (UID: \"531408df-67a5-46d5-b390-9e91982ca396\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.200598 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.200575    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4gl6\" (UniqueName: \"kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6\") pod \"test-curl-7266-140504081378448\" (UID: \"531408df-67a5-46d5-b390-9e91982ca396\") " pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.327472 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.327362    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:45.470645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.470616    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:45.473442 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:36:45.473408    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod531408df_67a5_46d5_b390_9e91982ca396.slice/crio-acc629a05c7554a9d3828e42b82624ec12949ce1ef6f7b05274bf2effb60e9c5 WatchSource:0}: Error finding container acc629a05c7554a9d3828e42b82624ec12949ce1ef6f7b05274bf2effb60e9c5: Status 404 returned error can't find the container with id acc629a05c7554a9d3828e42b82624ec12949ce1ef6f7b05274bf2effb60e9c5
Jul 09 15:36:45.533961 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.533930    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081378448" event={"ID":"531408df-67a5-46d5-b390-9e91982ca396","Type":"ContainerStarted","Data":"acc629a05c7554a9d3828e42b82624ec12949ce1ef6f7b05274bf2effb60e9c5"}
Jul 09 15:36:45.908338 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:45.908313    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02fed090-b317-4cd3-9aae-3afa4acec537" path="/var/lib/kubelet/pods/02fed090-b317-4cd3-9aae-3afa4acec537/volumes"
Jul 09 15:36:46.540575 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:46.540466    2573 generic.go:356] "Generic (PLEG): container finished" podID="531408df-67a5-46d5-b390-9e91982ca396" containerID="33f1b3e776bdab3e185460cb0154e07eca7988b00712af1cb6390f031ce8723d" exitCode=0
Jul 09 15:36:46.540575 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:46.540552    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7266-140504081378448" event={"ID":"531408df-67a5-46d5-b390-9e91982ca396","Type":"ContainerDied","Data":"33f1b3e776bdab3e185460cb0154e07eca7988b00712af1cb6390f031ce8723d"}
Jul 09 15:36:47.701074 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.701047    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:47.729544 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.729493    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7266-140504081378448_531408df-67a5-46d5-b390-9e91982ca396/test-curl-7266-140504081378448/0.log"
Jul 09 15:36:47.754845 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.754810    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:47.759057 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.759028    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7266-140504081378448"]
Jul 09 15:36:47.813110 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.813022    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4gl6\" (UniqueName: \"kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6\") pod \"531408df-67a5-46d5-b390-9e91982ca396\" (UID: \"531408df-67a5-46d5-b390-9e91982ca396\") "
Jul 09 15:36:47.815090 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.815059    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6" (OuterVolumeSpecName: "kube-api-access-q4gl6") pod "531408df-67a5-46d5-b390-9e91982ca396" (UID: "531408df-67a5-46d5-b390-9e91982ca396"). InnerVolumeSpecName "kube-api-access-q4gl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:47.913962 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.913930    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4gl6\" (UniqueName: \"kubernetes.io/projected/531408df-67a5-46d5-b390-9e91982ca396-kube-api-access-q4gl6\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:47.914385 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:47.914361    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531408df-67a5-46d5-b390-9e91982ca396" path="/var/lib/kubelet/pods/531408df-67a5-46d5-b390-9e91982ca396/volumes"
Jul 09 15:36:48.552135 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:48.552107    2573 scope.go:117] "RemoveContainer" containerID="33f1b3e776bdab3e185460cb0154e07eca7988b00712af1cb6390f031ce8723d"
Jul 09 15:36:48.552331 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:48.552146    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7266-140504081378448"
Jul 09 15:36:48.721913 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:48.721878    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:36:48.722433 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:48.722115    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" podUID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" containerName="maas-api" containerID="cri-o://0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346" gracePeriod=30
Jul 09 15:36:48.978701 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:48.978674    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:36:49.025222 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.025189    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2s554\" (UniqueName: \"kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554\") pod \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") "
Jul 09 15:36:49.025427 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.025283    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca\") pod \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") "
Jul 09 15:36:49.025427 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.025323    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") pod \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\" (UID: \"6ccc6033-a60f-44b8-9a36-7435caa1fc06\") "
Jul 09 15:36:49.025732 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.025685    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ccc6033-a60f-44b8-9a36-7435caa1fc06" (UID: "6ccc6033-a60f-44b8-9a36-7435caa1fc06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:36:49.027626 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.027604    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554" (OuterVolumeSpecName: "kube-api-access-2s554") pod "6ccc6033-a60f-44b8-9a36-7435caa1fc06" (UID: "6ccc6033-a60f-44b8-9a36-7435caa1fc06"). InnerVolumeSpecName "kube-api-access-2s554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:49.027724 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.027619    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ccc6033-a60f-44b8-9a36-7435caa1fc06" (UID: "6ccc6033-a60f-44b8-9a36-7435caa1fc06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:36:49.126959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.126866    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s554\" (UniqueName: \"kubernetes.io/projected/6ccc6033-a60f-44b8-9a36-7435caa1fc06-kube-api-access-2s554\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:49.126959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.126900    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ccc6033-a60f-44b8-9a36-7435caa1fc06-openshift-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:49.126959 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.126910    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ccc6033-a60f-44b8-9a36-7435caa1fc06-maas-api-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:49.558810 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.558778    2573 generic.go:356] "Generic (PLEG): container finished" podID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" containerID="0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346" exitCode=0
Jul 09 15:36:49.558985 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.558825    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"
Jul 09 15:36:49.558985 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.558846    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" event={"ID":"6ccc6033-a60f-44b8-9a36-7435caa1fc06","Type":"ContainerDied","Data":"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"}
Jul 09 15:36:49.558985 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.558887    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5" event={"ID":"6ccc6033-a60f-44b8-9a36-7435caa1fc06","Type":"ContainerDied","Data":"a2c50e872ea69198845121513b1759d8f364bcf526b0ed79ffc4486e89176bd3"}
Jul 09 15:36:49.558985 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.558907    2573 scope.go:117] "RemoveContainer" containerID="0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"
Jul 09 15:36:49.569152 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.569131    2573 scope.go:117] "RemoveContainer" containerID="0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"
Jul 09 15:36:49.569478 ip-10-0-133-59 kubenswrapper[2573]: E0709 15:36:49.569457    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346\": container with ID starting with 0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346 not found: ID does not exist" containerID="0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"
Jul 09 15:36:49.569563 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.569488    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346"} err="failed to get container status \"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346\": rpc error: code = NotFound desc = could not find container \"0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346\": container with ID starting with 0e83ace22b8f1a609f724a25558206372d82c41a3ff25fe1bdf153899c1b9346 not found: ID does not exist"
Jul 09 15:36:49.586549 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.586503    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:36:49.591334 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.591303    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bf561e-8868459dd-jqhh5"]
Jul 09 15:36:49.908820 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:49.908784    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" path="/var/lib/kubelet/pods/6ccc6033-a60f-44b8-9a36-7435caa1fc06/volumes"
Jul 09 15:36:56.387159 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.387123    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:36:56.387731 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.387348    2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" podUID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" containerName="maas-api" containerID="cri-o://21d8e27e0e7ac56d7a6656ceff6affc1ab44f837f711a3971381f6e84aac266b" gracePeriod=30
Jul 09 15:36:56.595344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.595311    2573 generic.go:356] "Generic (PLEG): container finished" podID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" containerID="21d8e27e0e7ac56d7a6656ceff6affc1ab44f837f711a3971381f6e84aac266b" exitCode=0
Jul 09 15:36:56.595530 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.595379    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" event={"ID":"e2377bbc-38e9-4ff0-8fcd-1c410e732107","Type":"ContainerDied","Data":"21d8e27e0e7ac56d7a6656ceff6affc1ab44f837f711a3971381f6e84aac266b"}
Jul 09 15:36:56.633487 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.633463    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:36:56.699359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.699278    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hbql\" (UniqueName: \"kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql\") pod \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") "
Jul 09 15:36:56.699359 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.699329    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") pod \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") "
Jul 09 15:36:56.699641 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.699370    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca\") pod \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\" (UID: \"e2377bbc-38e9-4ff0-8fcd-1c410e732107\") "
Jul 09 15:36:56.699818 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.699793    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2377bbc-38e9-4ff0-8fcd-1c410e732107" (UID: "e2377bbc-38e9-4ff0-8fcd-1c410e732107"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:36:56.701419 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.701387    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql" (OuterVolumeSpecName: "kube-api-access-9hbql") pod "e2377bbc-38e9-4ff0-8fcd-1c410e732107" (UID: "e2377bbc-38e9-4ff0-8fcd-1c410e732107"). InnerVolumeSpecName "kube-api-access-9hbql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:36:56.701564 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.701547    2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2377bbc-38e9-4ff0-8fcd-1c410e732107" (UID: "e2377bbc-38e9-4ff0-8fcd-1c410e732107"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:36:56.800543 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.800464    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hbql\" (UniqueName: \"kubernetes.io/projected/e2377bbc-38e9-4ff0-8fcd-1c410e732107-kube-api-access-9hbql\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:56.800543 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.800509    2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2377bbc-38e9-4ff0-8fcd-1c410e732107-maas-api-tls\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:56.800543 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:56.800554    2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2377bbc-38e9-4ff0-8fcd-1c410e732107-openshift-service-ca\") on node \"ip-10-0-133-59.ec2.internal\" DevicePath \"\""
Jul 09 15:36:57.601061 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.601033    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"
Jul 09 15:36:57.601546 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.601064    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6" event={"ID":"e2377bbc-38e9-4ff0-8fcd-1c410e732107","Type":"ContainerDied","Data":"c0ce012644a52f97c04d17c0012fcff21a54786b8f21d438131d86a8f0a1f18a"}
Jul 09 15:36:57.601546 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.601125    2573 scope.go:117] "RemoveContainer" containerID="21d8e27e0e7ac56d7a6656ceff6affc1ab44f837f711a3971381f6e84aac266b"
Jul 09 15:36:57.623758 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.623737    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:36:57.627722 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.627701    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-497419-5c594d6d84-fx9b6"]
Jul 09 15:36:57.909556 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:36:57.909500    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" path="/var/lib/kubelet/pods/e2377bbc-38e9-4ff0-8fcd-1c410e732107/volumes"
Jul 09 15:37:03.888683 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:03.888650    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff459b68-gthgj_627f3705-ab2e-4d97-b560-b15126f44930/authorino/0.log"
Jul 09 15:37:09.560792 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:09.560761    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-5p88m_a019d1db-5406-4a07-a030-c931b46b46b5/copy-manifests/0.log"
Jul 09 15:37:09.574470 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:09.574420    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-5p88m_a019d1db-5406-4a07-a030-c931b46b46b5/manager/0.log"
Jul 09 15:37:11.694743 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:11.694710    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff459b68-gthgj_627f3705-ab2e-4d97-b560-b15126f44930/authorino/0.log"
Jul 09 15:37:11.829531 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:11.829489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p44ng_fdc07be5-cef3-4ca6-8a83-782b616410d1/manager/0.log"
Jul 09 15:37:13.152210 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:13.152178    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-htcx9_82c5eda5-5d70-475a-b318-e32651698d20/kube-auth-proxy/0.log"
Jul 09 15:37:13.630159 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:13.630087    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qkxlm_cec3d102-d738-49c3-93d7-05deeb555b8d/payload-processing/0.log"
Jul 09 15:37:14.224273 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:14.224245    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-trk5s_eab6809a-503f-4471-af0f-4cfdf13b8401/main/0.log"
Jul 09 15:37:14.345486 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:14.345453    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pzzwn_df531ec5-6b61-4e85-8c62-69376661e6a9/main/0.log"
Jul 09 15:37:19.315657 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315578    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wn7sj/must-gather-gnbz8"]
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315931    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" containerName="maas-api"
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315942    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" containerName="maas-api"
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315952    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531408df-67a5-46d5-b390-9e91982ca396" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315959    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="531408df-67a5-46d5-b390-9e91982ca396" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315975    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" containerName="maas-api"
Jul 09 15:37:19.316010 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.315983    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" containerName="maas-api"
Jul 09 15:37:19.316199 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.316052    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2377bbc-38e9-4ff0-8fcd-1c410e732107" containerName="maas-api"
Jul 09 15:37:19.316199 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.316062    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="531408df-67a5-46d5-b390-9e91982ca396" containerName="test-curl-7266-140504081378448"
Jul 09 15:37:19.316199 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.316068    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ccc6033-a60f-44b8-9a36-7435caa1fc06" containerName="maas-api"
Jul 09 15:37:19.320800 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.320781    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.324106 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.324086    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"openshift-service-ca.crt\""
Jul 09 15:37:19.325353 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.325335    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wn7sj\"/\"default-dockercfg-6vsgb\""
Jul 09 15:37:19.325452 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.325378    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wn7sj\"/\"kube-root-ca.crt\""
Jul 09 15:37:19.335473 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.335452    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/must-gather-gnbz8"]
Jul 09 15:37:19.410195 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.410160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ea4aa80-496f-4829-afc8-6c3dbf47101f-must-gather-output\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.410361 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.410204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5qgj\" (UniqueName: \"kubernetes.io/projected/8ea4aa80-496f-4829-afc8-6c3dbf47101f-kube-api-access-z5qgj\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.511375 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.511339    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ea4aa80-496f-4829-afc8-6c3dbf47101f-must-gather-output\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.511564 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.511388    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5qgj\" (UniqueName: \"kubernetes.io/projected/8ea4aa80-496f-4829-afc8-6c3dbf47101f-kube-api-access-z5qgj\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.511718 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.511699    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8ea4aa80-496f-4829-afc8-6c3dbf47101f-must-gather-output\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.520930 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.520903    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5qgj\" (UniqueName: \"kubernetes.io/projected/8ea4aa80-496f-4829-afc8-6c3dbf47101f-kube-api-access-z5qgj\") pod \"must-gather-gnbz8\" (UID: \"8ea4aa80-496f-4829-afc8-6c3dbf47101f\") " pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.629407 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.629328    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/must-gather-gnbz8"
Jul 09 15:37:19.778889 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:19.778858    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/must-gather-gnbz8"]
Jul 09 15:37:19.781455 ip-10-0-133-59 kubenswrapper[2573]: W0709 15:37:19.781421    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ea4aa80_496f_4829_afc8_6c3dbf47101f.slice/crio-46e14c8b60f7d6c6c7616ad2de2d6a5f2eebbb2fc8d54361824692ad2f9e5ac4 WatchSource:0}: Error finding container 46e14c8b60f7d6c6c7616ad2de2d6a5f2eebbb2fc8d54361824692ad2f9e5ac4: Status 404 returned error can't find the container with id 46e14c8b60f7d6c6c7616ad2de2d6a5f2eebbb2fc8d54361824692ad2f9e5ac4
Jul 09 15:37:20.736086 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:20.736038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/must-gather-gnbz8" event={"ID":"8ea4aa80-496f-4829-afc8-6c3dbf47101f","Type":"ContainerStarted","Data":"46e14c8b60f7d6c6c7616ad2de2d6a5f2eebbb2fc8d54361824692ad2f9e5ac4"}
Jul 09 15:37:21.745901 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:21.745855    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/must-gather-gnbz8" event={"ID":"8ea4aa80-496f-4829-afc8-6c3dbf47101f","Type":"ContainerStarted","Data":"c77606e7515c308480d7b860e29260c98f0a840ce58b915fd44944ccdaf1a114"}
Jul 09 15:37:21.746409 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:21.745920    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/must-gather-gnbz8" event={"ID":"8ea4aa80-496f-4829-afc8-6c3dbf47101f","Type":"ContainerStarted","Data":"2225c72520b14cb24d0ab693802bd7f5569349520782305fd512a408be49f4be"}
Jul 09 15:37:21.768999 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:21.768931    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wn7sj/must-gather-gnbz8" podStartSLOduration=1.68179083 podStartE2EDuration="2.768909972s" totalImagesPullingTime="1.087119142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:21.767568249 +0000 UTC m=+2518.458981026" watchObservedRunningTime="2026-07-09 15:37:21.768909972 +0000 UTC m=+2518.460322755"
Jul 09 15:37:22.759344 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:22.759309    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h9vpp_7302b010-3a52-4b6a-92fb-571b8aaf0e25/global-pull-secret-syncer/0.log"
Jul 09 15:37:23.016585 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:23.016488    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nfgcs_af7f4e15-26b7-4c65-aa37-ff070a1ab09b/konnectivity-agent/0.log"
Jul 09 15:37:23.086092 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:23.086060    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-59.ec2.internal_e04123caa9afce06f056b45e663d1ad7/haproxy/0.log"
Jul 09 15:37:28.453535 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:28.453284    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ff459b68-gthgj_627f3705-ab2e-4d97-b560-b15126f44930/authorino/0.log"
Jul 09 15:37:28.492328 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:28.492287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p44ng_fdc07be5-cef3-4ca6-8a83-782b616410d1/manager/0.log"
Jul 09 15:37:30.962966 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:30.962889    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b4bdc4fdf-trkm7_b3918a8e-a0f2-4168-b74b-cc429ff19ce9/metrics-server/0.log"
Jul 09 15:37:31.247402 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.247246    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlhnn_7a069391-fe77-49c8-a028-852a96a41b9e/node-exporter/0.log"
Jul 09 15:37:31.288821 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.288792    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlhnn_7a069391-fe77-49c8-a028-852a96a41b9e/kube-rbac-proxy/0.log"
Jul 09 15:37:31.328816 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.328781    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vlhnn_7a069391-fe77-49c8-a028-852a96a41b9e/init-textfile/0.log"
Jul 09 15:37:31.361533 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.361482    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dmg9z_e109ddb2-1514-4e30-94be-178a6e9b6b7f/kube-rbac-proxy-main/0.log"
Jul 09 15:37:31.388293 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.388257    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dmg9z_e109ddb2-1514-4e30-94be-178a6e9b6b7f/kube-rbac-proxy-self/0.log"
Jul 09 15:37:31.419433 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.419403    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-dmg9z_e109ddb2-1514-4e30-94be-178a6e9b6b7f/openshift-state-metrics/0.log"
Jul 09 15:37:31.458915 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.458886    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/prometheus/0.log"
Jul 09 15:37:31.486036 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.486011    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/config-reloader/0.log"
Jul 09 15:37:31.514688 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.514611    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/thanos-sidecar/0.log"
Jul 09 15:37:31.553135 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.553110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/kube-rbac-proxy-web/0.log"
Jul 09 15:37:31.582811 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.582782    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/kube-rbac-proxy/0.log"
Jul 09 15:37:31.614256 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.614204    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/kube-rbac-proxy-thanos/0.log"
Jul 09 15:37:31.649248 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.649217    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_80ecd0ad-3711-405b-83fa-d280e0ae765d/init-config-reloader/0.log"
Jul 09 15:37:31.692617 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.692574    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-mstwc_208d6f46-5971-465a-afb7-736dd760f04b/prometheus-operator/0.log"
Jul 09 15:37:31.719946 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.719915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-mstwc_208d6f46-5971-465a-afb7-736dd760f04b/kube-rbac-proxy/0.log"
Jul 09 15:37:31.753710 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.753684    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-wzrk5_8f8b3ff1-a836-4858-b92c-0370cdfa0e6f/prometheus-operator-admission-webhook/0.log"
Jul 09 15:37:31.933638 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.933592    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/thanos-query/0.log"
Jul 09 15:37:31.960090 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.960056    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/kube-rbac-proxy-web/0.log"
Jul 09 15:37:31.996139 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:31.996104    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/kube-rbac-proxy/0.log"
Jul 09 15:37:32.014395 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.013846    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"]
Jul 09 15:37:32.019174 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.019140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.030558 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.030532    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"]
Jul 09 15:37:32.033324 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.033291    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/prom-label-proxy/0.log"
Jul 09 15:37:32.071338 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.071306    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/kube-rbac-proxy-rules/0.log"
Jul 09 15:37:32.104912 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.104880    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-cb85f9c57-j2vxf_0f8e2328-bc5c-4230-ae71-5ce0bd3056c6/kube-rbac-proxy-metrics/0.log"
Jul 09 15:37:32.154235 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.154198    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-lib-modules\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.154534 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.154499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-podres\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.154759 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.154730    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhflg\" (UniqueName: \"kubernetes.io/projected/9a186750-f5e5-485c-9713-49454670bd44-kube-api-access-mhflg\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.154844 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.154783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-proc\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.154902 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.154877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-sys\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256038 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.255950    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhflg\" (UniqueName: \"kubernetes.io/projected/9a186750-f5e5-485c-9713-49454670bd44-kube-api-access-mhflg\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256038 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.255999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-proc\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256078    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-sys\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256131    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-lib-modules\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256171    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-proc\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256173    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-podres\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256283 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256276    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-podres\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256531 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256306    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-sys\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.256531 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.256360    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a186750-f5e5-485c-9713-49454670bd44-lib-modules\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.267135 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.267101    2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhflg\" (UniqueName: \"kubernetes.io/projected/9a186750-f5e5-485c-9713-49454670bd44-kube-api-access-mhflg\") pod \"perf-node-gather-daemonset-rsq6z\" (UID: \"9a186750-f5e5-485c-9713-49454670bd44\") " pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.333078 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.333032    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.508394 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.506808    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"]
Jul 09 15:37:32.828154 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.828077    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z" event={"ID":"9a186750-f5e5-485c-9713-49454670bd44","Type":"ContainerStarted","Data":"b4290cbd7ab4fa7d7deb03e3710dcddda24b82339b8482cc83415cd4c155a63f"}
Jul 09 15:37:32.828154 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.828137    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z" event={"ID":"9a186750-f5e5-485c-9713-49454670bd44","Type":"ContainerStarted","Data":"c7d33b5a57e183ae7c6a7b7fcff24945f0812de224f92057ceb4dd03b4fea1ff"}
Jul 09 15:37:32.828364 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.828264    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:32.860037 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:32.859974    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z" podStartSLOduration=1.859951675 podStartE2EDuration="1.859951675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:32.858201382 +0000 UTC m=+2529.549614163" watchObservedRunningTime="2026-07-09 15:37:32.859951675 +0000 UTC m=+2529.551364456"
Jul 09 15:37:33.891687 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:33.891652    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/1.log"
Jul 09 15:37:33.897368 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:33.897327    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-6xrfw_9988cc9e-a398-4c1d-b8ab-adbca8f84020/console-operator/2.log"
Jul 09 15:37:34.423291 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:34.423262    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9cdf8645-h78jm_ccf1300c-9324-44c8-8b2b-f4232b5229df/console/0.log"
Jul 09 15:37:35.095006 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:35.094973    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ss7mv_0fb4e695-7efb-4060-b37a-7379e233daed/volume-data-source-validator/0.log"
Jul 09 15:37:36.160070 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:36.160044    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2cd85_a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4/dns/0.log"
Jul 09 15:37:36.186462 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:36.186432    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2cd85_a1b08ffe-3125-4dc8-aefa-25cf5a74b5f4/kube-rbac-proxy/0.log"
Jul 09 15:37:36.312198 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:36.312168    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-97lch_31de8069-1975-404b-91e2-c91ceea0e229/dns-node-resolver/0.log"
Jul 09 15:37:36.981692 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:36.981660    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dq8w4_66e5db36-142b-4113-a30b-f2e9a915e1a0/node-ca/0.log"
Jul 09 15:37:38.451199 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:38.451162    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-htcx9_82c5eda5-5d70-475a-b318-e32651698d20/kube-auth-proxy/0.log"
Jul 09 15:37:38.685270 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:38.685231    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qkxlm_cec3d102-d738-49c3-93d7-05deeb555b8d/payload-processing/0.log"
Jul 09 15:37:38.844645 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:38.844574    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wn7sj/perf-node-gather-daemonset-rsq6z"
Jul 09 15:37:39.448815 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:39.448789    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wmcv_ad661331-e9c0-4384-9797-e23cd0ef48fa/serve-healthcheck-canary/0.log"
Jul 09 15:37:40.035836 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:40.035795    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-f9mfq_67198508-e405-4194-85ab-832bab637cf2/insights-operator/0.log"
Jul 09 15:37:40.037357 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:40.037326    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-f9mfq_67198508-e405-4194-85ab-832bab637cf2/insights-operator/1.log"
Jul 09 15:37:40.244878 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:40.244852    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r7bhj_07a7a3be-eb1a-49d2-8f6d-9ef2753d1458/kube-rbac-proxy/0.log"
Jul 09 15:37:40.286373 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:40.286300    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r7bhj_07a7a3be-eb1a-49d2-8f6d-9ef2753d1458/exporter/0.log"
Jul 09 15:37:40.312616 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:40.312588    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r7bhj_07a7a3be-eb1a-49d2-8f6d-9ef2753d1458/extractor/0.log"
Jul 09 15:37:43.290353 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:43.290327    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-htcx9_82c5eda5-5d70-475a-b318-e32651698d20/kube-auth-proxy/0.log"
Jul 09 15:37:43.384527 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:43.384489    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-5p88m_a019d1db-5406-4a07-a030-c931b46b46b5/manager/0.log"
Jul 09 15:37:43.406467 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:43.406438    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69d458487d-5p88m_a019d1db-5406-4a07-a030-c931b46b46b5/copy-manifests/0.log"
Jul 09 15:37:43.473661 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:43.473630    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qkxlm_cec3d102-d738-49c3-93d7-05deeb555b8d/payload-processing/0.log"
Jul 09 15:37:44.897581 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:44.897552    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-79ccf9794-x84bh_624a58bb-a3b9-4115-b8b2-f88093350503/manager/0.log"
Jul 09 15:37:44.900681 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:44.900654    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8d68d4884-htcx9_82c5eda5-5d70-475a-b318-e32651698d20/kube-auth-proxy/0.log"
Jul 09 15:37:45.054034 ip-10-0-133-59 kubenswrapper[2573]: I0709 15:37:45.053991    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qkxlm_cec3d102-d738-49c3-93d7-05deeb555b8d/payload-processing/0.log"