Jul 15 18:48:46.172498 ip-10-0-133-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 18:48:46.172510 ip-10-0-133-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 18:48:46.172517 ip-10-0-133-23 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 18:48:46.172795 ip-10-0-133-23 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 18:48:56.362746 ip-10-0-133-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 18:48:56.362761 ip-10-0-133-23 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4c80f98d8b9f4bbc86a6ba7187239066 --
Jul 15 18:50:30.761866 ip-10-0-133-23 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 18:50:31.201315 ip-10-0-133-23 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:50:31.201315 ip-10-0-133-23 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 18:50:31.201315 ip-10-0-133-23 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:50:31.201315 ip-10-0-133-23 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 18:50:31.201315 ip-10-0-133-23 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 18:50:31.202500 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.202359    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 18:50:31.209362 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209342    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.209362 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209359    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.209362 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209362    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.209362 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209366    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209369    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209372    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209374    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209377    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209381    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209384    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209387    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209399    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209402    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209405    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209407    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209410    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209413    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209416    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209418    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209421    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209423    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209426    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209430    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.209487 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209434    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209438    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209441    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209444    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209446    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209449    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209453    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209455    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209458    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209461    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209463    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209467    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209469    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209472    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209475    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209477    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209480    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209483    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209486    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209489    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.209954 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209492    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209494    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209497    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209500    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209502    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209505    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209508    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209510    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209513    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209515    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209517    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209520    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209522    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209525    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209527    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209530    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209532    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209534    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209538    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209541    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.210533 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209545    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209549    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209553    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209557    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209560    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209563    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209580    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209585    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209589    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209593    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209598    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209601    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209603    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209606    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209609    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209611    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209614    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209616    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209619    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.211027 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209622    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209624    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209627    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209629    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209632    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209634    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209637    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209639    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209642    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209644    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209646    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209649    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209652    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209654    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209657    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209659    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.209662    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210356    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210363    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210367    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.211473 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210370    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210373    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210391    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210395    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210398    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210402    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210404    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210407    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210410    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210413    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210415    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210419    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210421    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210424    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210426    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210429    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210431    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210434    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210437    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210439    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.211944 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210442    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210445    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210447    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210450    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210452    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210455    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210457    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210460    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210463    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210466    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210468    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210471    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210473    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210476    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210478    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210481    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210484    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210486    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210489    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.212420 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210491    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210494    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210496    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210498    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210501    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210503    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210506    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210508    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210510    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210513    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210516    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210518    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210521    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210523    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210526    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210530    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210534    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210538    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210540    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210543    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.212895 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210547    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210549    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210552    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210554    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210557    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210559    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210562    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210564    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210586    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210591    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210596    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210601    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210604    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210607    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210609    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210612    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210615    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210619    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210623    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.213375 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210625    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210628    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210631    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210634    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210637    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210640    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210642    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210645    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210647    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210650    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210652    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210655    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210658    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210660    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210662    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210665    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210667    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.210670    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211051    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211056    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.213829 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211058    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211061    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211065    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211068    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211070    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211073    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211075    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211078    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211081    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211083    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211086    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211088    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211091    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211094    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211098    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211101    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211104    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211106    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211109    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.214313 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211111    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211114    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211118    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211121    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211125    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211128    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211131    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211133    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211136    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211138    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211141    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211143    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211147    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211150    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211153    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211155    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211159    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211161    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211164    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.214805 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211167    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211170    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211172    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211174    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211177    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211179    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211182    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211185    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211187    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211190    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211192    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211195    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211197    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211200    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211202    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211205    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211207    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211212    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211215    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211217    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.215252 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211220    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211223    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211225    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211227    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211230    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211232    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211234    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211237    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211239    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211243    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211246    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211249    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211251    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211254    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211256    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211259    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211261    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211263    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211266    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.215738 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211268    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211271    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211273    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211276    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211278    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211280    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211283    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211285    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211288    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211290    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211294    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211297    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211299    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211301    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211304    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211307    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211309    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211311    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211314    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.211316    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211393    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 18:50:31.216210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211401    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211407    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211411    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211429    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211433    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211442    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211446    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211449    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211452    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211455    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211459    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211462    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211465    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211468    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211471    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211474    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211476    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211484    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211487    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211490    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211493    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211497    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211501    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 18:50:31.216740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211504    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211507    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211510    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211513    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211516    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211519    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211522    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211525    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211529    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211532    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211535    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211538    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211541    2562 flags.go:64] FLAG: --enable-server="true"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211550    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211556    2562 flags.go:64] FLAG: --event-burst="100"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211559    2562 flags.go:64] FLAG: --event-qps="50"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211562    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211565    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211587    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211593    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211596    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211599    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211602    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211605    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211607    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 18:50:31.217268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211610    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211613    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211616    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211618    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211621    2562 flags.go:64] FLAG: --feature-gates=""
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211626    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211629    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211632    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211635    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211638    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211641    2562 flags.go:64] FLAG: --help="false"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211644    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211647    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211649    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211652    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211655    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211658    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211661    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211664    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211667    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211670    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211679    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211682    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211685    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 15 18:50:31.217907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211688    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211690    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211693    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211696    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211699    2562 flags.go:64] FLAG: --lock-file=""
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211701    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211704    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211707    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211712    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211715    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211717    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211720    2562 flags.go:64] FLAG: --logging-format="text"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211723    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211727    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211730    2562 flags.go:64] FLAG: --manifest-url=""
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211733    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211737    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211740    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211744    2562 flags.go:64] FLAG: --max-pods="110"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211748    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211751    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211754    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211757    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211759    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211762    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 18:50:31.218494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211765    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211772    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211775    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211778    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211781    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211784    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211790    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211793    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211796    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211798    2562 flags.go:64] FLAG: --port="10250"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211801    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211804    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f84a834b70486763"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211807    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211810    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211812    2562 flags.go:64] FLAG: --register-node="true"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211815    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211819    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211821    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211824    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211827    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211830    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211834    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211837    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211840    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211842    2562 flags.go:64] FLAG: --runonce="false"
Jul 15 18:50:31.219130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211845    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211850    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211852    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211856    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211858    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211861    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211864    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211867    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211870    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211873    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211875    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211878    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211881    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211884    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211887    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211892    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211895    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211897    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211902    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211904    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211907    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211909    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211912    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211915    2562 flags.go:64] FLAG: --v="2"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211919    2562 flags.go:64] FLAG: --version="false"
Jul 15 18:50:31.219743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211922    2562 flags.go:64] FLAG: --vmodule=""
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211926    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.211929    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212066    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212071    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212074    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212077    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212080    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212085    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212088    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212090    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212093    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212096    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212099    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212102    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212105    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212107    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212110    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212113    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212116    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.220326 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212119    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212122    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212125    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212130    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212133    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212135    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212138    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212141    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212143    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212146    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212148    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212151    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212153    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212156    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212159    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212162    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212165    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212167    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212170    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212172    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.220817 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212176    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212180    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212184    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212187    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212191    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212194    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212197    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212199    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212202    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212204    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212207    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212209    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212212    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212215    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212218    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212220    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212223    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212225    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212228    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.221325 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212230    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212232    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212235    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212237    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212240    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212242    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212244    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212247    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212252    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212256    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212258    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212261    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212264    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212268    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212271    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212273    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212276    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212279    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212281    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212284    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.221793 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212286    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212289    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212291    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212294    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212296    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212299    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212301    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212304    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212307    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212309    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212312    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212314    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212317    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212319    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212321    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212324    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212326    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212329    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212331    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212333    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.222266 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212338    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212341    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.212343    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.213138    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.220405    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.220420    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.220440    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.220445    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220499    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220504    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220509    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220513    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220516    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220519    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.222834 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220522    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220525    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220528    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220531    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220534    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220537    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220540    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220543    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220547    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220549    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220552    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220555    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220557    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220560    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220563    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220565    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220581    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220584    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220587    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220590    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.223174 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220592    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220595    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220598    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220601    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220604    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220607    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220609    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220612    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220615    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220617    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220620    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220623    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220626    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220628    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220631    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220633    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220636    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220639    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220641    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220644    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.223641 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220647    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220649    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220652    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220654    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220657    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220660    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220662    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220664    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220667    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220669    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220672    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220674    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220677    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220679    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220682    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220685    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220688    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220690    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220693    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.224169 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220696    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220699    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220702    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220704    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220707    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220709    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220711    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220714    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220716    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220719    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220722    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220725    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220729    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220732    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220734    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220737    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220739    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220742    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220744    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220747    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.224673 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220750    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220752    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220755    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220758    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220760    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220762    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220766    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220769    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220772    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220775    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220778    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220781    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220783    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220786    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.220791    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:50:31.225133 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220907    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220911    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220915    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220917    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220920    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220923    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220926    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220929    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220932    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220934    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220937    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220940    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220942    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220945    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220948    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220951    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220954    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220956    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220960    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 18:50:31.225489 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220962    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220965    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220967    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220970    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220972    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220975    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220978    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220980    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220982    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220985    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220987    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220991    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220994    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.220997    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221001    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221004    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221007    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221010    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221012    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221015    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 18:50:31.226068 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221017    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221020    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221022    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221024    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221027    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221030    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221033    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221035    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221038    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221040    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221043    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221046    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221048    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221051    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221054    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221056    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221059    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221061    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221064    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221067    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221069    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 18:50:31.226534 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221071    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221074    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221076    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221079    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221081    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221084    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221086    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221088    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221091    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221094    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221096    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221098    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221101    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221103    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221106    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221108    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221112    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221116    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221120    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 18:50:31.227150 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221123    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221126    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221129    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221132    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221135    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221137    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221140    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221143    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221145    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221148    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221151    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221153    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221155    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221158    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221160    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221163    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221165    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221168    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221171    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 18:50:31.227757 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:31.221173    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.221178    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.221294    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.223753    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.225585    2562 server.go:1019] "Starting client certificate rotation"
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.225719    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:50:31.228242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.225763    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 18:50:31.228624 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.228609    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:50:31.231477 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.231433    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 18:50:31.244388 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.244364    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 15 18:50:31.246860 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.246843    2562 log.go:25] "Validated CRI v1 image API"
Jul 15 18:50:31.247714 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.247692    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 18:50:31.251928 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.251909    2562 fs.go:135] Filesystem UUIDs: map[18455222-05bc-468e-9d10-d3f0d8e3db3e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c64a5399-2e2f-4ced-9e7b-8b15b86780f5:/dev/nvme0n1p4]
Jul 15 18:50:31.251985 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.251928    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 18:50:31.258217 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.258099    2562 manager.go:216] Machine: {Timestamp:2026-07-15 18:50:31.256710603 +0000 UTC m=+0.368017109 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201936 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239a0c189d8588cddc810dc2ef835b SystemUUID:ec239a0c-189d-8588-cddc-810dc2ef835b BootID:4c80f98d-8b9f-4bbc-86a6-ba7187239066 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:42:53:8a:fa:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:42:53:8a:fa:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:ca:f8:b4:21:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 18:50:31.258217 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.258208    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 18:50:31.258370 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.258289    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 18:50:31.260290 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.260271    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:50:31.261908 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.261874    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 18:50:31.262081 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.261914    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 18:50:31.262852 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.262840    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 18:50:31.262914 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.262859    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 18:50:31.262914 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.262870    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:50:31.263785 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.263773    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 18:50:31.265628 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.265616    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 18:50:31.270229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270213    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:50:31.270353 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270344    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 18:50:31.270394 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270376    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 18:50:31.270394 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270387    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 18:50:31.270454 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270401    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 18:50:31.270454 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270410    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 15 18:50:31.270454 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270419    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 18:50:31.270861 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270846    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:50:31.270928 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.270871    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 18:50:31.273323 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.273304    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 18:50:31.275665 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275651    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 18:50:31.275719 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275681    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 18:50:31.275942 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275932    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 18:50:31.275971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275947    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 18:50:31.275971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275954    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 18:50:31.275971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275959    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 18:50:31.275971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275967    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 18:50:31.275971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.275972    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 18:50:31.276475 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276467    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 18:50:31.276475 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276475    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 18:50:31.276529 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276482    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 18:50:31.276529 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276487    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 18:50:31.276529 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276495    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 18:50:31.276529 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.276503    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 18:50:31.278148 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.278139    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 18:50:31.278148 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.278148    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 18:50:31.281303 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.281291    2562 server.go:1268] "Started kubelet"
Jul 15 18:50:31.281398 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.281374    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 18:50:31.281437 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.281420    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 18:50:31.281503 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.281401    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 18:50:31.282097 ip-10-0-133-23 systemd[1]: Started Kubernetes Kubelet.
Jul 15 18:50:31.284926 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.284898    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 18:50:31.287743 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.287726    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 18:50:31.289468 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.289448    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 18:50:31.289635 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.289615    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 18:50:31.289762 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.289718    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 18:50:31.289879 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.289861    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 18:50:31.290821 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.289653    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-23.ec2.internal.18c28b2dd093a78b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-23.ec2.internal,UID:ip-10-0-133-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-23.ec2.internal,},FirstTimestamp:2026-07-15 18:50:31.281264523 +0000 UTC m=+0.392571029,LastTimestamp:2026-07-15 18:50:31.281264523 +0000 UTC m=+0.392571029,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-23.ec2.internal,}"
Jul 15 18:50:31.294975 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.294958    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 18:50:31.295057 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.294962    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 18:50:31.295111 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.295071    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.295736 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295715    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 18:50:31.295736 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295717    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 18:50:31.295857 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295743    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 18:50:31.295857 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295841    2562 factory.go:55] Registering systemd factory
Jul 15 18:50:31.295953 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295857    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 18:50:31.295953 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295867    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 18:50:31.295953 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.295879    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 15 18:50:31.296136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296115    2562 factory.go:153] Registering CRI-O factory
Jul 15 18:50:31.296136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296133    2562 factory.go:223] Registration of the crio container factory successfully
Jul 15 18:50:31.296231 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296179    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 18:50:31.296231 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296198    2562 factory.go:103] Registering Raw factory
Jul 15 18:50:31.296231 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296212    2562 manager.go:1196] Started watching for new ooms in manager
Jul 15 18:50:31.296622 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.296603    2562 manager.go:349] Starting recovery of all containers
Jul 15 18:50:31.305108 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.305084    2562 manager.go:354] Recovery completed
Jul 15 18:50:31.305798 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.305770    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 18:50:31.305903 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.305884    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 18:50:31.309418 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.309405    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.311772 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.311750    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.311840 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.311824    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.311887 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.311840    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.312107 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.312076    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rsh6l"
Jul 15 18:50:31.312497 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.312476    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 18:50:31.312497 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.312488    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 18:50:31.312639 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.312502    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 18:50:31.312639 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.312529    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.313257 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.313237    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.313333 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.313271    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.313333 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.313286    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.314828 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.314813    2562 policy_none.go:49] "None policy: Start"
Jul 15 18:50:31.314892 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.314833    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 18:50:31.314892 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.314846    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 18:50:31.316931 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.316913    2562 policy_none.go:47] "Start"
Jul 15 18:50:31.320899 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.320883    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rsh6l"
Jul 15 18:50:31.323170 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.323048    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-23.ec2.internal.18c28b2dd26526fe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-23.ec2.internal,UID:ip-10-0-133-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-23.ec2.internal,},FirstTimestamp:2026-07-15 18:50:31.31177139 +0000 UTC m=+0.423077896,LastTimestamp:2026-07-15 18:50:31.31177139 +0000 UTC m=+0.423077896,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-23.ec2.internal,}"
Jul 15 18:50:31.325516 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.325455    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-23.ec2.internal.18c28b2dd2661060  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-23.ec2.internal,UID:ip-10-0-133-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-23.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-23.ec2.internal,},FirstTimestamp:2026-07-15 18:50:31.311831136 +0000 UTC m=+0.423137642,LastTimestamp:2026-07-15 18:50:31.311831136 +0000 UTC m=+0.423137642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-23.ec2.internal,}"
Jul 15 18:50:31.361628 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.361406    2562 manager.go:337] "Starting Device Plugin manager"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.361687    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.361718    2562 server.go:87] "Starting device plugin registration server"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.362089    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.362103    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.362202    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.362277    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.362285    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.363607    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 18:50:31.385734 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.363673    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.411266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.411234    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 18:50:31.412584 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.412550    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 18:50:31.412687 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.412602    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 18:50:31.412687 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.412627    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 18:50:31.412687 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.412675    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 18:50:31.415150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.415126    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:50:31.463179 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.463091    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.464248 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.464227    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.464358 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.464261    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.464358 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.464273    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.464358 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.464296    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.473815 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.473787    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.473815 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.473815    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-23.ec2.internal\": node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.510043 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.510018    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.513062 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.513044    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"]
Jul 15 18:50:31.513138 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.513109    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.514614 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.514600    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.514685 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.514630    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.514685 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.514644    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.517041 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.517030    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.517167 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.517146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.517203 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.517171    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.518667 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518653    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.518746 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518682    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.518746 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.518746 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518707    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.518746 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518726    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.518746 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.518738    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.521016 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.521003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.521065 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.521031    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 18:50:31.522680 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.522659    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 18:50:31.522787 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.522688    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 18:50:31.522787 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.522708    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID"
Jul 15 18:50:31.557442 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.557415    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-23.ec2.internal\" not found" node="ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.561737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.561721    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-23.ec2.internal\" not found" node="ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.598312 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.598285    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db04d6671f4cd1e28684b053242e01cc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"db04d6671f4cd1e28684b053242e01cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.598312 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.598312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.598488 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.598331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.610250 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.610228    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.699306 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db04d6671f4cd1e28684b053242e01cc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"db04d6671f4cd1e28684b053242e01cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.699306 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.699492 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.699492 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.699492 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db04d6671f4cd1e28684b053242e01cc-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"db04d6671f4cd1e28684b053242e01cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.699492 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.699446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5701c24352dc73620154381df2823d4e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"5701c24352dc73620154381df2823d4e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.710606 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.710585    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.811433 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.811365    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:31.859637 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.859605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.864720 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:31.864510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:31.911720 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:31.911687    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:32.012197 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.012150    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found"
Jul 15 18:50:32.095484 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.095403    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:50:32.195546 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.195510    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:32.205313 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.205283    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:50:32.206802 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.206783    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"
Jul 15 18:50:32.219464 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.219438    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 18:50:32.224587 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.224561    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 18:50:32.224767 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.224746    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 18:50:32.262215 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.262184    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:50:32.271234 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.271212    2562 apiserver.go:52] "Watching apiserver"
Jul 15 18:50:32.280647 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.280622    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 18:50:32.280977 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.280957    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-4ddsc","openshift-ovn-kubernetes/ovnkube-node-65s8b","kube-system/konnectivity-agent-xzcc5","kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4","openshift-cluster-node-tuning-operator/tuned-4dbl4","openshift-dns/node-resolver-stb4z","openshift-image-registry/node-ca-rzwzk","openshift-network-operator/iptables-alerter-2dgj8","kube-system/global-pull-secret-syncer-kvjqc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal","openshift-multus/multus-additional-cni-plugins-v4lc9","openshift-multus/multus-mt2jm","openshift-multus/network-metrics-daemon-9gr6t"]
Jul 15 18:50:32.283470 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.283449    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.286294 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.286272    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.286399 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.286278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.286399 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.286341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-44l4b\""
Jul 15 18:50:32.286897 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.286879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.286985 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.286946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:32.289000 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.288985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.291153 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.291135    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.291480 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.291461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pckkw\""
Jul 15 18:50:32.291540 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.291482    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 18:50:32.291622 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.291608    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 18:50:32.293243 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.293224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.293527 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.293508    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ck2bd\""
Jul 15 18:50:32.293733 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.293719    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 18:50:32.293836 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.293820    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.293926 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.293841    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 18:50:32.294052 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.294040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 18:50:32.294493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.294480    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.295251 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295239    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 18:50:32.295413 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.295618 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295595    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.295711 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295606    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k9fpq\""
Jul 15 18:50:32.295711 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.295888 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.295873    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 18:50:32.297510 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.297491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.297694 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.297672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.297942 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.297925    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.298007 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.297925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6nq49\""
Jul 15 18:50:32.299710 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.299693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.299794 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.299749    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2rj6s\""
Jul 15 18:50:32.299886 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.299871    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.300137 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.300122    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 18:50:32.300210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.300122    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.301819 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32b4affa-a511-4ed5-8efa-e039902c0a90-hosts-file\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.301905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kh2\" (UniqueName: \"kubernetes.io/projected/859d557e-a010-4ab5-9068-ebf1a525e957-kube-api-access-x5kh2\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.301905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-systemd\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.301905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-var-lib-kubelet\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.301905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-socket-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-sys-fs\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301916    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.301995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xch\" (UniqueName: \"kubernetes.io/projected/0048c3e6-e013-42e8-b255-8b978759698a-kube-api-access-62xch\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.301994    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32b4affa-a511-4ed5-8efa-e039902c0a90-tmp-dir\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.302100 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5vgk2\""
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzz5r\" (UniqueName: \"kubernetes.io/projected/32b4affa-a511-4ed5-8efa-e039902c0a90-kube-api-access-zzz5r\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-kubernetes\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-tmp\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4mh\" (UniqueName: \"kubernetes.io/projected/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-kube-api-access-9q4mh\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.302350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302322    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-os-release\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-conf\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7169f3ef-afeb-4a89-a408-9f6b5e185736-konnectivity-ca\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-system-cni-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-cnibin\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xl8d\" (UniqueName: \"kubernetes.io/projected/4aa03ac6-cb37-46cc-8825-8956e3114056-kube-api-access-2xl8d\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-modprobe-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-sys\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-tuned\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.302674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-host\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-serviceca\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysconfig\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-registration-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-run\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-lib-modules\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4s5f\" (UniqueName: \"kubernetes.io/projected/d4d2f26e-201d-4f51-b202-90d254137c0a-kube-api-access-p4s5f\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.302981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7169f3ef-afeb-4a89-a408-9f6b5e185736-agent-certs\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.303002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-device-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.303114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.303035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-host\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.304152 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.304133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:32.304249 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.304219    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:32.306407 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.306390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.307790 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.307774    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 18:50:32.308721 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.308704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.308800 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.308725    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 18:50:32.309116 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.309090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p6p59\""
Jul 15 18:50:32.311228 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.311212    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 18:50:32.311283 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.311251    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 18:50:32.312383 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.312368    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 18:50:32.312608 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.312592    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 18:50:32.312674 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.312612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8rsz6\""
Jul 15 18:50:32.312727 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.312678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 18:50:32.312902 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.312888    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 18:50:32.326442 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.326386    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 18:45:31 +0000 UTC" deadline="2028-01-06 02:40:44.862697217 +0000 UTC"
Jul 15 18:50:32.326442 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.326441    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12943h50m12.53626057s"
Jul 15 18:50:32.330442 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.330427    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wsbtz"
Jul 15 18:50:32.337407 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.337379    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wsbtz"
Jul 15 18:50:32.397147 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.397115    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 18:50:32.403242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-run\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.403350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7169f3ef-afeb-4a89-a408-9f6b5e185736-agent-certs\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.403350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:32.403451 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-system-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.403451 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-cni-binary-copy\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.403451 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-systemd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.403451 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403431    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-run\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.403566 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-ovn\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.403566 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-env-overrides\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.403566 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32b4affa-a511-4ed5-8efa-e039902c0a90-hosts-file\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-var-lib-kubelet\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/32b4affa-a511-4ed5-8efa-e039902c0a90-hosts-file\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-socket-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-var-lib-kubelet\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xch\" (UniqueName: \"kubernetes.io/projected/0048c3e6-e013-42e8-b255-8b978759698a-kube-api-access-62xch\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-dbus\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.403740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-hostroot\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-multus-certs\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-kubelet\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403792    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzz5r\" (UniqueName: \"kubernetes.io/projected/32b4affa-a511-4ed5-8efa-e039902c0a90-kube-api-access-zzz5r\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-tmp\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-kubelet\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-os-release\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-conf\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7169f3ef-afeb-4a89-a408-9f6b5e185736-konnectivity-ca\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4xm\" (UniqueName: \"kubernetes.io/projected/8ecfc4ce-30d7-482e-b501-619a71ac5e56-kube-api-access-pq4xm\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-cnibin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.403802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-socket-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-os-release\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.404058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-k8s-cni-cncf-io\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-system-cni-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-multus\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404146    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-conf\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-netns\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-os-release\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-systemd-units\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysconfig\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-system-cni-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-registration-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-daemon-config\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysctl-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-lib-modules\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.404723 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4s5f\" (UniqueName: \"kubernetes.io/projected/d4d2f26e-201d-4f51-b202-90d254137c0a-kube-api-access-p4s5f\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-device-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-script-lib\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404500    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-lib-modules\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-host\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-sysconfig\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-host\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7169f3ef-afeb-4a89-a408-9f6b5e185736-konnectivity-ca\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.404672    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-device-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.404757    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:32.904717565 +0000 UTC m=+2.016024058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-registration-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kh2\" (UniqueName: \"kubernetes.io/projected/859d557e-a010-4ab5-9068-ebf1a525e957-kube-api-access-x5kh2\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-systemd\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-sys-fs\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.405629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-systemd\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt497\" (UniqueName: \"kubernetes.io/projected/e9a8168d-371c-4be7-a300-a44ced01253e-kube-api-access-tt497\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.404984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32b4affa-a511-4ed5-8efa-e039902c0a90-tmp-dir\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-kubernetes\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-sys-fs\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-kubernetes\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4mh\" (UniqueName: \"kubernetes.io/projected/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-kube-api-access-9q4mh\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ecfc4ce-30d7-482e-b501-619a71ac5e56-host-slash\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-socket-dir-parent\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32b4affa-a511-4ed5-8efa-e039902c0a90-tmp-dir\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-log-socket\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-bin\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0048c3e6-e013-42e8-b255-8b978759698a-etc-selinux\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.406395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-netd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9a8168d-371c-4be7-a300-a44ced01253e-ovn-node-metrics-cert\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-kubelet-config\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-var-lib-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-cnibin\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-cnibin\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405677    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xl8d\" (UniqueName: \"kubernetes.io/projected/4aa03ac6-cb37-46cc-8825-8956e3114056-kube-api-access-2xl8d\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405714    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-modprobe-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-sys\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-netns\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-bin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-tuned\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-host\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.407174 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-serviceca\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ecfc4ce-30d7-482e-b501-619a71ac5e56-iptables-alerter-script\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-conf-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-node-log\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.405997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-modprobe-d\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d4d2f26e-201d-4f51-b202-90d254137c0a-sys\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-config\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-host\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-etc-kubernetes\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlj7c\" (UniqueName: \"kubernetes.io/projected/5355b867-fae3-497f-89ac-52dd643e2d5b-kube-api-access-vlj7c\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-slash\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-etc-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4aa03ac6-cb37-46cc-8825-8956e3114056-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4aa03ac6-cb37-46cc-8825-8956e3114056-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.406735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-serviceca\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.407748 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.407464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-tmp\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.408262 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.407690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7169f3ef-afeb-4a89-a408-9f6b5e185736-agent-certs\") pod \"konnectivity-agent-xzcc5\" (UID: \"7169f3ef-afeb-4a89-a408-9f6b5e185736\") " pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.408406 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.408391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d4d2f26e-201d-4f51-b202-90d254137c0a-etc-tuned\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.414487 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.414465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xch\" (UniqueName: \"kubernetes.io/projected/0048c3e6-e013-42e8-b255-8b978759698a-kube-api-access-62xch\") pod \"aws-ebs-csi-driver-node-ghps4\" (UID: \"0048c3e6-e013-42e8-b255-8b978759698a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.415230 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.414737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kh2\" (UniqueName: \"kubernetes.io/projected/859d557e-a010-4ab5-9068-ebf1a525e957-kube-api-access-x5kh2\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.415230 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.415050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4mh\" (UniqueName: \"kubernetes.io/projected/782738dc-bbda-4dac-81fa-3bd0c9eb1cf5-kube-api-access-9q4mh\") pod \"node-ca-rzwzk\" (UID: \"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5\") " pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.415230 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.415172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4s5f\" (UniqueName: \"kubernetes.io/projected/d4d2f26e-201d-4f51-b202-90d254137c0a-kube-api-access-p4s5f\") pod \"tuned-4dbl4\" (UID: \"d4d2f26e-201d-4f51-b202-90d254137c0a\") " pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.415879 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.415860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xl8d\" (UniqueName: \"kubernetes.io/projected/4aa03ac6-cb37-46cc-8825-8956e3114056-kube-api-access-2xl8d\") pod \"multus-additional-cni-plugins-v4lc9\" (UID: \"4aa03ac6-cb37-46cc-8825-8956e3114056\") " pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.415988 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.415905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzz5r\" (UniqueName: \"kubernetes.io/projected/32b4affa-a511-4ed5-8efa-e039902c0a90-kube-api-access-zzz5r\") pod \"node-resolver-stb4z\" (UID: \"32b4affa-a511-4ed5-8efa-e039902c0a90\") " pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.424788 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.424769    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rzwzk"
Jul 15 18:50:32.506534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.506534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-netns\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-bin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-bin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.506645    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-netns\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ecfc4ce-30d7-482e-b501-619a71ac5e56-iptables-alerter-script\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-conf-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.506742    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:50:33.006714981 +0000 UTC m=+2.118021480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-node-log\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-conf-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.506789 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-config\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-node-log\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-etc-kubernetes\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-etc-kubernetes\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlj7c\" (UniqueName: \"kubernetes.io/projected/5355b867-fae3-497f-89ac-52dd643e2d5b-kube-api-access-vlj7c\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-slash\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-etc-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-slash\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.506997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-system-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-etc-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-cni-binary-copy\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-systemd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-ovn\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-system-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-env-overrides\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-dbus\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-hostroot\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.507250 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-systemd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-ovn\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-multus-certs\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-multus-certs\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-kubelet\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-kubelet\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-hostroot\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4xm\" (UniqueName: \"kubernetes.io/projected/8ecfc4ce-30d7-482e-b501-619a71ac5e56-kube-api-access-pq4xm\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-dbus\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-cnibin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507309    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-kubelet\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-k8s-cni-cncf-io\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-config\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-kubelet\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-multus\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-run-k8s-cni-cncf-io\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-netns\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507384    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-cnibin\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507407    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-host-var-lib-cni-multus\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-os-release\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-env-overrides\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-netns\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-systemd-units\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507475    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-systemd-units\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-daemon-config\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-os-release\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-script-lib\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt497\" (UniqueName: \"kubernetes.io/projected/e9a8168d-371c-4be7-a300-a44ced01253e-kube-api-access-tt497\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ecfc4ce-30d7-482e-b501-619a71ac5e56-host-slash\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-socket-dir-parent\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-cni-dir\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-cni-binary-copy\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-run-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507741    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-log-socket\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.508629 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507778    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-log-socket\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ecfc4ce-30d7-482e-b501-619a71ac5e56-host-slash\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ecfc4ce-30d7-482e-b501-619a71ac5e56-iptables-alerter-script\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-socket-dir-parent\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-bin\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507883    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-run-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-netd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-bin\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5355b867-fae3-497f-89ac-52dd643e2d5b-multus-daemon-config\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9a8168d-371c-4be7-a300-a44ced01253e-ovn-node-metrics-cert\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.507979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-cni-netd\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-kubelet-config\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-var-lib-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/052485cd-74e9-4c40-8fc3-4efc09ec052d-kubelet-config\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508135    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9a8168d-371c-4be7-a300-a44ced01253e-var-lib-openvswitch\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.509831 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.508433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9a8168d-371c-4be7-a300-a44ced01253e-ovnkube-script-lib\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.510259 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.510238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9a8168d-371c-4be7-a300-a44ced01253e-ovn-node-metrics-cert\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.514230 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.514208    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:32.514321 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.514235    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:32.514321 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.514250    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:32.514416 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.514324    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:33.014309921 +0000 UTC m=+2.125616458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:32.516244 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.516213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlj7c\" (UniqueName: \"kubernetes.io/projected/5355b867-fae3-497f-89ac-52dd643e2d5b-kube-api-access-vlj7c\") pod \"multus-mt2jm\" (UID: \"5355b867-fae3-497f-89ac-52dd643e2d5b\") " pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.516326 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.516300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4xm\" (UniqueName: \"kubernetes.io/projected/8ecfc4ce-30d7-482e-b501-619a71ac5e56-kube-api-access-pq4xm\") pod \"iptables-alerter-2dgj8\" (UID: \"8ecfc4ce-30d7-482e-b501-619a71ac5e56\") " pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.516975 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.516959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt497\" (UniqueName: \"kubernetes.io/projected/e9a8168d-371c-4be7-a300-a44ced01253e-kube-api-access-tt497\") pod \"ovnkube-node-65s8b\" (UID: \"e9a8168d-371c-4be7-a300-a44ced01253e\") " pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.532645 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.532606    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5701c24352dc73620154381df2823d4e.slice/crio-935e711b1099463fb901515a4ab7501304fffeb38c11c4f2b34d99b57a7b4a80 WatchSource:0}: Error finding container 935e711b1099463fb901515a4ab7501304fffeb38c11c4f2b34d99b57a7b4a80: Status 404 returned error can't find the container with id 935e711b1099463fb901515a4ab7501304fffeb38c11c4f2b34d99b57a7b4a80
Jul 15 18:50:32.532986 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.532966    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb04d6671f4cd1e28684b053242e01cc.slice/crio-0173b7e066f74bb55145a725f6f5fcf8596ba5725bd643625d0b64a0d7a98873 WatchSource:0}: Error finding container 0173b7e066f74bb55145a725f6f5fcf8596ba5725bd643625d0b64a0d7a98873: Status 404 returned error can't find the container with id 0173b7e066f74bb55145a725f6f5fcf8596ba5725bd643625d0b64a0d7a98873
Jul 15 18:50:32.536522 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.536508    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:50:32.619094 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.619002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-stb4z"
Jul 15 18:50:32.628490 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.628466    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b4affa_a511_4ed5_8efa_e039902c0a90.slice/crio-d408bbaa1f78530aade55f3a86530da8800aaae7051f9e08c0356e56b30b7009 WatchSource:0}: Error finding container d408bbaa1f78530aade55f3a86530da8800aaae7051f9e08c0356e56b30b7009: Status 404 returned error can't find the container with id d408bbaa1f78530aade55f3a86530da8800aaae7051f9e08c0356e56b30b7009
Jul 15 18:50:32.639955 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.639934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:32.648227 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.648202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7169f3ef_afeb_4a89_a408_9f6b5e185736.slice/crio-355cf10bf9aec3582e3da3b07f616fd454c99f0f7e0a135701e2aa059803467f WatchSource:0}: Error finding container 355cf10bf9aec3582e3da3b07f616fd454c99f0f7e0a135701e2aa059803467f: Status 404 returned error can't find the container with id 355cf10bf9aec3582e3da3b07f616fd454c99f0f7e0a135701e2aa059803467f
Jul 15 18:50:32.663758 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.663729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4lc9"
Jul 15 18:50:32.665836 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.665816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4"
Jul 15 18:50:32.672780 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.672757    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa03ac6_cb37_46cc_8825_8956e3114056.slice/crio-a63e0c04d25b8c3def747d3a90726eba3c5300b4f309148c2a12cedb81f854a3 WatchSource:0}: Error finding container a63e0c04d25b8c3def747d3a90726eba3c5300b4f309148c2a12cedb81f854a3: Status 404 returned error can't find the container with id a63e0c04d25b8c3def747d3a90726eba3c5300b4f309148c2a12cedb81f854a3
Jul 15 18:50:32.674341 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.674319    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0048c3e6_e013_42e8_b255_8b978759698a.slice/crio-66d5d824ff7232afa64075b879785aa93fd8ca10b7c938d51fec69f9f0f837e3 WatchSource:0}: Error finding container 66d5d824ff7232afa64075b879785aa93fd8ca10b7c938d51fec69f9f0f837e3: Status 404 returned error can't find the container with id 66d5d824ff7232afa64075b879785aa93fd8ca10b7c938d51fec69f9f0f837e3
Jul 15 18:50:32.700494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.700451    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4dbl4"
Jul 15 18:50:32.709878 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.709855    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d2f26e_201d_4f51_b202_90d254137c0a.slice/crio-cf083df44ef176020e328814d2c2292dba6c14342c0a0c36993ff365715f8f6d WatchSource:0}: Error finding container cf083df44ef176020e328814d2c2292dba6c14342c0a0c36993ff365715f8f6d: Status 404 returned error can't find the container with id cf083df44ef176020e328814d2c2292dba6c14342c0a0c36993ff365715f8f6d
Jul 15 18:50:32.730169 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.730146    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:50:32.738842 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.738819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2dgj8"
Jul 15 18:50:32.744636 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.744620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mt2jm"
Jul 15 18:50:32.749017 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.748998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:32.764115 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.764091    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355b867_fae3_497f_89ac_52dd643e2d5b.slice/crio-1919158fec1504df2c161169863ab8b4b3f2b842f555ab19981fc1f5aedde8b2 WatchSource:0}: Error finding container 1919158fec1504df2c161169863ab8b4b3f2b842f555ab19981fc1f5aedde8b2: Status 404 returned error can't find the container with id 1919158fec1504df2c161169863ab8b4b3f2b842f555ab19981fc1f5aedde8b2
Jul 15 18:50:32.764424 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.764405    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782738dc_bbda_4dac_81fa_3bd0c9eb1cf5.slice/crio-cd1603788cf89cbfb229f545a3ccc6a4834af4fc03039bd556fe789d222f5d0e WatchSource:0}: Error finding container cd1603788cf89cbfb229f545a3ccc6a4834af4fc03039bd556fe789d222f5d0e: Status 404 returned error can't find the container with id cd1603788cf89cbfb229f545a3ccc6a4834af4fc03039bd556fe789d222f5d0e
Jul 15 18:50:32.765246 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.765210    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a8168d_371c_4be7_a300_a44ced01253e.slice/crio-c0f9d483fe84c9938aea299fdfba8f85192cd097f960e1f06dc93fddf76b2d02 WatchSource:0}: Error finding container c0f9d483fe84c9938aea299fdfba8f85192cd097f960e1f06dc93fddf76b2d02: Status 404 returned error can't find the container with id c0f9d483fe84c9938aea299fdfba8f85192cd097f960e1f06dc93fddf76b2d02
Jul 15 18:50:32.766077 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:50:32.766001    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecfc4ce_30d7_482e_b501_619a71ac5e56.slice/crio-0cfeb1c932d084c80f3e5cda86278f01a08085a8c315920dcbe42cf83e7f6683 WatchSource:0}: Error finding container 0cfeb1c932d084c80f3e5cda86278f01a08085a8c315920dcbe42cf83e7f6683: Status 404 returned error can't find the container with id 0cfeb1c932d084c80f3e5cda86278f01a08085a8c315920dcbe42cf83e7f6683
Jul 15 18:50:32.910516 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:32.910428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:32.910661 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.910597    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:32.910661 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:32.910650    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:33.910636585 +0000 UTC m=+3.021943078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:33.011298 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.011258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:33.011451 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.011424    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:33.011522 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.011507    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:50:34.011486595 +0000 UTC m=+3.122793105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:33.065348 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.065318    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 18:50:33.112210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.112173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:33.112399 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.112361    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:33.112399 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.112382    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:33.112399 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.112393    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:33.112542 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.112455    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:34.112434773 +0000 UTC m=+3.223741268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:33.340485 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.340376    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:45:32 +0000 UTC" deadline="2028-05-02 05:49:01.678457488 +0000 UTC"
Jul 15 18:50:33.340485 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.340427    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15754h58m28.338036157s"
Jul 15 18:50:33.432750 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.432622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"c0f9d483fe84c9938aea299fdfba8f85192cd097f960e1f06dc93fddf76b2d02"}
Jul 15 18:50:33.465024 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.464885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4dbl4" event={"ID":"d4d2f26e-201d-4f51-b202-90d254137c0a","Type":"ContainerStarted","Data":"cf083df44ef176020e328814d2c2292dba6c14342c0a0c36993ff365715f8f6d"}
Jul 15 18:50:33.498782 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.498738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4" event={"ID":"0048c3e6-e013-42e8-b255-8b978759698a","Type":"ContainerStarted","Data":"66d5d824ff7232afa64075b879785aa93fd8ca10b7c938d51fec69f9f0f837e3"}
Jul 15 18:50:33.522587 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.522541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerStarted","Data":"a63e0c04d25b8c3def747d3a90726eba3c5300b4f309148c2a12cedb81f854a3"}
Jul 15 18:50:33.544289 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.544243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzcc5" event={"ID":"7169f3ef-afeb-4a89-a408-9f6b5e185736","Type":"ContainerStarted","Data":"355cf10bf9aec3582e3da3b07f616fd454c99f0f7e0a135701e2aa059803467f"}
Jul 15 18:50:33.563532 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.563473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stb4z" event={"ID":"32b4affa-a511-4ed5-8efa-e039902c0a90","Type":"ContainerStarted","Data":"d408bbaa1f78530aade55f3a86530da8800aaae7051f9e08c0356e56b30b7009"}
Jul 15 18:50:33.572017 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.571979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" event={"ID":"db04d6671f4cd1e28684b053242e01cc","Type":"ContainerStarted","Data":"0173b7e066f74bb55145a725f6f5fcf8596ba5725bd643625d0b64a0d7a98873"}
Jul 15 18:50:33.576999 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.576915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzwzk" event={"ID":"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5","Type":"ContainerStarted","Data":"cd1603788cf89cbfb229f545a3ccc6a4834af4fc03039bd556fe789d222f5d0e"}
Jul 15 18:50:33.590726 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.590687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mt2jm" event={"ID":"5355b867-fae3-497f-89ac-52dd643e2d5b","Type":"ContainerStarted","Data":"1919158fec1504df2c161169863ab8b4b3f2b842f555ab19981fc1f5aedde8b2"}
Jul 15 18:50:33.609084 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.609037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"5701c24352dc73620154381df2823d4e","Type":"ContainerStarted","Data":"935e711b1099463fb901515a4ab7501304fffeb38c11c4f2b34d99b57a7b4a80"}
Jul 15 18:50:33.623981 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.623944    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2dgj8" event={"ID":"8ecfc4ce-30d7-482e-b501-619a71ac5e56","Type":"ContainerStarted","Data":"0cfeb1c932d084c80f3e5cda86278f01a08085a8c315920dcbe42cf83e7f6683"}
Jul 15 18:50:33.920902 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:33.920812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:33.921083 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.921046    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:33.921152 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:33.921115    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:35.921094689 +0000 UTC m=+5.032401200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:34.021342 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.021294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:34.021539 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.021501    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:34.021612 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.021566    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:50:36.021545178 +0000 UTC m=+5.132851678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:34.121997 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.121960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:34.122207 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.122136    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:34.122207 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.122156    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:34.122207 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.122169    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:34.122379 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.122232    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:36.122213443 +0000 UTC m=+5.233519941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:34.343640 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.341663    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 18:45:32 +0000 UTC" deadline="2028-04-07 08:22:32.71176852 +0000 UTC"
Jul 15 18:50:34.343640 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.341726    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15157h31m58.370046366s"
Jul 15 18:50:34.413682 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.413644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:34.413868 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.413791    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:34.414272 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.414251    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:34.414393 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.414353    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:34.414458 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:34.414421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:34.414530 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:34.414497    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:35.938985 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:35.938939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:35.939494 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:35.939100    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:35.939494 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:35.939167    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:39.939147751 +0000 UTC m=+9.050454247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:36.040301 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:36.040267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:36.040484 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.040397    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:36.040484 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.040450    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:50:40.040436362 +0000 UTC m=+9.151742857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:36.141280 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:36.141243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:36.141466 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.141449    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:36.141466 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.141467    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:36.141572 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.141476    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:36.141572 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.141523    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:40.141508753 +0000 UTC m=+9.252815248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:36.413616 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:36.413504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:36.413808 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.413665    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:36.414085 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:36.414064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:36.414187 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.414168    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:36.414246 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:36.414222    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:36.414305 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:36.414290    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:38.413209 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:38.413174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:38.413646 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:38.413214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:38.413646 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:38.413214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:38.413646 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:38.413307    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:38.413646 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:38.413445    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:38.413646 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:38.413543    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:39.974494 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:39.974446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:39.974990 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:39.974707    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:39.974990 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:39.974780    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:47.974759812 +0000 UTC m=+17.086066305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:40.075703 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:40.075666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:40.075879 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.075823    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:40.075942 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.075884    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:50:48.075870553 +0000 UTC m=+17.187177050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:40.176306 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:40.176268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:40.176472 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.176436    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:40.176472 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.176451    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:40.176472 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.176460    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:40.176695 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.176512    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:50:48.176494452 +0000 UTC m=+17.287800966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:40.413295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.413436    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:40.413665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:40.413685    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.413760    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:40.413922 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:40.413843    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:42.413905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:42.413684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:42.413905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:42.413724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:42.413905 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:42.413819    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:42.413905 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:42.413884    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:42.414476 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:42.413939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:42.414476 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:42.414038    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:44.413944 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:44.413737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:44.414413 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:44.413790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:44.414413 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:44.413790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:44.414413 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:44.414066    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:44.414413 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:44.414188    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:44.414413 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:44.414268    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:46.413251 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:46.413213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:46.413251 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:46.413253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:46.413721 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:46.413213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:46.413721 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:46.413349    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:46.413721 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:46.413406    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:46.413721 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:46.413502    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:48.034630 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.034589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:48.035064 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.034765    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:48.035064 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.034841    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:04.03481953 +0000 UTC m=+33.146126025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:50:48.135635 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.135589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:48.135822 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.135681    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:48.135822 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.135761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:51:04.135741802 +0000 UTC m=+33.247048309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:50:48.236760 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.236725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:48.236933 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.236912    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:50:48.236988 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.236944    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:50:48.236988 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.236959    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:48.237055 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.237021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:04.237002956 +0000 UTC m=+33.348309455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:50:48.413110 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.413028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:48.413266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.413028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:48.413266 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.413150    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:48.413266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:48.413033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:48.413432 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.413268    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:48.413432 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:48.413314    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:50.412899 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:50.412864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:50.413333 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:50.412861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:50.413333 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:50.412964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:50.413333 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:50.413096    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:50.413333 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:50.412874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:50.413333 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:50.413195    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:52.413301 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:52.413264    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:52.413767 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:52.413316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:52.413767 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:52.413383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:52.413767 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:52.413404    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:52.413767 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:52.413504    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:52.413767 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:52.413617    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:53.669212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.669111    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:50:53.671192 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.671046    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9a8168d-371c-4be7-a300-a44ced01253e" containerID="96a127e54f0b67718d35d621221dea857b575cdbefaa4c04f2578efcc2994187" exitCode=1
Jul 15 18:50:53.671192 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.671123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerDied","Data":"96a127e54f0b67718d35d621221dea857b575cdbefaa4c04f2578efcc2994187"}
Jul 15 18:50:53.671341 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.671215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"de5b77f30690040628a60c934693495b28f175b76ea980d41ba6d869f6182345"}
Jul 15 18:50:53.693195 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.693166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4dbl4" event={"ID":"d4d2f26e-201d-4f51-b202-90d254137c0a","Type":"ContainerStarted","Data":"a106d4d801b3ca88782153fbd778df2235f6caa4f5ae5f8c8af76cdf13e2a8f8"}
Jul 15 18:50:53.708917 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.708246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" event={"ID":"db04d6671f4cd1e28684b053242e01cc","Type":"ContainerStarted","Data":"65255c4d4bb1cc8e6bdb22a9d79943ea20883be529ec40013248ced040ee2d47"}
Jul 15 18:50:53.742162 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:53.741910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4dbl4" podStartSLOduration=1.115035622 podStartE2EDuration="21.741886072s" totalImagesPullingTime="20.62685045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:53.719217617 +0000 UTC m=+22.830524146" watchObservedRunningTime="2026-07-15 18:50:53.741886072 +0000 UTC m=+22.853192589"
Jul 15 18:50:54.413228 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.413194    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:54.413385 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.413296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:54.413385 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:54.413301    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:54.413385 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.413323    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:54.413489 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:54.413396    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:54.413489 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:54.413465    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:54.711443 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.711415    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="8267f525c96ccdfd30d602fe4f164bcfb379ff60826960f4622148ed9799044e" exitCode=0
Jul 15 18:50:54.712223 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.711479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"8267f525c96ccdfd30d602fe4f164bcfb379ff60826960f4622148ed9799044e"}
Jul 15 18:50:54.713117 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.712940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xzcc5" event={"ID":"7169f3ef-afeb-4a89-a408-9f6b5e185736","Type":"ContainerStarted","Data":"6fcb2270737307e00d386838c6c703d4cedd59eb6651edaf823049f08b9c3b30"}
Jul 15 18:50:54.714320 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.714286    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-stb4z" event={"ID":"32b4affa-a511-4ed5-8efa-e039902c0a90","Type":"ContainerStarted","Data":"6a7fa58976cae659a3cd7507bb2ad98a4c097f183baa51e4620b3f376e0bb858"}
Jul 15 18:50:54.715518 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.715494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rzwzk" event={"ID":"782738dc-bbda-4dac-81fa-3bd0c9eb1cf5","Type":"ContainerStarted","Data":"8007e95f515f9c7d69ce03a0d2e26fd65c83663535b33bd42d23a4f3224fe489"}
Jul 15 18:50:54.716733 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.716714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mt2jm" event={"ID":"5355b867-fae3-497f-89ac-52dd643e2d5b","Type":"ContainerStarted","Data":"d7218c8df05b4e4667bb9615932adef7d3325470e8d216c41d870078516ffe37"}
Jul 15 18:50:54.718639 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.718605    2562 generic.go:356] "Generic (PLEG): container finished" podID="5701c24352dc73620154381df2823d4e" containerID="919330bf33af91d57382885608ecfba9d1658a861bd8e26502b1f569fb917dd4" exitCode=0
Jul 15 18:50:54.718726 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.718684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"5701c24352dc73620154381df2823d4e","Type":"ContainerDied","Data":"919330bf33af91d57382885608ecfba9d1658a861bd8e26502b1f569fb917dd4"}
Jul 15 18:50:54.720014 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.719989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2dgj8" event={"ID":"8ecfc4ce-30d7-482e-b501-619a71ac5e56","Type":"ContainerStarted","Data":"0c73b5d35a3566e866acb6db7fcdc786a9adff372c2b8b1a01e450a51b3fb42f"}
Jul 15 18:50:54.722526 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.722512    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:50:54.722870 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.722853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"ccdc38a70b6a6d517d2cfdea08ca3bf8ca3f17f65144a961009b32b2fed3e1f4"}
Jul 15 18:50:54.722921 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.722904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"225e994b412c6325cbec0f7876bf96f82bec2b03051670af3baea1c75d22a87e"}
Jul 15 18:50:54.722959 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.722933    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"e3f1ed0b6c5c48c96cf39cd70dae69ee5dad8c5308b77c91f21a089a80fcbd9e"}
Jul 15 18:50:54.722995 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.722968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"d685d5d80d3631c961e446759ca915caabf15e2910bcf3b572b03f465840fc2c"}
Jul 15 18:50:54.724210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.724189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4" event={"ID":"0048c3e6-e013-42e8-b255-8b978759698a","Type":"ContainerStarted","Data":"75f673098c3cac85b95516550f00292fba34f1602caf9533f4033c0e13e3765a"}
Jul 15 18:50:54.744947 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.744909    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" podStartSLOduration=22.744896307 podStartE2EDuration="22.744896307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:53.742928492 +0000 UTC m=+22.854235011" watchObservedRunningTime="2026-07-15 18:50:54.744896307 +0000 UTC m=+23.856202832"
Jul 15 18:50:54.801361 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.801315    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mt2jm" podStartSLOduration=1.972817213 podStartE2EDuration="22.801300362s" totalImagesPullingTime="20.828483149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:54.77447462 +0000 UTC m=+23.885781139" watchObservedRunningTime="2026-07-15 18:50:54.801300362 +0000 UTC m=+23.912606877"
Jul 15 18:50:54.827865 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.827822    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-stb4z" podStartSLOduration=3.120120114 podStartE2EDuration="23.827806537s" totalImagesPullingTime="20.707686423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:54.825898394 +0000 UTC m=+23.937204909" watchObservedRunningTime="2026-07-15 18:50:54.827806537 +0000 UTC m=+23.939113051"
Jul 15 18:50:54.898279 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.898215    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xzcc5" podStartSLOduration=7.77354941 podStartE2EDuration="23.898191195s" totalImagesPullingTime="16.124641785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:54.865291505 +0000 UTC m=+23.976598022" watchObservedRunningTime="2026-07-15 18:50:54.898191195 +0000 UTC m=+24.009497710"
Jul 15 18:50:54.898681 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.898650    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2dgj8" podStartSLOduration=6.892008141 podStartE2EDuration="22.898643096s" totalImagesPullingTime="16.006634955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:54.898414292 +0000 UTC m=+24.009720808" watchObservedRunningTime="2026-07-15 18:50:54.898643096 +0000 UTC m=+24.009949612"
Jul 15 18:50:54.982480 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.982364    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:54.983053 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:54.983038    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:55.026179 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.026127    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rzwzk" podStartSLOduration=2.478986999 podStartE2EDuration="23.026102495s" totalImagesPullingTime="20.547115496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:54.932065383 +0000 UTC m=+24.043371898" watchObservedRunningTime="2026-07-15 18:50:55.026102495 +0000 UTC m=+24.137409038"
Jul 15 18:50:55.677248 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.677162    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 18:50:55.728058 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.728021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"5701c24352dc73620154381df2823d4e","Type":"ContainerStarted","Data":"b4b3d01aeb2f4dee7426dbecb26952a64e631d45bf1421e80d696b3b61a005fd"}
Jul 15 18:50:55.730226 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.730201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4" event={"ID":"0048c3e6-e013-42e8-b255-8b978759698a","Type":"ContainerStarted","Data":"6487445b0abc7bd490402c601c2f1ed048079c1da6db1c49d2adde911b9f3f6d"}
Jul 15 18:50:55.731027 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.731009    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:55.731129 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.731080    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xzcc5"
Jul 15 18:50:55.752795 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:55.752743    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" podStartSLOduration=23.752722551 podStartE2EDuration="23.752722551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:55.752708371 +0000 UTC m=+24.864014885" watchObservedRunningTime="2026-07-15 18:50:55.752722551 +0000 UTC m=+24.864029067"
Jul 15 18:50:56.375133 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.375030    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T18:50:55.67718587Z","UUID":"a088b5d6-2d7e-4b58-b43e-d76667bd572e","Handler":null,"Name":"","Endpoint":""}
Jul 15 18:50:56.377503 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.377475    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 18:50:56.377684 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.377527    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 18:50:56.413705 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.413600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:56.413705 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.413668    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:56.413705 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.413629    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:56.413920 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:56.413799    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:56.413920 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:56.413901    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:56.414000 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:56.413980    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:56.736384 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.736311    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:50:56.737103 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:56.737080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"e71cc066eeaa37e69d15806b02b953e7a16db1def3e5a71e7c1a6780febb834e"}
Jul 15 18:50:57.741627 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:57.741566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4" event={"ID":"0048c3e6-e013-42e8-b255-8b978759698a","Type":"ContainerStarted","Data":"3787bf9ea0bc8b83f9264d83a90461bb5767c5663ef1a04b68d9c5e598cc8531"}
Jul 15 18:50:57.760456 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:57.760401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ghps4" podStartSLOduration=3.468186154 podStartE2EDuration="26.760386054s" totalImagesPullingTime="23.2921999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:50:57.760242305 +0000 UTC m=+26.871548820" watchObservedRunningTime="2026-07-15 18:50:57.760386054 +0000 UTC m=+26.871692568"
Jul 15 18:50:58.413437 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:58.413404    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:50:58.413607 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:58.413503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:50:58.413607 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:58.413510    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:50:58.413607 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:58.413529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:50:58.413737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:58.413624    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:50:58.413737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:50:58.413693    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:50:59.749926 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.749697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:50:59.750641 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.750230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"8a420bfe556321c605d081d2fd218bca2420da8d4bbaee2bec3d1e6387c94985"}
Jul 15 18:50:59.750641 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.750499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:59.750641 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.750602    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:59.750747 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.750689    2562 scope.go:117] "RemoveContainer" containerID="96a127e54f0b67718d35d621221dea857b575cdbefaa4c04f2578efcc2994187"
Jul 15 18:50:59.752621 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.752555    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="2628a79361dbe258a529eadb14741e3caa38cd447adbaa05884784a3ef70175c" exitCode=0
Jul 15 18:50:59.752621 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.752600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"2628a79361dbe258a529eadb14741e3caa38cd447adbaa05884784a3ef70175c"}
Jul 15 18:50:59.767804 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.767783    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:50:59.767915 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:50:59.767905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.413263    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:00.413388    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.413811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:00.413902    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.413955    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:00.416592 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:00.414025    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:51:00.763008 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.762895    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:51:00.763395 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.763269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" event={"ID":"e9a8168d-371c-4be7-a300-a44ced01253e","Type":"ContainerStarted","Data":"da437a99bc933ef65e44352350363953436aaa714148f3c482479e1111420b30"}
Jul 15 18:51:00.763558 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:00.763543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:51:01.040519 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.040413    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b" podStartSLOduration=8.429537131 podStartE2EDuration="29.040396795s" totalImagesPullingTime="20.610859664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:00.795803894 +0000 UTC m=+29.907110410" watchObservedRunningTime="2026-07-15 18:51:01.040396795 +0000 UTC m=+30.151703308"
Jul 15 18:51:01.041187 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.041158    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kvjqc"]
Jul 15 18:51:01.041301 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.041292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:01.041406 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:01.041389    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:51:01.045291 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.045267    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ddsc"]
Jul 15 18:51:01.045405 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.045381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:01.045503 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:01.045478    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:51:01.045693 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.045678    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gr6t"]
Jul 15 18:51:01.045768 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.045758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:01.045841 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:01.045825    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:51:01.769999 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.769964    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="81e65ec098df22b6a001c37d9083afbd215c30f5ba8cd458663bfb84a8ae5896" exitCode=0
Jul 15 18:51:01.770421 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:01.770050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"81e65ec098df22b6a001c37d9083afbd215c30f5ba8cd458663bfb84a8ae5896"}
Jul 15 18:51:02.413563 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:02.413536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:02.413707 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:02.413663    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:51:02.413770 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:02.413711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:02.413859 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:02.413840    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:51:03.413362 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:03.413285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:03.413811 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:03.413414    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:51:03.776558 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:03.776521    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="82da4f0dfd8e67c37ddb2647d5b6cc9d384338d5b92f1391a5c374ba84b994ca" exitCode=0
Jul 15 18:51:03.776720 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:03.776564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"82da4f0dfd8e67c37ddb2647d5b6cc9d384338d5b92f1391a5c374ba84b994ca"}
Jul 15 18:51:04.056978 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:04.056887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:04.057114 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.057038    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:04.057114 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.057100    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs podName:859d557e-a010-4ab5-9068-ebf1a525e957 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:36.057084955 +0000 UTC m=+65.168391449 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs") pod "network-metrics-daemon-9gr6t" (UID: "859d557e-a010-4ab5-9068-ebf1a525e957") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 18:51:04.157515 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:04.157478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:04.157693 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.157615    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:04.157693 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.157670    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret podName:052485cd-74e9-4c40-8fc3-4efc09ec052d nodeName:}" failed. No retries permitted until 2026-07-15 18:51:36.157658418 +0000 UTC m=+65.268964911 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret") pod "global-pull-secret-syncer-kvjqc" (UID: "052485cd-74e9-4c40-8fc3-4efc09ec052d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 18:51:04.258427 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:04.258395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:04.258612 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.258519    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 18:51:04.258612 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.258532    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 18:51:04.258612 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.258541    2562 projected.go:196] Error preparing data for projected volume kube-api-access-lfp55 for pod openshift-network-diagnostics/network-check-target-4ddsc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:04.258612 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.258604    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55 podName:d7e2a0cf-1547-4851-a861-11b9855b2830 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:36.25859096 +0000 UTC m=+65.369897453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lfp55" (UniqueName: "kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55") pod "network-check-target-4ddsc" (UID: "d7e2a0cf-1547-4851-a861-11b9855b2830") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 18:51:04.413528 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:04.413447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:04.413528 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:04.413495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:04.414001 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.413615    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvjqc" podUID="052485cd-74e9-4c40-8fc3-4efc09ec052d"
Jul 15 18:51:04.414001 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:04.413659    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9gr6t" podUID="859d557e-a010-4ab5-9068-ebf1a525e957"
Jul 15 18:51:05.413068 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:05.413034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:05.413244 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:05.413155    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4ddsc" podUID="d7e2a0cf-1547-4851-a861-11b9855b2830"
Jul 15 18:51:06.200620 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.200590    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeReady"
Jul 15 18:51:06.200997 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.200752    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 18:51:06.247608 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.246818    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"]
Jul 15 18:51:06.250817 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.250791    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"]
Jul 15 18:51:06.250945 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.250854    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.255956 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.255935    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"]
Jul 15 18:51:06.256061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.256033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"
Jul 15 18:51:06.259208 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.259187    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"]
Jul 15 18:51:06.259345 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.259305    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.261227 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.261208    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.261332 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.261214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-clx8d\""
Jul 15 18:51:06.261533 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.261516    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.261650 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.261612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jngcc\""
Jul 15 18:51:06.262662 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.262642    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:51:06.262772 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.262758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.265216 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.265201    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 18:51:06.265421 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.265407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.265485 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.265462    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.266056 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.266038    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-lst2h"]
Jul 15 18:51:06.266165 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.266145    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.267416 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.267401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 18:51:06.267509 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.267429    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qfhtc\""
Jul 15 18:51:06.269230 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.269212    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pqwsf"]
Jul 15 18:51:06.269375 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.269316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.269819 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.269800    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.269933 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.269920    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 18:51:06.270644 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.270551    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 18:51:06.271044 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.271027    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.271190 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.271033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.271987 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.271970    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 18:51:06.272105 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.272090    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 18:51:06.272209 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.272195    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.272497 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.272479    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"]
Jul 15 18:51:06.272647 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.272622    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.273922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.273907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9j7dz\""
Jul 15 18:51:06.274443 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.274417    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.275124 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 18:51:06.275124 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275120    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vb6tl\""
Jul 15 18:51:06.275281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275090    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.275281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 18:51:06.275281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275255    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.275456 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275426    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 18:51:06.275547 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.275532    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 18:51:06.276255 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.276216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.276348 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.276253    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-94g5v\""
Jul 15 18:51:06.279380 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.278937    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.282028 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.280225    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.282028 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.280278    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 18:51:06.282028 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.280226    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jdpnx\""
Jul 15 18:51:06.282028 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.280301    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 18:51:06.282028 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.281262    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.283526 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.283367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rlxbn\""
Jul 15 18:51:06.284300 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.284111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 18:51:06.284300 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.284184    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"]
Jul 15 18:51:06.285598 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.285440    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 18:51:06.290760 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.290737    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 18:51:06.291685 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.291645    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b987544d6-22jms"]
Jul 15 18:51:06.292397 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.292381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"
Jul 15 18:51:06.293197 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.293175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 18:51:06.294917 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.294899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 18:51:06.295244 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.295226    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lst2h"]
Jul 15 18:51:06.295344 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.295265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"]
Jul 15 18:51:06.295344 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.295286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"]
Jul 15 18:51:06.295448 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.295348    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.296221 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.296202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"]
Jul 15 18:51:06.296532 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.296515    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.296662 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.296644    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p599l\""
Jul 15 18:51:06.296893 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.296876    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.297048 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.297034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"]
Jul 15 18:51:06.297550 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.297527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:51:06.299808 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.299792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 18:51:06.300310 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.300292    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 18:51:06.300904 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.300881    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 18:51:06.301060 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.301041    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.301170 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.301047    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.301170 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.301096    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mhqlx\""
Jul 15 18:51:06.301396 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.301380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 18:51:06.306043 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.305016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m7dmm"]
Jul 15 18:51:06.310302 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.310281    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7wccv"]
Jul 15 18:51:06.310456 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.310434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.316091 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.315543    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 18:51:06.316091 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.315915    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mxlws\""
Jul 15 18:51:06.316262 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.316243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b987544d6-22jms"]
Jul 15 18:51:06.316372 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.316358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.319374 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.319353    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 18:51:06.319844 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.319768    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 18:51:06.320140 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.320115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jj7q8\""
Jul 15 18:51:06.320238 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.320155    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"]
Jul 15 18:51:06.320351 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.320334    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 18:51:06.320705 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.320671    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 18:51:06.324220 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.324202    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"]
Jul 15 18:51:06.324321 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.324244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pqwsf"]
Jul 15 18:51:06.324888 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.324868    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wccv"]
Jul 15 18:51:06.325759 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.325740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7dmm"]
Jul 15 18:51:06.374245 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09f51599-39a1-4b35-8546-d81177619edf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzvgq\" (UniqueName: \"kubernetes.io/projected/4c3db7f6-a103-4a53-bfde-668821d83785-kube-api-access-zzvgq\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2n8\" (UniqueName: \"kubernetes.io/projected/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-kube-api-access-pj2n8\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09f51599-39a1-4b35-8546-d81177619edf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.374391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq8t4\" (UniqueName: \"kubernetes.io/projected/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-kube-api-access-tq8t4\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmx5g\" (UniqueName: \"kubernetes.io/projected/09f51599-39a1-4b35-8546-d81177619edf-kube-api-access-dmx5g\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-config\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snsh\" (UniqueName: \"kubernetes.io/projected/c395b913-55ae-43ec-a1ba-15cc5e805655-kube-api-access-2snsh\") pod \"network-check-source-869dcfcdcd-sntfz\" (UID: \"c395b913-55ae-43ec-a1ba-15cc5e805655\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-config\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.374671 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwtfp\" (UniqueName: \"kubernetes.io/projected/7af06135-7c6a-40fb-a835-967e12272c28-kube-api-access-mwtfp\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959b2256-3d5b-4362-9dd5-bfe4767856c4-serving-cert\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af06135-7c6a-40fb-a835-967e12272c28-serving-cert\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj2ch\" (UniqueName: \"kubernetes.io/projected/44cfea73-0599-4874-9390-aa430cb967ee-kube-api-access-hj2ch\") pod \"volume-data-source-validator-78495597f6-7bvx2\" (UID: \"44cfea73-0599-4874-9390-aa430cb967ee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"
Jul 15 18:51:06.374922 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-tmp\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-default-certificate\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.374983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh79d\" (UniqueName: \"kubernetes.io/projected/238d2bad-610b-47c4-bb77-eb08fa07c7c5-kube-api-access-rh79d\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-trusted-ca\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-stats-auth\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bfbn\" (UniqueName: \"kubernetes.io/projected/959b2256-3d5b-4362-9dd5-bfe4767856c4-kube-api-access-4bfbn\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-snapshots\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2pg8\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c3db7f6-a103-4a53-bfde-668821d83785-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.375268 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.375226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.413324 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.413287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:06.413495 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.413304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:06.416108 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.416085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:51:06.416196 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.416158    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nvc9\""
Jul 15 18:51:06.416238 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.416190    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d804f410-ec9a-4c74-addc-df3211085594-tmp-dir\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmx5g\" (UniqueName: \"kubernetes.io/projected/09f51599-39a1-4b35-8546-d81177619edf-kube-api-access-dmx5g\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-config\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2snsh\" (UniqueName: \"kubernetes.io/projected/c395b913-55ae-43ec-a1ba-15cc5e805655-kube-api-access-2snsh\") pod \"network-check-source-869dcfcdcd-sntfz\" (UID: \"c395b913-55ae-43ec-a1ba-15cc5e805655\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-config\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwtfp\" (UniqueName: \"kubernetes.io/projected/7af06135-7c6a-40fb-a835-967e12272c28-kube-api-access-mwtfp\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959b2256-3d5b-4362-9dd5-bfe4767856c4-serving-cert\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.477355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af06135-7c6a-40fb-a835-967e12272c28-serving-cert\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj2ch\" (UniqueName: \"kubernetes.io/projected/44cfea73-0599-4874-9390-aa430cb967ee-kube-api-access-hj2ch\") pod \"volume-data-source-validator-78495597f6-7bvx2\" (UID: \"44cfea73-0599-4874-9390-aa430cb967ee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-tmp\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-default-certificate\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh79d\" (UniqueName: \"kubernetes.io/projected/238d2bad-610b-47c4-bb77-eb08fa07c7c5-kube-api-access-rh79d\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-trusted-ca\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-stats-auth\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bfbn\" (UniqueName: \"kubernetes.io/projected/959b2256-3d5b-4362-9dd5-bfe4767856c4-kube-api-access-4bfbn\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-snapshots\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2pg8\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c3db7f6-a103-4a53-bfde-668821d83785-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zmpj\" (UniqueName: \"kubernetes.io/projected/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-kube-api-access-4zmpj\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.478229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.476979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09f51599-39a1-4b35-8546-d81177619edf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzvgq\" (UniqueName: \"kubernetes.io/projected/4c3db7f6-a103-4a53-bfde-668821d83785-kube-api-access-zzvgq\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zpt\" (UniqueName: \"kubernetes.io/projected/d804f410-ec9a-4c74-addc-df3211085594-kube-api-access-l5zpt\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2n8\" (UniqueName: \"kubernetes.io/projected/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-kube-api-access-pj2n8\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477099    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d804f410-ec9a-4c74-addc-df3211085594-config-volume\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-cert\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.477254    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:06.977201737 +0000 UTC m=+36.088508247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09f51599-39a1-4b35-8546-d81177619edf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq8t4\" (UniqueName: \"kubernetes.io/projected/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-kube-api-access-tq8t4\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.477777    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-tmp\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.478136    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.478208    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/959b2256-3d5b-4362-9dd5-bfe4767856c4-snapshots\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.478965 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.478951    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-config\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.479737 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.479165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c3db7f6-a103-4a53-bfde-668821d83785-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.479737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.479276    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:06.479737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.479290    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:06.479737 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.479396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-trusted-ca\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.479737 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.479414    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:06.979400531 +0000 UTC m=+36.090707024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:06.479963 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.479791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7af06135-7c6a-40fb-a835-967e12272c28-config\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.480089 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.480070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/09f51599-39a1-4b35-8546-d81177619edf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.480331 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.480305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.481089 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.480697    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.481089 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.480860    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:06.481089 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.480972    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:06.980954001 +0000 UTC m=+36.092260497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:06.481089 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.481061    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:06.481351 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.481101    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:06.981090365 +0000 UTC m=+36.092396858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:06.481351 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.481279    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:06.481351 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.481337    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:06.981322275 +0000 UTC m=+36.092628770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:06.482165 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.482138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/959b2256-3d5b-4362-9dd5-bfe4767856c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.482388 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.482360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.483136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.483105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.483284 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.483244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.483978 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.483938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7af06135-7c6a-40fb-a835-967e12272c28-serving-cert\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.484301 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.484278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/09f51599-39a1-4b35-8546-d81177619edf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.484401 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.484379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.484667 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.484646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-default-certificate\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.485681 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.485658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/959b2256-3d5b-4362-9dd5-bfe4767856c4-serving-cert\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.485812 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.485722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-stats-auth\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.488760 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.487874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:06.488760 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.488284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj2ch\" (UniqueName: \"kubernetes.io/projected/44cfea73-0599-4874-9390-aa430cb967ee-kube-api-access-hj2ch\") pod \"volume-data-source-validator-78495597f6-7bvx2\" (UID: \"44cfea73-0599-4874-9390-aa430cb967ee\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"
Jul 15 18:51:06.488903 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.488862    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bfbn\" (UniqueName: \"kubernetes.io/projected/959b2256-3d5b-4362-9dd5-bfe4767856c4-kube-api-access-4bfbn\") pod \"insights-operator-68d9dd94cf-pqwsf\" (UID: \"959b2256-3d5b-4362-9dd5-bfe4767856c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.490976 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.490933    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snsh\" (UniqueName: \"kubernetes.io/projected/c395b913-55ae-43ec-a1ba-15cc5e805655-kube-api-access-2snsh\") pod \"network-check-source-869dcfcdcd-sntfz\" (UID: \"c395b913-55ae-43ec-a1ba-15cc5e805655\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"
Jul 15 18:51:06.491132 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.491113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwtfp\" (UniqueName: \"kubernetes.io/projected/7af06135-7c6a-40fb-a835-967e12272c28-kube-api-access-mwtfp\") pod \"console-operator-7866497494-lst2h\" (UID: \"7af06135-7c6a-40fb-a835-967e12272c28\") " pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.491551 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.491530    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.493175 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.493092    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2n8\" (UniqueName: \"kubernetes.io/projected/396d753b-23ae-44dc-abbb-ab7a2a8a59c7-kube-api-access-pj2n8\") pod \"service-ca-operator-7695fc6c8c-6jwwf\" (UID: \"396d753b-23ae-44dc-abbb-ab7a2a8a59c7\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.493435 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.493394    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh79d\" (UniqueName: \"kubernetes.io/projected/238d2bad-610b-47c4-bb77-eb08fa07c7c5-kube-api-access-rh79d\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.493762 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.493740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzvgq\" (UniqueName: \"kubernetes.io/projected/4c3db7f6-a103-4a53-bfde-668821d83785-kube-api-access-zzvgq\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.493856 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.493790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2pg8\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.493856 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.493815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmx5g\" (UniqueName: \"kubernetes.io/projected/09f51599-39a1-4b35-8546-d81177619edf-kube-api-access-dmx5g\") pod \"kube-storage-version-migrator-operator-799cb7f958-g42sf\" (UID: \"09f51599-39a1-4b35-8546-d81177619edf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.495201 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.495176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq8t4\" (UniqueName: \"kubernetes.io/projected/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-kube-api-access-tq8t4\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.572026 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.571932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"
Jul 15 18:51:06.578094 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d804f410-ec9a-4c74-addc-df3211085594-tmp-dir\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.578217 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.578266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zmpj\" (UniqueName: \"kubernetes.io/projected/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-kube-api-access-4zmpj\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.578313 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zpt\" (UniqueName: \"kubernetes.io/projected/d804f410-ec9a-4c74-addc-df3211085594-kube-api-access-l5zpt\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.578347 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d804f410-ec9a-4c74-addc-df3211085594-config-volume\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.578347 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-cert\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.578430 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.578405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d804f410-ec9a-4c74-addc-df3211085594-tmp-dir\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.578789 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.578765    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:06.578907 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.578876    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.078855877 +0000 UTC m=+36.190162372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:06.579442 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.579419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d804f410-ec9a-4c74-addc-df3211085594-config-volume\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.581309 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.581291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-cert\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.594816 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.594768    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zpt\" (UniqueName: \"kubernetes.io/projected/d804f410-ec9a-4c74-addc-df3211085594-kube-api-access-l5zpt\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:06.596339 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.596132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"
Jul 15 18:51:06.598026 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.598008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zmpj\" (UniqueName: \"kubernetes.io/projected/9ed1afa1-9bf3-46f3-85c7-e47d161c4d54-kube-api-access-4zmpj\") pod \"ingress-canary-7wccv\" (UID: \"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54\") " pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.614350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.614328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:06.623923 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.623908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf"
Jul 15 18:51:06.624389 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.624366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:06.631731 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.631716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"
Jul 15 18:51:06.638463 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.638443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"
Jul 15 18:51:06.659664 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.659630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wccv"
Jul 15 18:51:06.982548 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.982512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:06.982742 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.982636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.982742 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.982680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:06.982742 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982684    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:06.982742 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982707    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:06.982742 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.982711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.982746232 +0000 UTC m=+37.094052725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982787    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982788    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982809    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:06.982805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982842    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.982824375 +0000 UTC m=+37.094130887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.98286113 +0000 UTC m=+37.094167624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982880    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.982873547 +0000 UTC m=+37.094180040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:06.982975 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:06.982894    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:07.982887223 +0000 UTC m=+37.094193717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:07.083753 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.083713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:07.083923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.083887    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:07.083986 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.083974    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:08.083952214 +0000 UTC m=+37.195258710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:07.417086 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.417019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:07.420982 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.420953    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz9k9\""
Jul 15 18:51:07.991912 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.991732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:07.992053 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.991933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:07.992053 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.991962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:07.992053 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.992028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:07.992210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.992063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:07.992210 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992183    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:07.992210 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992197    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:07.992210 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992211    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992258    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:09.992237378 +0000 UTC m=+39.103543891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992277    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:09.992267367 +0000 UTC m=+39.103573863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992300    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992338    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:09.992321251 +0000 UTC m=+39.103627745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992341    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:07.992386 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992375    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:09.992363341 +0000 UTC m=+39.103669835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:07.992732 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:07.992405    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:09.992394243 +0000 UTC m=+39.103700744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:07.995139 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.994813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wccv"]
Jul 15 18:51:07.996208 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:07.996154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf"]
Jul 15 18:51:08.001027 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.000040    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-pqwsf"]
Jul 15 18:51:08.004002 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.003882    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz"]
Jul 15 18:51:08.007788 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:08.006987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959b2256_3d5b_4362_9dd5_bfe4767856c4.slice/crio-b9e82280c1f9eb0ac5cb8be13965deaece1f19d98c586635a1e8bf05fc54f021 WatchSource:0}: Error finding container b9e82280c1f9eb0ac5cb8be13965deaece1f19d98c586635a1e8bf05fc54f021: Status 404 returned error can't find the container with id b9e82280c1f9eb0ac5cb8be13965deaece1f19d98c586635a1e8bf05fc54f021
Jul 15 18:51:08.007994 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:08.007915    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc395b913_55ae_43ec_a1ba_15cc5e805655.slice/crio-4d8810f07b414eb8ea684ae82fa077911d5e5cdfd9813a0440f7ed0f8509dfbf WatchSource:0}: Error finding container 4d8810f07b414eb8ea684ae82fa077911d5e5cdfd9813a0440f7ed0f8509dfbf: Status 404 returned error can't find the container with id 4d8810f07b414eb8ea684ae82fa077911d5e5cdfd9813a0440f7ed0f8509dfbf
Jul 15 18:51:08.017513 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.017441    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf"]
Jul 15 18:51:08.037622 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.037586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2"]
Jul 15 18:51:08.049229 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.049194    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lst2h"]
Jul 15 18:51:08.051994 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:08.051949    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cfea73_0599_4874_9390_aa430cb967ee.slice/crio-2c01d2c416b69952e0897b380c04b136e7e57f379dd1bada6dae0c0e0774ce05 WatchSource:0}: Error finding container 2c01d2c416b69952e0897b380c04b136e7e57f379dd1bada6dae0c0e0774ce05: Status 404 returned error can't find the container with id 2c01d2c416b69952e0897b380c04b136e7e57f379dd1bada6dae0c0e0774ce05
Jul 15 18:51:08.052544 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:08.052508    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f51599_39a1_4b35_8546_d81177619edf.slice/crio-50184e34ab2d4bdc08942ea68009cf6c15b037717800c014ef74b4a927615c25 WatchSource:0}: Error finding container 50184e34ab2d4bdc08942ea68009cf6c15b037717800c014ef74b4a927615c25: Status 404 returned error can't find the container with id 50184e34ab2d4bdc08942ea68009cf6c15b037717800c014ef74b4a927615c25
Jul 15 18:51:08.053583 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:08.053360    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af06135_7c6a_40fb_a835_967e12272c28.slice/crio-a7fd8d87c337acd54ed7c0409abc611adb8adb430d0a5212334a4235ae9d2a04 WatchSource:0}: Error finding container a7fd8d87c337acd54ed7c0409abc611adb8adb430d0a5212334a4235ae9d2a04: Status 404 returned error can't find the container with id a7fd8d87c337acd54ed7c0409abc611adb8adb430d0a5212334a4235ae9d2a04
Jul 15 18:51:08.092910 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.092885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:08.093037 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:08.093021    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:08.093107 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:08.093095    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:10.093075459 +0000 UTC m=+39.204381976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:08.794625 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.794471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wccv" event={"ID":"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54","Type":"ContainerStarted","Data":"9cb249ad69a14289ae355db90e8243b2f233cf1769e40e65763b01ac1f6d31db"}
Jul 15 18:51:08.803737 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.803668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz" event={"ID":"c395b913-55ae-43ec-a1ba-15cc5e805655","Type":"ContainerStarted","Data":"4d8810f07b414eb8ea684ae82fa077911d5e5cdfd9813a0440f7ed0f8509dfbf"}
Jul 15 18:51:08.805328 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.805263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf" event={"ID":"959b2256-3d5b-4362-9dd5-bfe4767856c4","Type":"ContainerStarted","Data":"b9e82280c1f9eb0ac5cb8be13965deaece1f19d98c586635a1e8bf05fc54f021"}
Jul 15 18:51:08.807015 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.806965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf" event={"ID":"396d753b-23ae-44dc-abbb-ab7a2a8a59c7","Type":"ContainerStarted","Data":"f96dac7e1ce1c1454baacb06c55957c2d7365d54b9813cf5a67e8e88c3bea897"}
Jul 15 18:51:08.814466 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.814438    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="fc7d0ceb53ee2d40f0553383a7f67cb5e0b431b4e4e39fe7ac4f6e1ad0910840" exitCode=0
Jul 15 18:51:08.814593 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.814522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"fc7d0ceb53ee2d40f0553383a7f67cb5e0b431b4e4e39fe7ac4f6e1ad0910840"}
Jul 15 18:51:08.819982 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.819012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lst2h" event={"ID":"7af06135-7c6a-40fb-a835-967e12272c28","Type":"ContainerStarted","Data":"a7fd8d87c337acd54ed7c0409abc611adb8adb430d0a5212334a4235ae9d2a04"}
Jul 15 18:51:08.823779 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.823749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2" event={"ID":"44cfea73-0599-4874-9390-aa430cb967ee","Type":"ContainerStarted","Data":"2c01d2c416b69952e0897b380c04b136e7e57f379dd1bada6dae0c0e0774ce05"}
Jul 15 18:51:08.825247 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:08.825216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf" event={"ID":"09f51599-39a1-4b35-8546-d81177619edf","Type":"ContainerStarted","Data":"50184e34ab2d4bdc08942ea68009cf6c15b037717800c014ef74b4a927615c25"}
Jul 15 18:51:09.839606 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:09.839358    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aa03ac6-cb37-46cc-8825-8956e3114056" containerID="6dec1313fbdadf33fd4a55b6542869c39e596e1b6d15479afd6f375caf06c6d8" exitCode=0
Jul 15 18:51:09.839606 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:09.839409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerDied","Data":"6dec1313fbdadf33fd4a55b6542869c39e596e1b6d15479afd6f375caf06c6d8"}
Jul 15 18:51:10.013998 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.013864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:10.013998 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.013935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:10.013998 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.013968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:10.014271 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.014036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:10.014271 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.014089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:10.014787 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.014727    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:10.014905 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.014795    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.014773588 +0000 UTC m=+43.126080084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:10.015221 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015174    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:10.015291 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015231    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.015215779 +0000 UTC m=+43.126522276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:10.015291 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015286    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:10.015367 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015321    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.015309883 +0000 UTC m=+43.126616379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:10.015411 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015381    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.015372019 +0000 UTC m=+43.126678526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:10.016204 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015646    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:10.016204 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015664    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:10.016204 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.015701    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.015688123 +0000 UTC m=+43.126994643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:10.115586 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.115458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:10.115779 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.115641    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:10.115779 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:10.115708    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:14.115688858 +0000 UTC m=+43.226995364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:10.849502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.848728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" event={"ID":"4aa03ac6-cb37-46cc-8825-8956e3114056","Type":"ContainerStarted","Data":"1a1160bbaa23349111203fe6a714666322703688cbfb1f16fa6823dcd938b6cb"}
Jul 15 18:51:10.877375 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.876546    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4lc9" podStartSLOduration=8.735459493 podStartE2EDuration="39.876531826s" totalImagesPullingTime="31.141072333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:10.874964051 +0000 UTC m=+39.986270565" watchObservedRunningTime="2026-07-15 18:51:10.876531826 +0000 UTC m=+39.987838341"
Jul 15 18:51:10.909355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:10.909310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:11.003915 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:11.003796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:11.106708 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:11.106655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log" limit=1024
Jul 15 18:51:14.052129 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.052088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:14.052129 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.052130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.052171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052261    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.052248606 +0000 UTC m=+51.163555099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052262    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.052299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052317    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.05230596 +0000 UTC m=+51.163612453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052262    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052390    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.052392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052406    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052414    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.052408145 +0000 UTC m=+51.163714638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052440    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.052434956 +0000 UTC m=+51.163741455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:14.052710 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.052468    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.052456867 +0000 UTC m=+51.163763361 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:14.153278 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:14.153247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:14.153449 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.153410    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:14.153555 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:14.153478    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.153463151 +0000 UTC m=+51.264769644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:16.436404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.436364    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"]
Jul 15 18:51:16.451850 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.451821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"]
Jul 15 18:51:16.452003 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.451963    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.455169 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.454599    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n7qc4\""
Jul 15 18:51:16.455169 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.454805    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 18:51:16.455728 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.455705    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 18:51:16.575984 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.575942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.576165 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.576072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69e4df55-2061-4d92-b1c1-42a8abfe7067-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.677214 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.677174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69e4df55-2061-4d92-b1c1-42a8abfe7067-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.677420 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.677316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.677526 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:16.677502    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 18:51:16.677620 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:16.677608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert podName:69e4df55-2061-4d92-b1c1-42a8abfe7067 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:17.177563053 +0000 UTC m=+46.288869557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bwwsw" (UID: "69e4df55-2061-4d92-b1c1-42a8abfe7067") : secret "networking-console-plugin-cert" not found
Jul 15 18:51:16.678078 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.678057    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/69e4df55-2061-4d92-b1c1-42a8abfe7067-nginx-conf\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:16.871928 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.871892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wccv" event={"ID":"9ed1afa1-9bf3-46f3-85c7-e47d161c4d54","Type":"ContainerStarted","Data":"fdd9818115a6bb8d82edd919a76c9879a122d8c69208b0c5e04fcce34e3f0ae9"}
Jul 15 18:51:16.873548 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.873518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz" event={"ID":"c395b913-55ae-43ec-a1ba-15cc5e805655","Type":"ContainerStarted","Data":"25e1295ef671915a0791b14cade67696b9c4dac2fbac6adc3e75bbb394e13eda"}
Jul 15 18:51:16.875057 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.875034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf" event={"ID":"959b2256-3d5b-4362-9dd5-bfe4767856c4","Type":"ContainerStarted","Data":"9ccf7074e47ce2345a305e2294bba20918661e92181f38da4d7155a6c5aaf921"}
Jul 15 18:51:16.876520 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.876498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf" event={"ID":"396d753b-23ae-44dc-abbb-ab7a2a8a59c7","Type":"ContainerStarted","Data":"3e1308bbc54257799fda290dd4a001b1e2e61efb4d89226e37263fdc9063bf0c"}
Jul 15 18:51:16.878075 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.878059    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/0.log"
Jul 15 18:51:16.878175 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.878089    2562 generic.go:356] "Generic (PLEG): container finished" podID="7af06135-7c6a-40fb-a835-967e12272c28" containerID="8b058ab07e4dc2e529759a0517728499df37ca9e54bff1d1161765005e6babe4" exitCode=255
Jul 15 18:51:16.878175 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.878145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lst2h" event={"ID":"7af06135-7c6a-40fb-a835-967e12272c28","Type":"ContainerDied","Data":"8b058ab07e4dc2e529759a0517728499df37ca9e54bff1d1161765005e6babe4"}
Jul 15 18:51:16.878341 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.878326    2562 scope.go:117] "RemoveContainer" containerID="8b058ab07e4dc2e529759a0517728499df37ca9e54bff1d1161765005e6babe4"
Jul 15 18:51:16.880826 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.879683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2" event={"ID":"44cfea73-0599-4874-9390-aa430cb967ee","Type":"ContainerStarted","Data":"c87b361474969548024394c40ed9f98f7cabe45ab9a92ff97acb59edf2c4d675"}
Jul 15 18:51:16.881154 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.881135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf" event={"ID":"09f51599-39a1-4b35-8546-d81177619edf","Type":"ContainerStarted","Data":"007fd4ab362f9d077c91150d3e6f16a64f7f2a6146bd4a78378db177c8094e44"}
Jul 15 18:51:16.900909 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.900861    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7wccv" podStartSLOduration=3.12846665 podStartE2EDuration="10.900843251s" totalImagesPullingTime="7.772376601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:16.899309562 +0000 UTC m=+46.010616098" watchObservedRunningTime="2026-07-15 18:51:16.900843251 +0000 UTC m=+46.012149766"
Jul 15 18:51:16.918355 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.918289    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf" podStartSLOduration=20.195839428 podStartE2EDuration="27.918274146s" totalImagesPullingTime="7.722434718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:16.918157859 +0000 UTC m=+46.029464376" watchObservedRunningTime="2026-07-15 18:51:16.918274146 +0000 UTC m=+46.029580660"
Jul 15 18:51:16.961689 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.961625    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf" podStartSLOduration=20.192274957 podStartE2EDuration="27.961606143s" totalImagesPullingTime="7.769331186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:16.960080815 +0000 UTC m=+46.071387353" watchObservedRunningTime="2026-07-15 18:51:16.961606143 +0000 UTC m=+46.072912658"
Jul 15 18:51:16.990328 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:16.990286    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7bvx2" podStartSLOduration=20.325386363 podStartE2EDuration="27.990269989s" totalImagesPullingTime="7.664883626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:16.989232304 +0000 UTC m=+46.100538821" watchObservedRunningTime="2026-07-15 18:51:16.990269989 +0000 UTC m=+46.101576517"
Jul 15 18:51:17.015501 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.015435    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-sntfz" podStartSLOduration=20.24061788 podStartE2EDuration="28.015411973s" totalImagesPullingTime="7.774794093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:17.01419562 +0000 UTC m=+46.125502133" watchObservedRunningTime="2026-07-15 18:51:17.015411973 +0000 UTC m=+46.126718488"
Jul 15 18:51:17.169958 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.169835    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf" podStartSLOduration=20.403556113 podStartE2EDuration="28.169817042s" totalImagesPullingTime="7.766260929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:17.056757913 +0000 UTC m=+46.168064429" watchObservedRunningTime="2026-07-15 18:51:17.169817042 +0000 UTC m=+46.281123556"
Jul 15 18:51:17.171061 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.171040    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"]
Jul 15 18:51:17.183259 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.183227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:17.183394 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:17.183377    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 18:51:17.183450 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:17.183440    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert podName:69e4df55-2061-4d92-b1c1-42a8abfe7067 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:18.183425052 +0000 UTC m=+47.294731548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bwwsw" (UID: "69e4df55-2061-4d92-b1c1-42a8abfe7067") : secret "networking-console-plugin-cert" not found
Jul 15 18:51:17.184114 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.184101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"
Jul 15 18:51:17.186895 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.186833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"]
Jul 15 18:51:17.187210 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.187187    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 18:51:17.187438 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.187412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bhsvj\""
Jul 15 18:51:17.187532 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.187515    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 18:51:17.284608 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.284557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t24j\" (UniqueName: \"kubernetes.io/projected/182757e4-04c0-4664-9a4b-7899b4321235-kube-api-access-5t24j\") pod \"migrator-7f59b54f6c-jskpd\" (UID: \"182757e4-04c0-4664-9a4b-7899b4321235\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"
Jul 15 18:51:17.385548 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.385503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t24j\" (UniqueName: \"kubernetes.io/projected/182757e4-04c0-4664-9a4b-7899b4321235-kube-api-access-5t24j\") pod \"migrator-7f59b54f6c-jskpd\" (UID: \"182757e4-04c0-4664-9a4b-7899b4321235\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"
Jul 15 18:51:17.397217 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.397188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t24j\" (UniqueName: \"kubernetes.io/projected/182757e4-04c0-4664-9a4b-7899b4321235-kube-api-access-5t24j\") pod \"migrator-7f59b54f6c-jskpd\" (UID: \"182757e4-04c0-4664-9a4b-7899b4321235\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"
Jul 15 18:51:17.495189 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.495156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"
Jul 15 18:51:17.667956 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.667920    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd"]
Jul 15 18:51:17.671402 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:17.671374    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182757e4_04c0_4664_9a4b_7899b4321235.slice/crio-03104ea9247cc7da1d03859d988ff6387e01794ab2b05f285c23a44eb4b148cb WatchSource:0}: Error finding container 03104ea9247cc7da1d03859d988ff6387e01794ab2b05f285c23a44eb4b148cb: Status 404 returned error can't find the container with id 03104ea9247cc7da1d03859d988ff6387e01794ab2b05f285c23a44eb4b148cb
Jul 15 18:51:17.889482 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.889401    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 18:51:17.889885 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.889866    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/0.log"
Jul 15 18:51:17.889962 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.889910    2562 generic.go:356] "Generic (PLEG): container finished" podID="7af06135-7c6a-40fb-a835-967e12272c28" containerID="cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e" exitCode=255
Jul 15 18:51:17.890010 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.889985    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lst2h" event={"ID":"7af06135-7c6a-40fb-a835-967e12272c28","Type":"ContainerDied","Data":"cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e"}
Jul 15 18:51:17.890125 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.890082    2562 scope.go:117] "RemoveContainer" containerID="8b058ab07e4dc2e529759a0517728499df37ca9e54bff1d1161765005e6babe4"
Jul 15 18:51:17.890384 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.890360    2562 scope.go:117] "RemoveContainer" containerID="cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e"
Jul 15 18:51:17.890592 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:17.890552    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lst2h_openshift-console-operator(7af06135-7c6a-40fb-a835-967e12272c28)\"" pod="openshift-console-operator/console-operator-7866497494-lst2h" podUID="7af06135-7c6a-40fb-a835-967e12272c28"
Jul 15 18:51:17.891469 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:17.891428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd" event={"ID":"182757e4-04c0-4664-9a4b-7899b4321235","Type":"ContainerStarted","Data":"03104ea9247cc7da1d03859d988ff6387e01794ab2b05f285c23a44eb4b148cb"}
Jul 15 18:51:18.193841 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.193798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:18.194012 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.193958    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 18:51:18.194050 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.194035    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert podName:69e4df55-2061-4d92-b1c1-42a8abfe7067 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:20.194020232 +0000 UTC m=+49.305326725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bwwsw" (UID: "69e4df55-2061-4d92-b1c1-42a8abfe7067") : secret "networking-console-plugin-cert" not found
Jul 15 18:51:18.381266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.381222    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bfhdd"]
Jul 15 18:51:18.393065 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.393035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.395976 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.395948    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 18:51:18.396155 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.396131    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hvwrn\""
Jul 15 18:51:18.396529 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.396513    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 18:51:18.400878 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.400858    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfhdd"]
Jul 15 18:51:18.496791 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.496720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-crio-socket\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.496791 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.496757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgw8\" (UniqueName: \"kubernetes.io/projected/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-api-access-slgw8\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.497212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.496917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-data-volume\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.497212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.496957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.497212 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.496994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597511 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-crio-socket\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597511 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgw8\" (UniqueName: \"kubernetes.io/projected/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-api-access-slgw8\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-crio-socket\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597776 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-data-volume\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597818 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597850 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.597840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.597960 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.597946    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:51:18.597993 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.597960    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:18.598023 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.598014    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:19.097994458 +0000 UTC m=+48.209300955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:18.598059 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.598030    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:19.098021906 +0000 UTC m=+48.209328399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : configmap "kube-rbac-proxy" not found
Jul 15 18:51:18.598059 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.598035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-data-volume\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.609119 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.609085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgw8\" (UniqueName: \"kubernetes.io/projected/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-api-access-slgw8\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:18.896418 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.896345    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 18:51:18.896744 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:18.896727    2562 scope.go:117] "RemoveContainer" containerID="cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e"
Jul 15 18:51:18.896951 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:18.896928    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lst2h_openshift-console-operator(7af06135-7c6a-40fb-a835-967e12272c28)\"" pod="openshift-console-operator/console-operator-7866497494-lst2h" podUID="7af06135-7c6a-40fb-a835-967e12272c28"
Jul 15 18:51:19.103161 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.103123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:19.103347 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.103170    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:19.103347 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:19.103304    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:19.103347 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:19.103330    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:51:19.103508 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:19.103381    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:20.103361078 +0000 UTC m=+49.214667588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:19.103508 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:19.103401    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:20.103390781 +0000 UTC m=+49.214697276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : configmap "kube-rbac-proxy" not found
Jul 15 18:51:19.291584 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.291544    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-7pqtq"]
Jul 15 18:51:19.322971 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.322941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-7pqtq"]
Jul 15 18:51:19.323115 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.323067    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.326264 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.326237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 18:51:19.326410 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.326348    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 18:51:19.326410 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.326374    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 18:51:19.326774 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.326756    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9h6zh\""
Jul 15 18:51:19.326834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.326796    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 18:51:19.507979 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.507947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b4nf\" (UniqueName: \"kubernetes.io/projected/7576b7e1-b5eb-452b-b44d-73c499aba179-kube-api-access-7b4nf\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.508327 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.508057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-key\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.508327 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.508076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-cabundle\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.608683 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.608592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-key\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.608683 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.608636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-cabundle\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.608904 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.608785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b4nf\" (UniqueName: \"kubernetes.io/projected/7576b7e1-b5eb-452b-b44d-73c499aba179-kube-api-access-7b4nf\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.609484 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.609363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-cabundle\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.611193 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.611169    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7576b7e1-b5eb-452b-b44d-73c499aba179-signing-key\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.616832 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.616811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b4nf\" (UniqueName: \"kubernetes.io/projected/7576b7e1-b5eb-452b-b44d-73c499aba179-kube-api-access-7b4nf\") pod \"service-ca-79f68b9f4f-7pqtq\" (UID: \"7576b7e1-b5eb-452b-b44d-73c499aba179\") " pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.633889 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.633866    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq"
Jul 15 18:51:19.900311 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.900284    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-7pqtq"]
Jul 15 18:51:19.902154 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:19.902128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd" event={"ID":"182757e4-04c0-4664-9a4b-7899b4321235","Type":"ContainerStarted","Data":"c7b786d53e3b8c5f0c82c1b4c42f68a08818d706ec9b76a4b88c958f9ae74d1a"}
Jul 15 18:51:19.904702 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:19.904384    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7576b7e1_b5eb_452b_b44d_73c499aba179.slice/crio-580be4f90cb3a4489bd9bbe4531604730dd79ef54cb89aa0473d80b1915fb763 WatchSource:0}: Error finding container 580be4f90cb3a4489bd9bbe4531604730dd79ef54cb89aa0473d80b1915fb763: Status 404 returned error can't find the container with id 580be4f90cb3a4489bd9bbe4531604730dd79ef54cb89aa0473d80b1915fb763
Jul 15 18:51:20.114921 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.114881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:20.115118 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.114930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:20.115118 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.115049    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:20.115118 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.115077    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:51:20.115118 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.115118    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.115103805 +0000 UTC m=+51.226410298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:20.115311 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.115133    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:22.115126923 +0000 UTC m=+51.226433416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : configmap "kube-rbac-proxy" not found
Jul 15 18:51:20.216189 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.216149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:20.216359 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.216322    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 18:51:20.216404 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:20.216391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert podName:69e4df55-2061-4d92-b1c1-42a8abfe7067 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:24.216374862 +0000 UTC m=+53.327681356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bwwsw" (UID: "69e4df55-2061-4d92-b1c1-42a8abfe7067") : secret "networking-console-plugin-cert" not found
Jul 15 18:51:20.564029 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.563946    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stb4z_32b4affa-a511-4ed5-8efa-e039902c0a90/dns-node-resolver/0.log"
Jul 15 18:51:20.907990 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.907900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd" event={"ID":"182757e4-04c0-4664-9a4b-7899b4321235","Type":"ContainerStarted","Data":"02d2b4e5e71585c3329c1b7a9f2e611911b51fe31e0db963856f3ae0c63ccd45"}
Jul 15 18:51:20.909437 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.909397    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq" event={"ID":"7576b7e1-b5eb-452b-b44d-73c499aba179","Type":"ContainerStarted","Data":"e1f13f6c188f7b3492ca7cc803f3dc0ce802b1ac186158e35a43bbb497d271f6"}
Jul 15 18:51:20.909589 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.909451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq" event={"ID":"7576b7e1-b5eb-452b-b44d-73c499aba179","Type":"ContainerStarted","Data":"580be4f90cb3a4489bd9bbe4531604730dd79ef54cb89aa0473d80b1915fb763"}
Jul 15 18:51:20.927701 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.927620    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-jskpd" podStartSLOduration=1.831021939 podStartE2EDuration="3.927598769s" totalImagesPullingTime="2.09657683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:20.926332548 +0000 UTC m=+50.037639065" watchObservedRunningTime="2026-07-15 18:51:20.927598769 +0000 UTC m=+50.038905288"
Jul 15 18:51:20.948675 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:20.948612    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-7pqtq" podStartSLOduration=1.948593638 podStartE2EDuration="1.948593638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:20.948311507 +0000 UTC m=+50.059618023" watchObservedRunningTime="2026-07-15 18:51:20.948593638 +0000 UTC m=+50.059900153"
Jul 15 18:51:21.365095 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:21.365026    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzwzk_782738dc-bbda-4dac-81fa-3bd0c9eb1cf5/node-ca/0.log"
Jul 15 18:51:21.962702 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:21.962676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wccv_9ed1afa1-9bf3-46f3-85c7-e47d161c4d54/serve-healthcheck-canary/0.log"
Jul 15 18:51:22.134462 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134527    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134608    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134621    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:22.134654 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134638    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134623    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.134659716 +0000 UTC m=+67.245966211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : secret "router-metrics-certs-default" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134686    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134690    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134704    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls podName:4c3db7f6-a103-4a53-bfde-668821d83785 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.134694535 +0000 UTC m=+67.246001035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jgbqc" (UID: "4c3db7f6-a103-4a53-bfde-668821d83785") : secret "cluster-monitoring-operator-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134728    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:26.134719881 +0000 UTC m=+55.246026375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134747    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls podName:cbb1024b-ebc0-48b1-a66a-2e04eaa82c74 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.13473933 +0000 UTC m=+67.246045846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls") pod "cluster-samples-operator-65db858894-glk5f" (UID: "cbb1024b-ebc0-48b1-a66a-2e04eaa82c74") : secret "samples-operator-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle podName:238d2bad-610b-47c4-bb77-eb08fa07c7c5 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.13475627 +0000 UTC m=+67.246062763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle") pod "router-default-7b987544d6-22jms" (UID: "238d2bad-610b-47c4-bb77-eb08fa07c7c5") : configmap references non-existent config key: service-ca.crt
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134772    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:26.134766901 +0000 UTC m=+55.246073394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : configmap "kube-rbac-proxy" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.134801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134918    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 18:51:22.134923 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134926    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66bcdfdf68-bcxhw: secret "image-registry-tls" not found
Jul 15 18:51:22.135269 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.134955    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls podName:56d871c1-7a1e-4c62-b62f-fbd9d070f674 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.134944347 +0000 UTC m=+67.246250840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls") pod "image-registry-66bcdfdf68-bcxhw" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674") : secret "image-registry-tls" not found
Jul 15 18:51:22.164282 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.164255    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jskpd_182757e4-04c0-4664-9a4b-7899b4321235/migrator/0.log"
Jul 15 18:51:22.236249 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.236148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:22.236405 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.236295    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 18:51:22.236405 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:22.236358    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls podName:d804f410-ec9a-4c74-addc-df3211085594 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:38.236342866 +0000 UTC m=+67.347649359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls") pod "dns-default-m7dmm" (UID: "d804f410-ec9a-4c74-addc-df3211085594") : secret "dns-default-metrics-tls" not found
Jul 15 18:51:22.367391 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.367363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jskpd_182757e4-04c0-4664-9a4b-7899b4321235/graceful-termination/0.log"
Jul 15 18:51:22.564585 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:22.564481    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-g42sf_09f51599-39a1-4b35-8546-d81177619edf/kube-storage-version-migrator-operator/0.log"
Jul 15 18:51:24.251890 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:24.251848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:24.252442 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:24.252018    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 18:51:24.252442 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:24.252105    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert podName:69e4df55-2061-4d92-b1c1-42a8abfe7067 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:32.252083851 +0000 UTC m=+61.363390364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-bwwsw" (UID: "69e4df55-2061-4d92-b1c1-42a8abfe7067") : secret "networking-console-plugin-cert" not found
Jul 15 18:51:26.167817 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.167786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:26.168303 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.167827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:26.168303 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:26.167989    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:26.168303 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:26.168054    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls podName:6f4de0f4-dcc9-45f4-b357-4ddd1defd302 nodeName:}" failed. No retries permitted until 2026-07-15 18:51:34.168038997 +0000 UTC m=+63.279345495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bfhdd" (UID: "6f4de0f4-dcc9-45f4-b357-4ddd1defd302") : secret "insights-runtime-extractor-tls" not found
Jul 15 18:51:26.168590 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.168545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:26.614756 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.614714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:26.614958 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.614782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:26.615193 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:26.615176    2562 scope.go:117] "RemoveContainer" containerID="cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e"
Jul 15 18:51:26.615432 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:51:26.615406    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lst2h_openshift-console-operator(7af06135-7c6a-40fb-a835-967e12272c28)\"" pod="openshift-console-operator/console-operator-7866497494-lst2h" podUID="7af06135-7c6a-40fb-a835-967e12272c28"
Jul 15 18:51:31.787215 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:31.787188    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65s8b"
Jul 15 18:51:32.328510 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.328469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:32.330911 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.330887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69e4df55-2061-4d92-b1c1-42a8abfe7067-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-bwwsw\" (UID: \"69e4df55-2061-4d92-b1c1-42a8abfe7067\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:32.365907 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.365870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n7qc4\""
Jul 15 18:51:32.373503 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.373469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"
Jul 15 18:51:32.532173 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.532144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-bwwsw"]
Jul 15 18:51:32.535042 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:32.535011    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e4df55_2061_4d92_b1c1_42a8abfe7067.slice/crio-3b351b04c953afea015939a74051e5b042647b72d0766a0960d37a4523ffbcbd WatchSource:0}: Error finding container 3b351b04c953afea015939a74051e5b042647b72d0766a0960d37a4523ffbcbd: Status 404 returned error can't find the container with id 3b351b04c953afea015939a74051e5b042647b72d0766a0960d37a4523ffbcbd
Jul 15 18:51:32.951103 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:32.951067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw" event={"ID":"69e4df55-2061-4d92-b1c1-42a8abfe7067","Type":"ContainerStarted","Data":"3b351b04c953afea015939a74051e5b042647b72d0766a0960d37a4523ffbcbd"}
Jul 15 18:51:33.955819 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:33.955781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw" event={"ID":"69e4df55-2061-4d92-b1c1-42a8abfe7067","Type":"ContainerStarted","Data":"ce0245c7e2aa31be858415a87aa16d6de37daf919773df15e4f97059f27c0807"}
Jul 15 18:51:33.973518 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:33.973415    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-bwwsw" podStartSLOduration=16.790573167 podStartE2EDuration="17.973397853s" totalImagesPullingTime="1.182824686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:33.97193616 +0000 UTC m=+63.083242676" watchObservedRunningTime="2026-07-15 18:51:33.973397853 +0000 UTC m=+63.084704367"
Jul 15 18:51:34.246828 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.246739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:34.249234 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.249202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6f4de0f4-dcc9-45f4-b357-4ddd1defd302-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bfhdd\" (UID: \"6f4de0f4-dcc9-45f4-b357-4ddd1defd302\") " pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:34.310347 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.310316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hvwrn\""
Jul 15 18:51:34.317840 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.317816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bfhdd"
Jul 15 18:51:34.448848 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.448815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bfhdd"]
Jul 15 18:51:34.452034 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:34.452007    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f4de0f4_dcc9_45f4_b357_4ddd1defd302.slice/crio-110e3c572bd3cb688acaeb0e32f0c779cd5038a4857ee5adf1583885894a735a WatchSource:0}: Error finding container 110e3c572bd3cb688acaeb0e32f0c779cd5038a4857ee5adf1583885894a735a: Status 404 returned error can't find the container with id 110e3c572bd3cb688acaeb0e32f0c779cd5038a4857ee5adf1583885894a735a
Jul 15 18:51:34.962082 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:34.962047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfhdd" event={"ID":"6f4de0f4-dcc9-45f4-b357-4ddd1defd302","Type":"ContainerStarted","Data":"110e3c572bd3cb688acaeb0e32f0c779cd5038a4857ee5adf1583885894a735a"}
Jul 15 18:51:36.064118 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.064082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:36.067097 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.067068    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 18:51:36.077955 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.077923    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/859d557e-a010-4ab5-9068-ebf1a525e957-metrics-certs\") pod \"network-metrics-daemon-9gr6t\" (UID: \"859d557e-a010-4ab5-9068-ebf1a525e957\") " pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:36.134082 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.134051    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nvc9\""
Jul 15 18:51:36.142253 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.142211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9gr6t"
Jul 15 18:51:36.165260 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.165228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:36.168739 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.168710    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 18:51:36.178758 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.178726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/052485cd-74e9-4c40-8fc3-4efc09ec052d-original-pull-secret\") pod \"global-pull-secret-syncer-kvjqc\" (UID: \"052485cd-74e9-4c40-8fc3-4efc09ec052d\") " pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:36.266384 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.266350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:36.269487 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.269461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfp55\" (UniqueName: \"kubernetes.io/projected/d7e2a0cf-1547-4851-a861-11b9855b2830-kube-api-access-lfp55\") pod \"network-check-target-4ddsc\" (UID: \"d7e2a0cf-1547-4851-a861-11b9855b2830\") " pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:36.295467 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.295427    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9gr6t"]
Jul 15 18:51:36.298632 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:36.298593    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859d557e_a010_4ab5_9068_ebf1a525e957.slice/crio-e7c2c3c917ca2ca66cad27da7557ab5cbf65e1cc373785feec8cae32cefe2a19 WatchSource:0}: Error finding container e7c2c3c917ca2ca66cad27da7557ab5cbf65e1cc373785feec8cae32cefe2a19: Status 404 returned error can't find the container with id e7c2c3c917ca2ca66cad27da7557ab5cbf65e1cc373785feec8cae32cefe2a19
Jul 15 18:51:36.426257 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.426174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvjqc"
Jul 15 18:51:36.530186 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.529990    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rz9k9\""
Jul 15 18:51:36.537343 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.537113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:36.571943 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.571919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kvjqc"]
Jul 15 18:51:36.679073 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.679002    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4ddsc"]
Jul 15 18:51:36.977328 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:36.977279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gr6t" event={"ID":"859d557e-a010-4ab5-9068-ebf1a525e957","Type":"ContainerStarted","Data":"e7c2c3c917ca2ca66cad27da7557ab5cbf65e1cc373785feec8cae32cefe2a19"}
Jul 15 18:51:38.187590 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.187528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:38.187590 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.187597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:38.188138 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.187631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:38.188138 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.187734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:38.188138 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.187799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:38.188415 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.188385    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/238d2bad-610b-47c4-bb77-eb08fa07c7c5-service-ca-bundle\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:38.190584 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.190538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"image-registry-66bcdfdf68-bcxhw\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") " pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:38.190708 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.190616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238d2bad-610b-47c4-bb77-eb08fa07c7c5-metrics-certs\") pod \"router-default-7b987544d6-22jms\" (UID: \"238d2bad-610b-47c4-bb77-eb08fa07c7c5\") " pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:38.190807 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.190787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c3db7f6-a103-4a53-bfde-668821d83785-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jgbqc\" (UID: \"4c3db7f6-a103-4a53-bfde-668821d83785\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:38.190859 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.190820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbb1024b-ebc0-48b1-a66a-2e04eaa82c74-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-glk5f\" (UID: \"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:38.288273 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.288234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:38.290705 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.290675    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d804f410-ec9a-4c74-addc-df3211085594-metrics-tls\") pod \"dns-default-m7dmm\" (UID: \"d804f410-ec9a-4c74-addc-df3211085594\") " pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:38.367721 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.367692    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-clx8d\""
Jul 15 18:51:38.375059 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.375026    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"
Jul 15 18:51:38.384135 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.384095    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qfhtc\""
Jul 15 18:51:38.391697 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.391674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"
Jul 15 18:51:38.406902 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.406885    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vb6tl\""
Jul 15 18:51:38.414196 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.414180    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:38.449538 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.449467    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mhqlx\""
Jul 15 18:51:38.455512 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.455493    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mxlws\""
Jul 15 18:51:38.457374 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.457359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:38.463597 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.463563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:38.876380 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:38.874952    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052485cd_74e9_4c40_8fc3_4efc09ec052d.slice/crio-79e01ef8a0669356492c47911843687ed960da86c286907333ddb2e401619921 WatchSource:0}: Error finding container 79e01ef8a0669356492c47911843687ed960da86c286907333ddb2e401619921: Status 404 returned error can't find the container with id 79e01ef8a0669356492c47911843687ed960da86c286907333ddb2e401619921
Jul 15 18:51:38.884616 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:38.884583    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e2a0cf_1547_4851_a861_11b9855b2830.slice/crio-3344710efe08c032b0b9073defb8eeb85314686c469ad9be3945f595cde8d07c WatchSource:0}: Error finding container 3344710efe08c032b0b9073defb8eeb85314686c469ad9be3945f595cde8d07c: Status 404 returned error can't find the container with id 3344710efe08c032b0b9073defb8eeb85314686c469ad9be3945f595cde8d07c
Jul 15 18:51:38.987588 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.987485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ddsc" event={"ID":"d7e2a0cf-1547-4851-a861-11b9855b2830","Type":"ContainerStarted","Data":"3344710efe08c032b0b9073defb8eeb85314686c469ad9be3945f595cde8d07c"}
Jul 15 18:51:38.988957 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:38.988926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kvjqc" event={"ID":"052485cd-74e9-4c40-8fc3-4efc09ec052d","Type":"ContainerStarted","Data":"79e01ef8a0669356492c47911843687ed960da86c286907333ddb2e401619921"}
Jul 15 18:51:39.483407 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:39.483371    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f"]
Jul 15 18:51:39.502175 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:39.502145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc"]
Jul 15 18:51:40.086731 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.086640    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"]
Jul 15 18:51:40.093366 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.093324    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"]
Jul 15 18:51:40.093534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.093466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.095988 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.095962    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"]
Jul 15 18:51:40.096905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.096877    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 18:51:40.097130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.097114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.098177 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.098153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 18:51:40.098910 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.098390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kj74s\""
Jul 15 18:51:40.098910 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.098565    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 18:51:40.098910 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.098763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 18:51:40.102777 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.099840    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 18:51:40.102777 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.101707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.103146 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.102974    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 18:51:40.103221 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.103202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 18:51:40.103855 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.103510    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 18:51:40.105044 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.104985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"]
Jul 15 18:51:40.115352 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.114476    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 18:51:40.117352 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.117287    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"]
Jul 15 18:51:40.118607 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.118562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"]
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d69183eb-760e-4709-8c25-e083f1fa0852-klusterlet-config\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt9tk\" (UniqueName: \"kubernetes.io/projected/5d160ad5-45de-4a38-b74f-ee829e4c0113-kube-api-access-kt9tk\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d160ad5-45de-4a38-b74f-ee829e4c0113-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p758\" (UniqueName: \"kubernetes.io/projected/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-kube-api-access-9p758\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d69183eb-760e-4709-8c25-e083f1fa0852-tmp\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7m8m\" (UniqueName: \"kubernetes.io/projected/d69183eb-760e-4709-8c25-e083f1fa0852-kube-api-access-b7m8m\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.205379 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.204987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.295888 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:40.295650    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178 WatchSource:0}: Error finding container f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178: Status 404 returned error can't find the container with id f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d69183eb-760e-4709-8c25-e083f1fa0852-klusterlet-config\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt9tk\" (UniqueName: \"kubernetes.io/projected/5d160ad5-45de-4a38-b74f-ee829e4c0113-kube-api-access-kt9tk\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d160ad5-45de-4a38-b74f-ee829e4c0113-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p758\" (UniqueName: \"kubernetes.io/projected/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-kube-api-access-9p758\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d69183eb-760e-4709-8c25-e083f1fa0852-tmp\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7m8m\" (UniqueName: \"kubernetes.io/projected/d69183eb-760e-4709-8c25-e083f1fa0852-kube-api-access-b7m8m\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.309493 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.308690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.313840 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.311100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-additional-service-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.317033 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.316253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d69183eb-760e-4709-8c25-e083f1fa0852-tmp\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.319542 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.319411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:51:40.327136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.327103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5d160ad5-45de-4a38-b74f-ee829e4c0113-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.327800 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.327533    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-ca\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.327970 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.327795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.329526 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.329484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d69183eb-760e-4709-8c25-e083f1fa0852-klusterlet-config\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.330868 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.330713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-hub\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.331424 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.331386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.333204 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.333151    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt9tk\" (UniqueName: \"kubernetes.io/projected/5d160ad5-45de-4a38-b74f-ee829e4c0113-kube-api-access-kt9tk\") pod \"managed-serviceaccount-addon-agent-54564f8466-4gjp4\" (UID: \"5d160ad5-45de-4a38-b74f-ee829e4c0113\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.353421 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.348641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p758\" (UniqueName: \"kubernetes.io/projected/4a8fa2c5-6cf8-43f5-abbd-7f39c706a269-kube-api-access-9p758\") pod \"cluster-proxy-proxy-agent-54b6d59f59-d48wt\" (UID: \"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.353644 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.353546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7m8m\" (UniqueName: \"kubernetes.io/projected/d69183eb-760e-4709-8c25-e083f1fa0852-kube-api-access-b7m8m\") pod \"klusterlet-addon-workmgr-79764557db-6hqg5\" (UID: \"d69183eb-760e-4709-8c25-e083f1fa0852\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.398270 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.398169    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m7dmm"]
Jul 15 18:51:40.402190 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:40.402155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd804f410_ec9a_4c74_addc_df3211085594.slice/crio-9ab1d5ae1c11256020f080c862bcfff26521e1bb289f78523a0e7317b8ac0741 WatchSource:0}: Error finding container 9ab1d5ae1c11256020f080c862bcfff26521e1bb289f78523a0e7317b8ac0741: Status 404 returned error can't find the container with id 9ab1d5ae1c11256020f080c862bcfff26521e1bb289f78523a0e7317b8ac0741
Jul 15 18:51:40.413294 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.413271    2562 scope.go:117] "RemoveContainer" containerID="cf0c2a509bee7b2ded6cf7871094f482ff446aec6f7fb74016cc7f3c7967202e"
Jul 15 18:51:40.422819 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.422752    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b987544d6-22jms"]
Jul 15 18:51:40.434684 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:40.434513    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238d2bad_610b_47c4_bb77_eb08fa07c7c5.slice/crio-0ce1cd6907c414be008cba7cd2cb4224c22134cac71eff02da4ce5ba5060672d WatchSource:0}: Error finding container 0ce1cd6907c414be008cba7cd2cb4224c22134cac71eff02da4ce5ba5060672d: Status 404 returned error can't find the container with id 0ce1cd6907c414be008cba7cd2cb4224c22134cac71eff02da4ce5ba5060672d
Jul 15 18:51:40.456658 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.456437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"
Jul 15 18:51:40.478534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.478139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"
Jul 15 18:51:40.530996 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.530744    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:40.707739 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.705715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4"]
Jul 15 18:51:40.745597 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.745541    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt"]
Jul 15 18:51:40.749475 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:40.749445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a8fa2c5_6cf8_43f5_abbd_7f39c706a269.slice/crio-ebe27c0bec01b7d98b826784c3d2a42dda46002be085619af87e58a22b44efab WatchSource:0}: Error finding container ebe27c0bec01b7d98b826784c3d2a42dda46002be085619af87e58a22b44efab: Status 404 returned error can't find the container with id ebe27c0bec01b7d98b826784c3d2a42dda46002be085619af87e58a22b44efab
Jul 15 18:51:40.771660 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:40.771591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"]
Jul 15 18:51:40.777322 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:51:40.777287    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69183eb_760e_4709_8c25_e083f1fa0852.slice/crio-ecc25d1f6afea7d93e9df5011cd82c2f43d01853d156cb1bb5d3e38c98e7f1ae WatchSource:0}: Error finding container ecc25d1f6afea7d93e9df5011cd82c2f43d01853d156cb1bb5d3e38c98e7f1ae: Status 404 returned error can't find the container with id ecc25d1f6afea7d93e9df5011cd82c2f43d01853d156cb1bb5d3e38c98e7f1ae
Jul 15 18:51:41.009901 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.009285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4ddsc" event={"ID":"d7e2a0cf-1547-4851-a861-11b9855b2830","Type":"ContainerStarted","Data":"c55f7434c5a359619789591203d8b571d2caa89acf702aadd11b7070c7d9e7ea"}
Jul 15 18:51:41.009901 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.009646    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:51:41.013059 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.012998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5" event={"ID":"d69183eb-760e-4709-8c25-e083f1fa0852","Type":"ContainerStarted","Data":"ecc25d1f6afea7d93e9df5011cd82c2f43d01853d156cb1bb5d3e38c98e7f1ae"}
Jul 15 18:51:41.016051 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.014749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b987544d6-22jms" event={"ID":"238d2bad-610b-47c4-bb77-eb08fa07c7c5","Type":"ContainerStarted","Data":"8bc189080d408b6af42dc449097d59b83cd2b2f6d78b6dc451a35e95b1cf62c7"}
Jul 15 18:51:41.016051 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.014788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b987544d6-22jms" event={"ID":"238d2bad-610b-47c4-bb77-eb08fa07c7c5","Type":"ContainerStarted","Data":"0ce1cd6907c414be008cba7cd2cb4224c22134cac71eff02da4ce5ba5060672d"}
Jul 15 18:51:41.031712 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.031150    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4ddsc" podStartSLOduration=69.031128342 podStartE2EDuration="1m9.031128342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:41.02964152 +0000 UTC m=+70.140948059" watchObservedRunningTime="2026-07-15 18:51:41.031128342 +0000 UTC m=+70.142434838"
Jul 15 18:51:41.032866 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.032180    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" event={"ID":"56d871c1-7a1e-4c62-b62f-fbd9d070f674","Type":"ContainerStarted","Data":"66248bf2025cafb22672ff93108445424915271baa9595417639a474e37d32e2"}
Jul 15 18:51:41.032866 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.032229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" event={"ID":"56d871c1-7a1e-4c62-b62f-fbd9d070f674","Type":"ContainerStarted","Data":"f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178"}
Jul 15 18:51:41.032866 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.032827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:51:41.036373 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.036320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt" event={"ID":"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269","Type":"ContainerStarted","Data":"ebe27c0bec01b7d98b826784c3d2a42dda46002be085619af87e58a22b44efab"}
Jul 15 18:51:41.038550 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.038478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f" event={"ID":"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74","Type":"ContainerStarted","Data":"25b8db35858c862cdd9bf5e73c538f6aa92871423772012cd22f65640cdb0365"}
Jul 15 18:51:41.041307 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.041232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfhdd" event={"ID":"6f4de0f4-dcc9-45f4-b357-4ddd1defd302","Type":"ContainerStarted","Data":"a6206b06d12fda08f8f4eb3cef21ca9eb20709221c18f743170292bda5625c4b"}
Jul 15 18:51:41.044170 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.044120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4" event={"ID":"5d160ad5-45de-4a38-b74f-ee829e4c0113","Type":"ContainerStarted","Data":"4bf6c3db5b9ce4a4d96a3e2a5c0f694056e223b5737d919ecbece096b74d8a0f"}
Jul 15 18:51:41.048831 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.048747    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7dmm" event={"ID":"d804f410-ec9a-4c74-addc-df3211085594","Type":"ContainerStarted","Data":"9ab1d5ae1c11256020f080c862bcfff26521e1bb289f78523a0e7317b8ac0741"}
Jul 15 18:51:41.052516 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.052488    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 18:51:41.052658 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.052603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lst2h" event={"ID":"7af06135-7c6a-40fb-a835-967e12272c28","Type":"ContainerStarted","Data":"aa21f8549ffcb6b89579acb43f6531193c9f7c127f1b6a9057a427538816c066"}
Jul 15 18:51:41.054716 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.054693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:41.057803 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.057741    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gr6t" event={"ID":"859d557e-a010-4ab5-9068-ebf1a525e957","Type":"ContainerStarted","Data":"f63b58b40b613d01877e3ff05d66678361fc0ba74d3a35d1a48fd9f547c87efb"}
Jul 15 18:51:41.057803 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.057792    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9gr6t" event={"ID":"859d557e-a010-4ab5-9068-ebf1a525e957","Type":"ContainerStarted","Data":"730df129542d0c0f94bb5ab976fd8a1f8572329f997d4de406950363dc520e4f"}
Jul 15 18:51:41.060496 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.060422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc" event={"ID":"4c3db7f6-a103-4a53-bfde-668821d83785","Type":"ContainerStarted","Data":"a9353e8e2b370f3d5102e717146d772a630dfbf2b883fad65ae17437db270650"}
Jul 15 18:51:41.084602 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.084172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b987544d6-22jms" podStartSLOduration=52.084151215 podStartE2EDuration="52.084151215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:41.063919123 +0000 UTC m=+70.175225639" watchObservedRunningTime="2026-07-15 18:51:41.084151215 +0000 UTC m=+70.195457731"
Jul 15 18:51:41.085221 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.085182    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9gr6t" podStartSLOduration=66.167134403 podStartE2EDuration="1m10.085170898s" totalImagesPullingTime="3.918036495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:41.083992732 +0000 UTC m=+70.195299247" watchObservedRunningTime="2026-07-15 18:51:41.085170898 +0000 UTC m=+70.196477395"
Jul 15 18:51:41.113505 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.112893    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" podStartSLOduration=69.112870377 podStartE2EDuration="1m9.112870377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:41.111619751 +0000 UTC m=+70.222926266" watchObservedRunningTime="2026-07-15 18:51:41.112870377 +0000 UTC m=+70.224176893"
Jul 15 18:51:41.135939 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.135881    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-lst2h" podStartSLOduration=44.414500522 podStartE2EDuration="52.135860158s" totalImagesPullingTime="7.721359636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:41.135285313 +0000 UTC m=+70.246591849" watchObservedRunningTime="2026-07-15 18:51:41.135860158 +0000 UTC m=+70.247166675"
Jul 15 18:51:41.458088 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.458053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:41.461077 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.461048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:41.623147 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:41.622884    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-lst2h"
Jul 15 18:51:42.083610 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:42.083473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:42.085217 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:42.084947    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b987544d6-22jms"
Jul 15 18:51:54.140009 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.139971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kvjqc" event={"ID":"052485cd-74e9-4c40-8fc3-4efc09ec052d","Type":"ContainerStarted","Data":"b688f7478a29e274fbb04e03de455fe3e2e9cd3a9edd45d629cba18a3fe3c4a3"}
Jul 15 18:51:54.141539 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.141500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc" event={"ID":"4c3db7f6-a103-4a53-bfde-668821d83785","Type":"ContainerStarted","Data":"17c09cde5c2ad7f3f9575210da1785c1539a0b533c3bd4b0291fc5a008a34a2e"}
Jul 15 18:51:54.143225 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.143194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5" event={"ID":"d69183eb-760e-4709-8c25-e083f1fa0852","Type":"ContainerStarted","Data":"e65921de17a6e9b0f882922c5d2015ed83cfeab1f28b7ea14afc1b4675a12e1a"}
Jul 15 18:51:54.143365 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.143349    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:54.145601 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.145547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt" event={"ID":"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269","Type":"ContainerStarted","Data":"bdc7297400e298ca2cdfea0418dcaf519f113dc225ddaa7f4d93c58c56124dfd"}
Jul 15 18:51:54.145740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.145613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt" event={"ID":"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269","Type":"ContainerStarted","Data":"5ea1f167b7375aea080b81417dca02b04ef390309f1c5ef6765e13c373cbec40"}
Jul 15 18:51:54.145740 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.145639    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt" event={"ID":"4a8fa2c5-6cf8-43f5-abbd-7f39c706a269","Type":"ContainerStarted","Data":"f8f90791934e9ef75cadfd7c1bf640c953ab854b5a0525367189d3d8b6bd6173"}
Jul 15 18:51:54.146123 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.146101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5"
Jul 15 18:51:54.147566 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.147541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f" event={"ID":"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74","Type":"ContainerStarted","Data":"0cdd484356ad5cd90d704e414fe913bed09dd97d98731bffa831a06d1dde26ea"}
Jul 15 18:51:54.147679 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.147603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f" event={"ID":"cbb1024b-ebc0-48b1-a66a-2e04eaa82c74","Type":"ContainerStarted","Data":"68ecce4277c4568351f6504acd095e1dffb45de0c47370283ed9825b3bf55324"}
Jul 15 18:51:54.149912 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.149884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfhdd" event={"ID":"6f4de0f4-dcc9-45f4-b357-4ddd1defd302","Type":"ContainerStarted","Data":"ba32af219e1efaae3b2769ed1b5c1b36da3450a6834c3eabd1cffe0bd8720855"}
Jul 15 18:51:54.151652 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.151629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4" event={"ID":"5d160ad5-45de-4a38-b74f-ee829e4c0113","Type":"ContainerStarted","Data":"0891a63d5ce039a2ae15f5877dc0cae0145eca62fe501b7884de5911436b283f"}
Jul 15 18:51:54.153706 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.153683    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7dmm" event={"ID":"d804f410-ec9a-4c74-addc-df3211085594","Type":"ContainerStarted","Data":"d05f01104b8d00a51de5cd34c5140885ade77ef112442568a64929574886f0c6"}
Jul 15 18:51:54.153788 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.153734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m7dmm" event={"ID":"d804f410-ec9a-4c74-addc-df3211085594","Type":"ContainerStarted","Data":"2d4981a96478a50a83905227b00ca2c161270b6936f813f2d167e636da853e46"}
Jul 15 18:51:54.153788 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.153775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:51:54.157197 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.156253    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kvjqc" podStartSLOduration=67.680501269 podStartE2EDuration="1m22.156242118s" totalImagesPullingTime="14.475740849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:50:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.1556829 +0000 UTC m=+83.266989417" watchObservedRunningTime="2026-07-15 18:51:54.156242118 +0000 UTC m=+83.267548632"
Jul 15 18:51:54.173014 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.172974    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m7dmm" podStartSLOduration=35.215018653 podStartE2EDuration="48.172958595s" totalImagesPullingTime="12.957939942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.172106907 +0000 UTC m=+83.283413420" watchObservedRunningTime="2026-07-15 18:51:54.172958595 +0000 UTC m=+83.284265119"
Jul 15 18:51:54.191773 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.191715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-54b6d59f59-d48wt" podStartSLOduration=1.542223081 podStartE2EDuration="14.191698242s" totalImagesPullingTime="12.649475161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.190278025 +0000 UTC m=+83.301584541" watchObservedRunningTime="2026-07-15 18:51:54.191698242 +0000 UTC m=+83.303004759"
Jul 15 18:51:54.210173 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.210127    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54564f8466-4gjp4" podStartSLOduration=1.522999334 podStartE2EDuration="14.210111378s" totalImagesPullingTime="12.687112044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.209028554 +0000 UTC m=+83.320335070" watchObservedRunningTime="2026-07-15 18:51:54.210111378 +0000 UTC m=+83.321417894"
Jul 15 18:51:54.227377 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.226122    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-glk5f" podStartSLOduration=53.129258027 podStartE2EDuration="1m5.226111454s" totalImagesPullingTime="12.096853427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.225830733 +0000 UTC m=+83.337137250" watchObservedRunningTime="2026-07-15 18:51:54.226111454 +0000 UTC m=+83.337417970"
Jul 15 18:51:54.241512 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.241462    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jgbqc" podStartSLOduration=52.025956765 podStartE2EDuration="1m5.241445614s" totalImagesPullingTime="13.215488849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.241113923 +0000 UTC m=+83.352420438" watchObservedRunningTime="2026-07-15 18:51:54.241445614 +0000 UTC m=+83.352752132"
Jul 15 18:51:54.262861 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:54.261341    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79764557db-6hqg5" podStartSLOduration=1.6395038469999998 podStartE2EDuration="14.261322149s" totalImagesPullingTime="12.621818302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:54.260486145 +0000 UTC m=+83.371792665" watchObservedRunningTime="2026-07-15 18:51:54.261322149 +0000 UTC m=+83.372628665"
Jul 15 18:51:57.169350 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:57.169316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bfhdd" event={"ID":"6f4de0f4-dcc9-45f4-b357-4ddd1defd302","Type":"ContainerStarted","Data":"12da97cc8f07889c3631bfc0bed15bab34df709e47631145d362b937656f4541"}
Jul 15 18:51:57.188126 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:57.188077    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bfhdd" podStartSLOduration=16.829153517 podStartE2EDuration="39.188061554s" totalImagesPullingTime="22.358908037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:51:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:51:57.186371505 +0000 UTC m=+86.297678045" watchObservedRunningTime="2026-07-15 18:51:57.188061554 +0000 UTC m=+86.299368068"
Jul 15 18:51:58.419151 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:58.419115    2562 patch_prober.go:28] interesting pod/image-registry-66bcdfdf68-bcxhw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 18:51:58.419515 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:51:58.419177    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 18:52:03.095112 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:03.095083    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:52:04.162159 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:04.162130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m7dmm"
Jul 15 18:52:04.479116 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:04.479085    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:52:12.084980 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:12.084951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4ddsc"
Jul 15 18:52:14.678347 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.678309    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgcb9"]
Jul 15 18:52:14.701666 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.701641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.704405 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.704382    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 18:52:14.704539 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.704408    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 18:52:14.704539 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.704416    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 18:52:14.705486 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.705471    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ls8b7\""
Jul 15 18:52:14.705602 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.705523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 18:52:14.816495 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5xqz\" (UniqueName: \"kubernetes.io/projected/9d36e4c4-4088-4336-92ca-8a69fb705785-kube-api-access-m5xqz\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816704 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-sys\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816704 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-tls\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816704 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816704 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-wtmp\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-metrics-client-ca\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-root\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.816905 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.816789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-textfile\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-wtmp\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-metrics-client-ca\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-root\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-textfile\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5xqz\" (UniqueName: \"kubernetes.io/projected/9d36e4c4-4088-4336-92ca-8a69fb705785-kube-api-access-m5xqz\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-sys\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-root\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-wtmp\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917365    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-tls\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917428    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d36e4c4-4088-4336-92ca-8a69fb705785-sys\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917502 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.917989 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.917866    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-textfile\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.918042 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.918001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.918042 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.918001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d36e4c4-4088-4336-92ca-8a69fb705785-metrics-client-ca\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.919869 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.919846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.920319 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.920297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d36e4c4-4088-4336-92ca-8a69fb705785-node-exporter-tls\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:14.926544 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:14.926522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5xqz\" (UniqueName: \"kubernetes.io/projected/9d36e4c4-4088-4336-92ca-8a69fb705785-kube-api-access-m5xqz\") pod \"node-exporter-rgcb9\" (UID: \"9d36e4c4-4088-4336-92ca-8a69fb705785\") " pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:15.010759 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:15.010722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgcb9"
Jul 15 18:52:15.025928 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:52:15.025895    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d36e4c4_4088_4336_92ca_8a69fb705785.slice/crio-aae998e1e6257ee2a2d48a1498e3a2e4577890d73c1b32a118d04847b8218549 WatchSource:0}: Error finding container aae998e1e6257ee2a2d48a1498e3a2e4577890d73c1b32a118d04847b8218549: Status 404 returned error can't find the container with id aae998e1e6257ee2a2d48a1498e3a2e4577890d73c1b32a118d04847b8218549
Jul 15 18:52:15.240168 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:15.240135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgcb9" event={"ID":"9d36e4c4-4088-4336-92ca-8a69fb705785","Type":"ContainerStarted","Data":"aae998e1e6257ee2a2d48a1498e3a2e4577890d73c1b32a118d04847b8218549"}
Jul 15 18:52:17.250656 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:17.250622    2562 generic.go:356] "Generic (PLEG): container finished" podID="9d36e4c4-4088-4336-92ca-8a69fb705785" containerID="0aff06ab842a69569d6e6e095e6bad113a664222391ef6b90e4d49f1d929abcf" exitCode=0
Jul 15 18:52:17.251048 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:17.250696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgcb9" event={"ID":"9d36e4c4-4088-4336-92ca-8a69fb705785","Type":"ContainerDied","Data":"0aff06ab842a69569d6e6e095e6bad113a664222391ef6b90e4d49f1d929abcf"}
Jul 15 18:52:18.257019 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:18.256984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgcb9" event={"ID":"9d36e4c4-4088-4336-92ca-8a69fb705785","Type":"ContainerStarted","Data":"53d310f6115c372c7b5fa243bde9534fead72afc8563f348a4921b217b36df56"}
Jul 15 18:52:18.257428 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:18.257052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgcb9" event={"ID":"9d36e4c4-4088-4336-92ca-8a69fb705785","Type":"ContainerStarted","Data":"fa9be070eaccc9f06eae7d03a1c5fb6442e1d59832a0c89b2c5fea65efcfbfdd"}
Jul 15 18:52:18.278056 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:18.278004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgcb9" podStartSLOduration=2.962460455 podStartE2EDuration="4.277988769s" totalImagesPullingTime="1.242630088s" totalInitContainerRuntime="72.898226ms" isStatefulPod=true podCreationTimestamp="2026-07-15 18:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:52:18.277673189 +0000 UTC m=+107.388979703" watchObservedRunningTime="2026-07-15 18:52:18.277988769 +0000 UTC m=+107.389295283"
Jul 15 18:52:29.507193 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:29.507127    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerName="registry" containerID="cri-o://66248bf2025cafb22672ff93108445424915271baa9595417639a474e37d32e2" gracePeriod=30
Jul 15 18:52:30.308160 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.308130    2562 generic.go:356] "Generic (PLEG): container finished" podID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerID="66248bf2025cafb22672ff93108445424915271baa9595417639a474e37d32e2" exitCode=0
Jul 15 18:52:30.308280 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.308205    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" event={"ID":"56d871c1-7a1e-4c62-b62f-fbd9d070f674","Type":"ContainerDied","Data":"66248bf2025cafb22672ff93108445424915271baa9595417639a474e37d32e2"}
Jul 15 18:52:30.308280 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.308258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw" event={"ID":"56d871c1-7a1e-4c62-b62f-fbd9d070f674","Type":"ContainerDied","Data":"f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178"}
Jul 15 18:52:30.308280 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.308276    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178"
Jul 15 18:52:30.349696 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.349664    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:52:30.458136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458139    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458180    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2pg8\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458212    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458275    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458312    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.458404 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.458343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca\") pod \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\" (UID: \"56d871c1-7a1e-4c62-b62f-fbd9d070f674\") "
Jul 15 18:52:30.459098 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.459072    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:30.459436 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.459300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:52:30.461012 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.460985    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:30.461137 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.461105    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 18:52:30.461215 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.461191    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:30.461294 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.461274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8" (OuterVolumeSpecName: "kube-api-access-v2pg8") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "kube-api-access-v2pg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:30.461602 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.461554    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:52:30.467645 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.467622    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "56d871c1-7a1e-4c62-b62f-fbd9d070f674" (UID: "56d871c1-7a1e-4c62-b62f-fbd9d070f674"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 18:52:30.559719 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559680    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/56d871c1-7a1e-4c62-b62f-fbd9d070f674-ca-trust-extracted\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.559719 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559716    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-installation-pull-secrets\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.559719 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559731    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-bound-sa-token\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.560150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559739    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2pg8\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-kube-api-access-v2pg8\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.560150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559748    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-certificates\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.560150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559757    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/56d871c1-7a1e-4c62-b62f-fbd9d070f674-registry-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.560150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559766    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/56d871c1-7a1e-4c62-b62f-fbd9d070f674-image-registry-private-configuration\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:30.560150 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:30.559775    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/56d871c1-7a1e-4c62-b62f-fbd9d070f674-trusted-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:52:31.312086 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:31.312054    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66bcdfdf68-bcxhw"
Jul 15 18:52:31.333197 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:31.333164    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:52:31.339837 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:31.339808    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66bcdfdf68-bcxhw"]
Jul 15 18:52:31.418950 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:31.418918    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" path="/var/lib/kubelet/pods/56d871c1-7a1e-4c62-b62f-fbd9d070f674/volumes"
Jul 15 18:52:31.723478 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:52:31.723432    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:52:32.317341 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.317260    2562 generic.go:356] "Generic (PLEG): container finished" podID="959b2256-3d5b-4362-9dd5-bfe4767856c4" containerID="9ccf7074e47ce2345a305e2294bba20918661e92181f38da4d7155a6c5aaf921" exitCode=0
Jul 15 18:52:32.317505 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.317332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf" event={"ID":"959b2256-3d5b-4362-9dd5-bfe4767856c4","Type":"ContainerDied","Data":"9ccf7074e47ce2345a305e2294bba20918661e92181f38da4d7155a6c5aaf921"}
Jul 15 18:52:32.317709 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.317692    2562 scope.go:117] "RemoveContainer" containerID="9ccf7074e47ce2345a305e2294bba20918661e92181f38da4d7155a6c5aaf921"
Jul 15 18:52:32.318882 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.318859    2562 generic.go:356] "Generic (PLEG): container finished" podID="396d753b-23ae-44dc-abbb-ab7a2a8a59c7" containerID="3e1308bbc54257799fda290dd4a001b1e2e61efb4d89226e37263fdc9063bf0c" exitCode=0
Jul 15 18:52:32.318983 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.318921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf" event={"ID":"396d753b-23ae-44dc-abbb-ab7a2a8a59c7","Type":"ContainerDied","Data":"3e1308bbc54257799fda290dd4a001b1e2e61efb4d89226e37263fdc9063bf0c"}
Jul 15 18:52:32.319218 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:32.319205    2562 scope.go:117] "RemoveContainer" containerID="3e1308bbc54257799fda290dd4a001b1e2e61efb4d89226e37263fdc9063bf0c"
Jul 15 18:52:33.324780 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:33.324742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-pqwsf" event={"ID":"959b2256-3d5b-4362-9dd5-bfe4767856c4","Type":"ContainerStarted","Data":"524380bf1b404cb402874263ffea74e00b951abe8f6e3e96341e86019afefe65"}
Jul 15 18:52:33.326475 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:33.326451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6jwwf" event={"ID":"396d753b-23ae-44dc-abbb-ab7a2a8a59c7","Type":"ContainerStarted","Data":"da3d291ea6730e1ef00157ba06e0c4f590f0653e59c554e43a38b1a36e059db1"}
Jul 15 18:52:37.342813 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:37.342780    2562 generic.go:356] "Generic (PLEG): container finished" podID="09f51599-39a1-4b35-8546-d81177619edf" containerID="007fd4ab362f9d077c91150d3e6f16a64f7f2a6146bd4a78378db177c8094e44" exitCode=0
Jul 15 18:52:37.343281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:37.342822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf" event={"ID":"09f51599-39a1-4b35-8546-d81177619edf","Type":"ContainerDied","Data":"007fd4ab362f9d077c91150d3e6f16a64f7f2a6146bd4a78378db177c8094e44"}
Jul 15 18:52:37.343281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:37.343109    2562 scope.go:117] "RemoveContainer" containerID="007fd4ab362f9d077c91150d3e6f16a64f7f2a6146bd4a78378db177c8094e44"
Jul 15 18:52:37.370958 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:52:37.370931    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:52:38.354954 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:52:38.354921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-g42sf" event={"ID":"09f51599-39a1-4b35-8546-d81177619edf","Type":"ContainerStarted","Data":"c50e09013b93c70f0a31466d8df4549cccf92fb0dc017be17ece651ab8522d8c"}
Jul 15 18:52:41.733075 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:52:41.733042    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:52:51.770865 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:52:51.770834    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:52:52.331603 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:52:52.331531    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:01.810008 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:01.809974    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:05.573080 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:05.573042    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:05.573497 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:05.573342    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:07.369346 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:07.369308    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:11.818253 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:11.818217    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:21.855149 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:21.855114    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:53:22.344992 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:53:22.344955    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d871c1_7a1e_4c62_b62f_fbd9d070f674.slice/crio-f214dfc3fb3d63cd0abce1080ef128099c85e2c7820fb397605f96074979e178\": RecentStats: unable to find data in memory cache]"
Jul 15 18:55:31.306098 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:55:31.306067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 18:55:31.309556 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:55:31.309529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:55:31.312141 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:55:31.312119    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 18:55:31.315904 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:55:31.315873    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 18:55:31.317495 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:55:31.317472    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 18:56:15.844199 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.844163    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"]
Jul 15 18:56:15.844631 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.844483    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerName="registry"
Jul 15 18:56:15.844631 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.844494    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerName="registry"
Jul 15 18:56:15.844631 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.844551    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="56d871c1-7a1e-4c62-b62f-fbd9d070f674" containerName="registry"
Jul 15 18:56:15.847477 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.847459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:15.852763 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.852738    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 18:56:15.852916 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.852847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 18:56:15.852916 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.852870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ssvhg\""
Jul 15 18:56:15.853088 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.852977    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 18:56:15.854346 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.854238    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 18:56:15.872337 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.872313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"]
Jul 15 18:56:15.955692 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.955656    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:15.955692 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.955691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:15.955962 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.955729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:15.955962 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.955853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978mc\" (UniqueName: \"kubernetes.io/projected/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-kube-api-access-978mc\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:15.955962 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:15.955892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.056586 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.056537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978mc\" (UniqueName: \"kubernetes.io/projected/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-kube-api-access-978mc\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.056779 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.056599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.056779 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.056651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.056779 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.056669    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.056779 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.056684    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.057091 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.057066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-manifests\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.059097 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.059064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-tmp\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.059345 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.059322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.059442 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.059421    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.069951 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.069925    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978mc\" (UniqueName: \"kubernetes.io/projected/9a2126e7-eeb1-4db9-b912-c9665a0cfc1f-kube-api-access-978mc\") pod \"opendatahub-operator-controller-manager-6dbd7b8848-6glpj\" (UID: \"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f\") " pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.158175 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.158069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:16.303024 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.302997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"]
Jul 15 18:56:16.305387 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:56:16.305362    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2126e7_eeb1_4db9_b912_c9665a0cfc1f.slice/crio-a4244c8790d91342fbf06d7caf1016a99488033192c5f510c7a6dcd56620b8dc WatchSource:0}: Error finding container a4244c8790d91342fbf06d7caf1016a99488033192c5f510c7a6dcd56620b8dc: Status 404 returned error can't find the container with id a4244c8790d91342fbf06d7caf1016a99488033192c5f510c7a6dcd56620b8dc
Jul 15 18:56:16.307027 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:16.307010    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 18:56:17.220244 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:17.220171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj" event={"ID":"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f","Type":"ContainerStarted","Data":"a4244c8790d91342fbf06d7caf1016a99488033192c5f510c7a6dcd56620b8dc"}
Jul 15 18:56:20.235290 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:20.235254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj" event={"ID":"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f","Type":"ContainerStarted","Data":"9e98b0d38e6177ac31bed41bac5dd7f41d92b1899ad9b9ed250d831b07082c2f"}
Jul 15 18:56:21.240960 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:21.240929    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a2126e7-eeb1-4db9-b912-c9665a0cfc1f" containerID="9e98b0d38e6177ac31bed41bac5dd7f41d92b1899ad9b9ed250d831b07082c2f" exitCode=0
Jul 15 18:56:21.241356 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:21.241006    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj" event={"ID":"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f","Type":"ContainerDied","Data":"9e98b0d38e6177ac31bed41bac5dd7f41d92b1899ad9b9ed250d831b07082c2f"}
Jul 15 18:56:22.247128 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:22.247097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj" event={"ID":"9a2126e7-eeb1-4db9-b912-c9665a0cfc1f","Type":"ContainerStarted","Data":"8a2ff2f8387fd9aea734f70c5d5ce6f51812b30f70942560e0fbfdcbf0a9d46d"}
Jul 15 18:56:22.247534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:22.247229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:22.272204 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:22.272151    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj" podStartSLOduration=3.041743402 podStartE2EDuration="7.272131147s" totalImagesPullingTime="3.226628434s" totalInitContainerRuntime="1.003759311s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:22.271868703 +0000 UTC m=+351.383175218" watchObservedRunningTime="2026-07-15 18:56:22.272131147 +0000 UTC m=+351.383437664"
Jul 15 18:56:33.253513 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:33.253476    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dbd7b8848-6glpj"
Jul 15 18:56:46.838211 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.838178    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"]
Jul 15 18:56:46.851399 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.851369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:46.853607 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.853565    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"]
Jul 15 18:56:46.855553 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.855531    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 18:56:46.856563 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.856545    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 18:56:46.862798 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.862778    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 18:56:46.863045 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.863028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vqxhs\""
Jul 15 18:56:46.863246 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.863230    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 18:56:46.863326 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.863276    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 18:56:46.927534 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.927489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6790a639-abe7-4388-bb41-4b84c2648f91-manager-config\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:46.927759 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.927696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmc2\" (UniqueName: \"kubernetes.io/projected/6790a639-abe7-4388-bb41-4b84c2648f91-kube-api-access-lwmc2\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:46.927759 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.927743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:46.927850 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:46.927780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-metrics-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.028954 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.028916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6790a639-abe7-4388-bb41-4b84c2648f91-manager-config\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.029130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.028973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmc2\" (UniqueName: \"kubernetes.io/projected/6790a639-abe7-4388-bb41-4b84c2648f91-kube-api-access-lwmc2\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.029130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.028996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.029130 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.029014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-metrics-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.029791 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.029725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6790a639-abe7-4388-bb41-4b84c2648f91-manager-config\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.031632 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.031609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-metrics-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.031728 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.031678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6790a639-abe7-4388-bb41-4b84c2648f91-cert\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.060859 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.060835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmc2\" (UniqueName: \"kubernetes.io/projected/6790a639-abe7-4388-bb41-4b84c2648f91-kube-api-access-lwmc2\") pod \"lws-controller-manager-7db65df97c-j5295\" (UID: \"6790a639-abe7-4388-bb41-4b84c2648f91\") " pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.161764 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.161658    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:47.313973 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.313940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"]
Jul 15 18:56:47.323522 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:56:47.323495    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6790a639_abe7_4388_bb41_4b84c2648f91.slice/crio-9bfd285f78a3f22b22661a7819626207080b563d08fb3772d6ef0c84fece6255 WatchSource:0}: Error finding container 9bfd285f78a3f22b22661a7819626207080b563d08fb3772d6ef0c84fece6255: Status 404 returned error can't find the container with id 9bfd285f78a3f22b22661a7819626207080b563d08fb3772d6ef0c84fece6255
Jul 15 18:56:47.362537 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.362505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295" event={"ID":"6790a639-abe7-4388-bb41-4b84c2648f91","Type":"ContainerStarted","Data":"9bfd285f78a3f22b22661a7819626207080b563d08fb3772d6ef0c84fece6255"}
Jul 15 18:56:47.998014 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:47.997975    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"]
Jul 15 18:56:48.007129 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.003787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.016882 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.009153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 18:56:48.016882 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.009401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zj595\""
Jul 15 18:56:48.025778 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.025747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"]
Jul 15 18:56:48.140064 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.139989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92mnt\" (UniqueName: \"kubernetes.io/projected/e17f98dc-9769-4ebe-83cc-0101393b76da-kube-api-access-92mnt\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.140240 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.140086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.241345 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.240550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92mnt\" (UniqueName: \"kubernetes.io/projected/e17f98dc-9769-4ebe-83cc-0101393b76da-kube-api-access-92mnt\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.241345 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.240668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.241345 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:56:48.240841    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 15 18:56:48.241345 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:56:48.240909    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert podName:e17f98dc-9769-4ebe-83cc-0101393b76da nodeName:}" failed. No retries permitted until 2026-07-15 18:56:48.740885991 +0000 UTC m=+377.852192488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert") pod "llmisvc-controller-manager-777c6bd7d5-zjbgf" (UID: "e17f98dc-9769-4ebe-83cc-0101393b76da") : secret "llmisvc-webhook-server-cert" not found
Jul 15 18:56:48.272402 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.272299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92mnt\" (UniqueName: \"kubernetes.io/projected/e17f98dc-9769-4ebe-83cc-0101393b76da-kube-api-access-92mnt\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.746685 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.746649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.749476 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.749451    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e17f98dc-9769-4ebe-83cc-0101393b76da-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zjbgf\" (UID: \"e17f98dc-9769-4ebe-83cc-0101393b76da\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:48.930375 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:48.930339    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:49.931810 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:49.931786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"]
Jul 15 18:56:49.934655 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:56:49.934615    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode17f98dc_9769_4ebe_83cc_0101393b76da.slice/crio-cc9ead918ad602fae0f82b6030805a44bf441c6eab549d6a677a23d4b52a6d49 WatchSource:0}: Error finding container cc9ead918ad602fae0f82b6030805a44bf441c6eab549d6a677a23d4b52a6d49: Status 404 returned error can't find the container with id cc9ead918ad602fae0f82b6030805a44bf441c6eab549d6a677a23d4b52a6d49
Jul 15 18:56:50.382834 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:50.382796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295" event={"ID":"6790a639-abe7-4388-bb41-4b84c2648f91","Type":"ContainerStarted","Data":"d36a08b6daccf7fe6a6605a82015c073d29f2225245e1ac8453b704bd5e26650"}
Jul 15 18:56:50.383015 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:50.382912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:56:50.384091 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:50.384069    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf" event={"ID":"e17f98dc-9769-4ebe-83cc-0101393b76da","Type":"ContainerStarted","Data":"cc9ead918ad602fae0f82b6030805a44bf441c6eab549d6a677a23d4b52a6d49"}
Jul 15 18:56:50.405371 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:50.405324    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295" podStartSLOduration=1.88058778 podStartE2EDuration="4.405308947s" totalImagesPullingTime="2.524721167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:50.404111575 +0000 UTC m=+379.515418090" watchObservedRunningTime="2026-07-15 18:56:50.405308947 +0000 UTC m=+379.516615464"
Jul 15 18:56:53.399626 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:53.399562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf" event={"ID":"e17f98dc-9769-4ebe-83cc-0101393b76da","Type":"ContainerStarted","Data":"e846692a47a411901109d9855f504a0a764ad0111e17233b661ace821a888662"}
Jul 15 18:56:53.400002 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:53.399724    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:56:53.417758 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:56:53.417705    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf" podStartSLOduration=3.561562393 podStartE2EDuration="6.417680891s" totalImagesPullingTime="2.856118498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:56:53.416276274 +0000 UTC m=+382.527582790" watchObservedRunningTime="2026-07-15 18:56:53.417680891 +0000 UTC m=+382.528987406"
Jul 15 18:57:01.391632 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:57:01.391603    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7db65df97c-j5295"
Jul 15 18:57:24.406975 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:57:24.406941    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zjbgf"
Jul 15 18:58:21.039202 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.039165    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"]
Jul 15 18:58:21.042510 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.042489    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:21.045266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.045244    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 18:58:21.045266 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.045263    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 18:58:21.046106 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.046088    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-88g8k\""
Jul 15 18:58:21.056496 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.056472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"]
Jul 15 18:58:21.122242 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.122192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7cbx\" (UniqueName: \"kubernetes.io/projected/8f30b6d3-a6b3-49b3-9264-95862909114b-kube-api-access-h7cbx\") pod \"authorino-operator-75cc8d5cb7-s6s66\" (UID: \"8f30b6d3-a6b3-49b3-9264-95862909114b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:21.223102 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.223057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7cbx\" (UniqueName: \"kubernetes.io/projected/8f30b6d3-a6b3-49b3-9264-95862909114b-kube-api-access-h7cbx\") pod \"authorino-operator-75cc8d5cb7-s6s66\" (UID: \"8f30b6d3-a6b3-49b3-9264-95862909114b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:21.232665 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.232628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7cbx\" (UniqueName: \"kubernetes.io/projected/8f30b6d3-a6b3-49b3-9264-95862909114b-kube-api-access-h7cbx\") pod \"authorino-operator-75cc8d5cb7-s6s66\" (UID: \"8f30b6d3-a6b3-49b3-9264-95862909114b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:21.353259 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.353167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:21.497303 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.497276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"]
Jul 15 18:58:21.500424 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:58:21.500395    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f30b6d3_a6b3_49b3_9264_95862909114b.slice/crio-d66be2e8f46df24f81b46995adfe67e9097d93f25ea160e792361a2253c9f3e1 WatchSource:0}: Error finding container d66be2e8f46df24f81b46995adfe67e9097d93f25ea160e792361a2253c9f3e1: Status 404 returned error can't find the container with id d66be2e8f46df24f81b46995adfe67e9097d93f25ea160e792361a2253c9f3e1
Jul 15 18:58:21.793669 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:21.793638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66" event={"ID":"8f30b6d3-a6b3-49b3-9264-95862909114b","Type":"ContainerStarted","Data":"d66be2e8f46df24f81b46995adfe67e9097d93f25ea160e792361a2253c9f3e1"}
Jul 15 18:58:24.811399 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:24.811362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66" event={"ID":"8f30b6d3-a6b3-49b3-9264-95862909114b","Type":"ContainerStarted","Data":"45b7de91bc85a18dacf3b00abc26c9f77d814ffe9517c428ee5336219c7b4bbd"}
Jul 15 18:58:24.811872 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:24.811492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:58:24.829630 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:24.829584    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66" podStartSLOduration=1.417596158 podStartE2EDuration="3.829552662s" totalImagesPullingTime="2.411956504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:58:24.828641095 +0000 UTC m=+473.939947611" watchObservedRunningTime="2026-07-15 18:58:24.829552662 +0000 UTC m=+473.940859178"
Jul 15 18:58:31.332771 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:31.332743    2562 scope.go:117] "RemoveContainer" containerID="66248bf2025cafb22672ff93108445424915271baa9595417639a474e37d32e2"
Jul 15 18:58:35.817917 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:58:35.817883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s6s66"
Jul 15 18:59:21.886420 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.886384    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:21.893859 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.893837    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:21.896851 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.896827    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4wzkg\""
Jul 15 18:59:21.896992 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.896832    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 18:59:21.897764 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.897738    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:21.936367 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.936334    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwdj\" (UniqueName: \"kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:21.936514 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.936380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:21.983339 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:21.983296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:22.037118 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.037088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwdj\" (UniqueName: \"kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:22.037281 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.037131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:22.037736 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.037718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:22.045149 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.045123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwdj\" (UniqueName: \"kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj\") pod \"limitador-limitador-64c94fd64f-lrnng\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:22.206182 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.206115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:22.345220 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:22.345195    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:22.348879 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:59:22.348845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82b5237_0a1c_4bc5_a5a4_af6c372ed39a.slice/crio-6faaec4bc865ce54702ad255ca607027f388da0637dcdec2b18009f44949c8e2 WatchSource:0}: Error finding container 6faaec4bc865ce54702ad255ca607027f388da0637dcdec2b18009f44949c8e2: Status 404 returned error can't find the container with id 6faaec4bc865ce54702ad255ca607027f388da0637dcdec2b18009f44949c8e2
Jul 15 18:59:23.076525 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:23.076484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" event={"ID":"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a","Type":"ContainerStarted","Data":"6faaec4bc865ce54702ad255ca607027f388da0637dcdec2b18009f44949c8e2"}
Jul 15 18:59:26.092994 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:26.092953    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" event={"ID":"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a","Type":"ContainerStarted","Data":"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"}
Jul 15 18:59:26.093389 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:26.093097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:26.110090 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:26.110038    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" podStartSLOduration=2.337236767 podStartE2EDuration="5.110023185s" totalImagesPullingTime="2.772786418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:59:26.108735604 +0000 UTC m=+535.220042120" watchObservedRunningTime="2026-07-15 18:59:26.110023185 +0000 UTC m=+535.221329749"
Jul 15 18:59:36.940112 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:36.940074    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:36.940546 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:36.940281    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" podUID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" containerName="limitador" containerID="cri-o://48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241" gracePeriod=30
Jul 15 18:59:36.941007 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:36.940953    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:37.487818 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.487793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:37.572854 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.572752    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file\") pod \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") "
Jul 15 18:59:37.572854 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.572806    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtwdj\" (UniqueName: \"kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj\") pod \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\" (UID: \"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a\") "
Jul 15 18:59:37.573136 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.573113    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file" (OuterVolumeSpecName: "config-file") pod "b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" (UID: "b82b5237-0a1c-4bc5-a5a4-af6c372ed39a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 18:59:37.575209 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.575182    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj" (OuterVolumeSpecName: "kube-api-access-gtwdj") pod "b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" (UID: "b82b5237-0a1c-4bc5-a5a4-af6c372ed39a"). InnerVolumeSpecName "kube-api-access-gtwdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 18:59:37.673950 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.673907    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-config-file\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:59:37.673950 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:37.673944    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtwdj\" (UniqueName: \"kubernetes.io/projected/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a-kube-api-access-gtwdj\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 18:59:38.148255 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.148220    2562 generic.go:356] "Generic (PLEG): container finished" podID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" containerID="48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241" exitCode=0
Jul 15 18:59:38.148696 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.148268    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng"
Jul 15 18:59:38.148696 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.148312    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" event={"ID":"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a","Type":"ContainerDied","Data":"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"}
Jul 15 18:59:38.148696 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.148361    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lrnng" event={"ID":"b82b5237-0a1c-4bc5-a5a4-af6c372ed39a","Type":"ContainerDied","Data":"6faaec4bc865ce54702ad255ca607027f388da0637dcdec2b18009f44949c8e2"}
Jul 15 18:59:38.148696 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.148386    2562 scope.go:117] "RemoveContainer" containerID="48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"
Jul 15 18:59:38.157785 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.157767    2562 scope.go:117] "RemoveContainer" containerID="48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"
Jul 15 18:59:38.158156 ip-10-0-133-23 kubenswrapper[2562]: E0715 18:59:38.158135    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241\": container with ID starting with 48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241 not found: ID does not exist" containerID="48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"
Jul 15 18:59:38.158255 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.158163    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241"} err="failed to get container status \"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241\": rpc error: code = NotFound desc = could not find container \"48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241\": container with ID starting with 48362d19fab2480e9e71151d3afb8e4a06d67141ad2f848b3bd3945642ca8241 not found: ID does not exist"
Jul 15 18:59:38.171637 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.171558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:38.175996 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:38.175967    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lrnng"]
Jul 15 18:59:39.418878 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:39.418843    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" path="/var/lib/kubelet/pods/b82b5237-0a1c-4bc5-a5a4-af6c372ed39a/volumes"
Jul 15 18:59:41.128784 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.128752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"]
Jul 15 18:59:41.129152 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.129066    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" containerName="limitador"
Jul 15 18:59:41.129152 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.129077    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" containerName="limitador"
Jul 15 18:59:41.129152 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.129136    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82b5237-0a1c-4bc5-a5a4-af6c372ed39a" containerName="limitador"
Jul 15 18:59:41.132249 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.132229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.139376 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.139356    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rjqf4\""
Jul 15 18:59:41.139682 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.139665    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 18:59:41.140372 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.140357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 18:59:41.140461 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.140391    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 18:59:41.152758 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.152728    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"]
Jul 15 18:59:41.205527 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.205487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cdcd185-23b0-4c0d-ba31-1794597aedc3-data\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.205736 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.205565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6ng\" (UniqueName: \"kubernetes.io/projected/2cdcd185-23b0-4c0d-ba31-1794597aedc3-kube-api-access-rk6ng\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.306663 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.306606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6ng\" (UniqueName: \"kubernetes.io/projected/2cdcd185-23b0-4c0d-ba31-1794597aedc3-kube-api-access-rk6ng\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.306663 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.306676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cdcd185-23b0-4c0d-ba31-1794597aedc3-data\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.307027 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.307008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cdcd185-23b0-4c0d-ba31-1794597aedc3-data\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.319280 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.319245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6ng\" (UniqueName: \"kubernetes.io/projected/2cdcd185-23b0-4c0d-ba31-1794597aedc3-kube-api-access-rk6ng\") pod \"postgres-69fb4594cf-sfq8n\" (UID: \"2cdcd185-23b0-4c0d-ba31-1794597aedc3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.442062 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.442031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:41.580249 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:41.580216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"]
Jul 15 18:59:41.582799 ip-10-0-133-23 kubenswrapper[2562]: W0715 18:59:41.582771    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdcd185_23b0_4c0d_ba31_1794597aedc3.slice/crio-4c2bfa5a453cf8d394006728ad5d794781718e128eb2b251df22cd369bc7a637 WatchSource:0}: Error finding container 4c2bfa5a453cf8d394006728ad5d794781718e128eb2b251df22cd369bc7a637: Status 404 returned error can't find the container with id 4c2bfa5a453cf8d394006728ad5d794781718e128eb2b251df22cd369bc7a637
Jul 15 18:59:42.167078 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:42.167040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n" event={"ID":"2cdcd185-23b0-4c0d-ba31-1794597aedc3","Type":"ContainerStarted","Data":"4c2bfa5a453cf8d394006728ad5d794781718e128eb2b251df22cd369bc7a637"}
Jul 15 18:59:47.193650 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:47.193610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n" event={"ID":"2cdcd185-23b0-4c0d-ba31-1794597aedc3","Type":"ContainerStarted","Data":"06bdb4e486e059ddd4c4708af840397dc6925301503cd7b2e76d79023f3b9eea"}
Jul 15 18:59:47.194069 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:47.193752    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 18:59:47.210531 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:47.210481    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n" podStartSLOduration=1.2490179829999999 podStartE2EDuration="6.210464967s" totalImagesPullingTime="4.961446984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:59:47.209418245 +0000 UTC m=+556.320724763" watchObservedRunningTime="2026-07-15 18:59:47.210464967 +0000 UTC m=+556.321771483"
Jul 15 18:59:53.228627 ip-10-0-133-23 kubenswrapper[2562]: I0715 18:59:53.228592    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sfq8n"
Jul 15 19:00:31.336231 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:31.336203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:00:31.337509 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:31.337486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:00:31.342178 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:31.342156    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:00:31.343390 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:31.343371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:00:38.028738 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.028699    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-755b754868-s49xv"]
Jul 15 19:00:38.033518 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.033482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.037817 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.037792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pnqdc\""
Jul 15 19:00:38.041187 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.041167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 19:00:38.129873 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.129832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-755b754868-s49xv"]
Jul 15 19:00:38.171382 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.171346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3832b0c6-e144-4756-a568-68e0ccb69c59-maas-api-tls\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.171547 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.171400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3832b0c6-e144-4756-a568-68e0ccb69c59-openshift-service-ca\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.171547 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.171447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4z4h\" (UniqueName: \"kubernetes.io/projected/3832b0c6-e144-4756-a568-68e0ccb69c59-kube-api-access-v4z4h\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.272349 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.272309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3832b0c6-e144-4756-a568-68e0ccb69c59-openshift-service-ca\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.272349 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.272358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4z4h\" (UniqueName: \"kubernetes.io/projected/3832b0c6-e144-4756-a568-68e0ccb69c59-kube-api-access-v4z4h\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.272634 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.272492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3832b0c6-e144-4756-a568-68e0ccb69c59-maas-api-tls\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.273039 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.273017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3832b0c6-e144-4756-a568-68e0ccb69c59-openshift-service-ca\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.275061 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.275040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3832b0c6-e144-4756-a568-68e0ccb69c59-maas-api-tls\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.285124 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.285058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4z4h\" (UniqueName: \"kubernetes.io/projected/3832b0c6-e144-4756-a568-68e0ccb69c59-kube-api-access-v4z4h\") pod \"maas-api-755b754868-s49xv\" (UID: \"3832b0c6-e144-4756-a568-68e0ccb69c59\") " pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.343755 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.343717    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:38.485507 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.485454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-755b754868-s49xv"]
Jul 15 19:00:38.489889 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:00:38.489851    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3832b0c6_e144_4756_a568_68e0ccb69c59.slice/crio-698d9fefa8c3a65fdfc1bd24e75291359c5b2a2fdd7aa0c7b38b6b06ceaa894c WatchSource:0}: Error finding container 698d9fefa8c3a65fdfc1bd24e75291359c5b2a2fdd7aa0c7b38b6b06ceaa894c: Status 404 returned error can't find the container with id 698d9fefa8c3a65fdfc1bd24e75291359c5b2a2fdd7aa0c7b38b6b06ceaa894c
Jul 15 19:00:38.641846 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.641757    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"]
Jul 15 19:00:38.646320 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.646293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.648970 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.648944    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 19:00:38.657873 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.657841    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"]
Jul 15 19:00:38.777929 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.777893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.777929 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.777934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbjp\" (UniqueName: \"kubernetes.io/projected/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-kube-api-access-clbjp\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.879271 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.879234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.879478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.879290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbjp\" (UniqueName: \"kubernetes.io/projected/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-kube-api-access-clbjp\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.880030 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.880006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.887705 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.887685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbjp\" (UniqueName: \"kubernetes.io/projected/9c871f9d-e156-4b60-af9f-cd2dc05ea0f7-kube-api-access-clbjp\") pod \"payload-pre-processing-74584bb9f8-ztc69\" (UID: \"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:38.958640 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:38.958597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:39.092746 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:39.092711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"]
Jul 15 19:00:39.095484 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:00:39.095460    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c871f9d_e156_4b60_af9f_cd2dc05ea0f7.slice/crio-3dbe588932aa92322e07ab155a77c48a919c2dbaa72c97a64370572cfd967c9b WatchSource:0}: Error finding container 3dbe588932aa92322e07ab155a77c48a919c2dbaa72c97a64370572cfd967c9b: Status 404 returned error can't find the container with id 3dbe588932aa92322e07ab155a77c48a919c2dbaa72c97a64370572cfd967c9b
Jul 15 19:00:39.438288 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:39.438250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69" event={"ID":"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7","Type":"ContainerStarted","Data":"3dbe588932aa92322e07ab155a77c48a919c2dbaa72c97a64370572cfd967c9b"}
Jul 15 19:00:39.439533 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:39.439503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv" event={"ID":"3832b0c6-e144-4756-a568-68e0ccb69c59","Type":"ContainerStarted","Data":"698d9fefa8c3a65fdfc1bd24e75291359c5b2a2fdd7aa0c7b38b6b06ceaa894c"}
Jul 15 19:00:41.451184 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:41.451145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv" event={"ID":"3832b0c6-e144-4756-a568-68e0ccb69c59","Type":"ContainerStarted","Data":"de9500c9021efa3bea301748ec92f49e61201eba1afdbc471150d1fce9dd2ace"}
Jul 15 19:00:41.451707 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:41.451283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:41.469830 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:41.469767    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv" podStartSLOduration=2.122481443 podStartE2EDuration="4.469744902s" totalImagesPullingTime="2.347263459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:00:41.468086361 +0000 UTC m=+610.579392877" watchObservedRunningTime="2026-07-15 19:00:41.469744902 +0000 UTC m=+610.581051417"
Jul 15 19:00:42.458228 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:42.458189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69" event={"ID":"9c871f9d-e156-4b60-af9f-cd2dc05ea0f7","Type":"ContainerStarted","Data":"89eb52d5c9913a0df1e743c77e816c3a4148dc984dffc6bf31d54c142f02bb8e"}
Jul 15 19:00:42.458681 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:42.458304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:00:42.475787 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:42.475736    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69" podStartSLOduration=1.502963139 podStartE2EDuration="4.475718366s" totalImagesPullingTime="2.972755227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:00:42.474653304 +0000 UTC m=+611.585959850" watchObservedRunningTime="2026-07-15 19:00:42.475718366 +0000 UTC m=+611.587024878"
Jul 15 19:00:47.464288 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:47.464258    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-755b754868-s49xv"
Jul 15 19:00:53.465420 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:00:53.465342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-ztc69"
Jul 15 19:01:03.524879 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.524845    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"]
Jul 15 19:01:03.528371 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.528353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.532237 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.532213    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fbsnr\""
Jul 15 19:01:03.532374 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.532336    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 19:01:03.532374 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.532336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 19:01:03.532484 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.532371    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 19:01:03.540022 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.539985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"]
Jul 15 19:01:03.597236 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.597236 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba67d6b-599f-4941-8df8-86ec4f766906-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.597467 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.597467 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.597467 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57gz\" (UniqueName: \"kubernetes.io/projected/fba67d6b-599f-4941-8df8-86ec4f766906-kube-api-access-z57gz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.597467 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.597402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.698676 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.698676 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba67d6b-599f-4941-8df8-86ec4f766906-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.698872 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.698872 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.699021 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57gz\" (UniqueName: \"kubernetes.io/projected/fba67d6b-599f-4941-8df8-86ec4f766906-kube-api-access-z57gz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.699021 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.698971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.699119 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.699047    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.699119 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.699078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.699216 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.699194    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.701233 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.701202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fba67d6b-599f-4941-8df8-86ec4f766906-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.701406 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.701383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fba67d6b-599f-4941-8df8-86ec4f766906-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.707389 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.707369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57gz\" (UniqueName: \"kubernetes.io/projected/fba67d6b-599f-4941-8df8-86ec4f766906-kube-api-access-z57gz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx\" (UID: \"fba67d6b-599f-4941-8df8-86ec4f766906\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.839059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.838977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:03.979750 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:03.979722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"]
Jul 15 19:01:03.982819 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:01:03.982789    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba67d6b_599f_4941_8df8_86ec4f766906.slice/crio-045abc5b2c9bd382c4fd75c55913e237a5991a4fb878f53bbaf43bae03aac033 WatchSource:0}: Error finding container 045abc5b2c9bd382c4fd75c55913e237a5991a4fb878f53bbaf43bae03aac033: Status 404 returned error can't find the container with id 045abc5b2c9bd382c4fd75c55913e237a5991a4fb878f53bbaf43bae03aac033
Jul 15 19:01:04.560740 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:04.560702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx" event={"ID":"fba67d6b-599f-4941-8df8-86ec4f766906","Type":"ContainerStarted","Data":"045abc5b2c9bd382c4fd75c55913e237a5991a4fb878f53bbaf43bae03aac033"}
Jul 15 19:01:05.566961 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:05.566922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx" event={"ID":"fba67d6b-599f-4941-8df8-86ec4f766906","Type":"ContainerStarted","Data":"14fe86ec04464a5efd7ea81896888e5879666e1b8a7c5a5e79d02b2d7c25bac4"}
Jul 15 19:01:05.584874 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:05.584823    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx" podStartSLOduration=1.4326390789999999 podStartE2EDuration="2.584807507s" totalImagesPullingTime="1.152168428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:01:05.584045676 +0000 UTC m=+634.695352215" watchObservedRunningTime="2026-07-15 19:01:05.584807507 +0000 UTC m=+634.696114022"
Jul 15 19:01:13.839720 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:13.839680    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:13.840197 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:13.839751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:13.852087 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:13.852059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:14.619791 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:14.619759    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx"
Jul 15 19:01:21.234002 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.233967    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"]
Jul 15 19:01:21.236523 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.236502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.241581 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.241548    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 19:01:21.251507 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.251479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"]
Jul 15 19:01:21.363561 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.363775 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.363775 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.363775 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.363775 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e84f332-1112-40b1-a088-39b59d14145c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.363931 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.363789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvts6\" (UniqueName: \"kubernetes.io/projected/5e84f332-1112-40b1-a088-39b59d14145c-kube-api-access-xvts6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.464795 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.464751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.464795 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.464805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.464851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e84f332-1112-40b1-a088-39b59d14145c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.464892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvts6\" (UniqueName: \"kubernetes.io/projected/5e84f332-1112-40b1-a088-39b59d14145c-kube-api-access-xvts6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.464964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.465000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465269 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.465219    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465369 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.465349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.465501 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.465483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.467385 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.467368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e84f332-1112-40b1-a088-39b59d14145c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.467485 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.467468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e84f332-1112-40b1-a088-39b59d14145c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.476888 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.476864    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvts6\" (UniqueName: \"kubernetes.io/projected/5e84f332-1112-40b1-a088-39b59d14145c-kube-api-access-xvts6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc\" (UID: \"5e84f332-1112-40b1-a088-39b59d14145c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.547049 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.546968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:21.689157 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.689131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"]
Jul 15 19:01:21.690969 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:01:21.690936    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e84f332_1112_40b1_a088_39b59d14145c.slice/crio-83571811cba138f6f129aa57fd20305803c40574339d39946b2cf9d634b165f0 WatchSource:0}: Error finding container 83571811cba138f6f129aa57fd20305803c40574339d39946b2cf9d634b165f0: Status 404 returned error can't find the container with id 83571811cba138f6f129aa57fd20305803c40574339d39946b2cf9d634b165f0
Jul 15 19:01:21.692252 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:21.692223    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:01:22.650448 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:22.650408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc" event={"ID":"5e84f332-1112-40b1-a088-39b59d14145c","Type":"ContainerStarted","Data":"83571811cba138f6f129aa57fd20305803c40574339d39946b2cf9d634b165f0"}
Jul 15 19:01:23.656257 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:23.656213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc" event={"ID":"5e84f332-1112-40b1-a088-39b59d14145c","Type":"ContainerStarted","Data":"8467966af9ad16ab573398c3f1a37a2563f59b20327514cd668ef6c6e106c3fc"}
Jul 15 19:01:23.679353 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:23.679301    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc" podStartSLOduration=1.222580657 podStartE2EDuration="2.679282977s" totalImagesPullingTime="1.45670232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:01:23.678004391 +0000 UTC m=+652.789310911" watchObservedRunningTime="2026-07-15 19:01:23.679282977 +0000 UTC m=+652.790589492"
Jul 15 19:01:26.439677 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.439643    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"]
Jul 15 19:01:26.441909 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.441890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.444748 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.444729    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 19:01:26.451480 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.451455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"]
Jul 15 19:01:26.513758 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.513716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.513919 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.513774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.513919 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.513799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.514021 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.513919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdd9j\" (UniqueName: \"kubernetes.io/projected/70552801-d897-49f1-9eb2-53c9f0e30b7f-kube-api-access-mdd9j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.514021 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.513973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.514093 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.514079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70552801-d897-49f1-9eb2-53c9f0e30b7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.614894 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.614849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdd9j\" (UniqueName: \"kubernetes.io/projected/70552801-d897-49f1-9eb2-53c9f0e30b7f-kube-api-access-mdd9j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.614906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.614968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70552801-d897-49f1-9eb2-53c9f0e30b7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615355 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615479 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.615557 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.615537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.617420 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.617397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70552801-d897-49f1-9eb2-53c9f0e30b7f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.617741 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.617722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70552801-d897-49f1-9eb2-53c9f0e30b7f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.624125 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.624103    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdd9j\" (UniqueName: \"kubernetes.io/projected/70552801-d897-49f1-9eb2-53c9f0e30b7f-kube-api-access-mdd9j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wnkhw\" (UID: \"70552801-d897-49f1-9eb2-53c9f0e30b7f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.753255 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.753162    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:26.893758 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:26.893731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"]
Jul 15 19:01:26.895817 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:01:26.895786    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70552801_d897_49f1_9eb2_53c9f0e30b7f.slice/crio-ea39ea158753362625f869dbf6593ba4a819ab16138300cd48612999cd7bc642 WatchSource:0}: Error finding container ea39ea158753362625f869dbf6593ba4a819ab16138300cd48612999cd7bc642: Status 404 returned error can't find the container with id ea39ea158753362625f869dbf6593ba4a819ab16138300cd48612999cd7bc642
Jul 15 19:01:27.676849 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:27.676814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw" event={"ID":"70552801-d897-49f1-9eb2-53c9f0e30b7f","Type":"ContainerStarted","Data":"34a00ea38405ea6baccfa6d1a6a15abfa25346f793e24f5349da6dc005ed2115"}
Jul 15 19:01:27.677231 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:27.676868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw" event={"ID":"70552801-d897-49f1-9eb2-53c9f0e30b7f","Type":"ContainerStarted","Data":"ea39ea158753362625f869dbf6593ba4a819ab16138300cd48612999cd7bc642"}
Jul 15 19:01:27.696417 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:27.696363    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw" podStartSLOduration=1.428068486 podStartE2EDuration="1.696346122s" totalImagesPullingTime="268.277636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:01:27.695563222 +0000 UTC m=+656.806869778" watchObservedRunningTime="2026-07-15 19:01:27.696346122 +0000 UTC m=+656.807652658"
Jul 15 19:01:31.547089 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:31.547062    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:31.547609 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:31.547123    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:31.560335 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:31.560302    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:31.707647 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:31.707620    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc"
Jul 15 19:01:36.754157 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:36.754117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:36.754802 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:36.754198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:36.766485 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:36.766460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:01:37.736971 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:01:37.736942    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wnkhw"
Jul 15 19:05:31.372166 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:05:31.372075    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:05:31.373506 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:05:31.373484    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:05:31.375709 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:05:31.375688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:05:31.376968 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:05:31.376947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:10:31.402839 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:10:31.402804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:10:31.404887 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:10:31.404867    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:10:31.406090 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:10:31.406071    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:10:31.408370 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:10:31.408345    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:15:31.438039 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:15:31.438005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:15:31.440214 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:15:31.440190    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:15:31.441515 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:15:31.441493    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:15:31.443621 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:15:31.443601    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:16:21.020030 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.019993    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:16:21.024465 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.024440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.028712 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.028685    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ba1e3d30-serving-cert\""
Jul 15 19:16:21.034908 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.034884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:16:21.163536 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.163468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67lc\" (UniqueName: \"kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.163855 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.163622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.163855 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.163646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.264791 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.264737    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67lc\" (UniqueName: \"kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.265014 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.264833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.265014 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.264865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.265014 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:16:21.264998    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-serving-cert: secret "maas-api-e2e-ait-ba1e3d30-serving-cert" not found
Jul 15 19:16:21.265436 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:16:21.265065    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls podName:c2b5b894-9147-44b0-be63-8c26ef4066a5 nodeName:}" failed. No retries permitted until 2026-07-15 19:16:21.765042307 +0000 UTC m=+1550.876348807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls") pod "maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" (UID: "c2b5b894-9147-44b0-be63-8c26ef4066a5") : secret "maas-api-e2e-ait-ba1e3d30-serving-cert" not found
Jul 15 19:16:21.265484 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.265458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.277881 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.277807    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67lc\" (UniqueName: \"kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.771199 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.771154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.773884 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.773857    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") pod \"maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:21.938280 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:21.938246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:22.092177 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.092149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:16:22.094604 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:16:22.094554    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b5b894_9147_44b0_be63_8c26ef4066a5.slice/crio-51a75fa945d4e39d8302c653993f40f289fc373d92c91aa9819f69854cf805ef WatchSource:0}: Error finding container 51a75fa945d4e39d8302c653993f40f289fc373d92c91aa9819f69854cf805ef: Status 404 returned error can't find the container with id 51a75fa945d4e39d8302c653993f40f289fc373d92c91aa9819f69854cf805ef
Jul 15 19:16:22.095974 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.095957    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:16:22.881015 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.880919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" event={"ID":"c2b5b894-9147-44b0-be63-8c26ef4066a5","Type":"ContainerStarted","Data":"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"}
Jul 15 19:16:22.881015 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.880968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" event={"ID":"c2b5b894-9147-44b0-be63-8c26ef4066a5","Type":"ContainerStarted","Data":"51a75fa945d4e39d8302c653993f40f289fc373d92c91aa9819f69854cf805ef"}
Jul 15 19:16:22.881015 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.881006    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:16:22.902810 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:22.902757    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" podStartSLOduration=2.387724736 podStartE2EDuration="2.902741075s" totalImagesPullingTime="515.016339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:16:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:16:22.901242442 +0000 UTC m=+1552.012548958" watchObservedRunningTime="2026-07-15 19:16:22.902741075 +0000 UTC m=+1552.014047634"
Jul 15 19:16:28.891659 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:16:28.891623    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:17:36.384938 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.384903    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:17:36.385532 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.385134    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" podUID="c2b5b894-9147-44b0-be63-8c26ef4066a5" containerName="maas-api" containerID="cri-o://daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c" gracePeriod=30
Jul 15 19:17:36.634427 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.634399    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:17:36.769494 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.769456    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca\") pod \"c2b5b894-9147-44b0-be63-8c26ef4066a5\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") "
Jul 15 19:17:36.769732 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.769524    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q67lc\" (UniqueName: \"kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc\") pod \"c2b5b894-9147-44b0-be63-8c26ef4066a5\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") "
Jul 15 19:17:36.769732 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.769612    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") pod \"c2b5b894-9147-44b0-be63-8c26ef4066a5\" (UID: \"c2b5b894-9147-44b0-be63-8c26ef4066a5\") "
Jul 15 19:17:36.769956 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.769930    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2b5b894-9147-44b0-be63-8c26ef4066a5" (UID: "c2b5b894-9147-44b0-be63-8c26ef4066a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:17:36.771969 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.771937    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2b5b894-9147-44b0-be63-8c26ef4066a5" (UID: "c2b5b894-9147-44b0-be63-8c26ef4066a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:17:36.772074 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.772015    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc" (OuterVolumeSpecName: "kube-api-access-q67lc") pod "c2b5b894-9147-44b0-be63-8c26ef4066a5" (UID: "c2b5b894-9147-44b0-be63-8c26ef4066a5"). InnerVolumeSpecName "kube-api-access-q67lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:17:36.870445 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.870404    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b5b894-9147-44b0-be63-8c26ef4066a5-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:17:36.870445 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.870438    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q67lc\" (UniqueName: \"kubernetes.io/projected/c2b5b894-9147-44b0-be63-8c26ef4066a5-kube-api-access-q67lc\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:17:36.870445 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:36.870448    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b5b894-9147-44b0-be63-8c26ef4066a5-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:17:37.237017 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.236981    2562 generic.go:356] "Generic (PLEG): container finished" podID="c2b5b894-9147-44b0-be63-8c26ef4066a5" containerID="daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c" exitCode=0
Jul 15 19:17:37.237192 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.237045    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"
Jul 15 19:17:37.237192 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.237072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" event={"ID":"c2b5b894-9147-44b0-be63-8c26ef4066a5","Type":"ContainerDied","Data":"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"}
Jul 15 19:17:37.237192 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.237164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q" event={"ID":"c2b5b894-9147-44b0-be63-8c26ef4066a5","Type":"ContainerDied","Data":"51a75fa945d4e39d8302c653993f40f289fc373d92c91aa9819f69854cf805ef"}
Jul 15 19:17:37.237192 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.237192    2562 scope.go:117] "RemoveContainer" containerID="daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"
Jul 15 19:17:37.246820 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.246801    2562 scope.go:117] "RemoveContainer" containerID="daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"
Jul 15 19:17:37.247089 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:17:37.247072    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c\": container with ID starting with daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c not found: ID does not exist" containerID="daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"
Jul 15 19:17:37.247135 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.247098    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c"} err="failed to get container status \"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c\": rpc error: code = NotFound desc = could not find container \"daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c\": container with ID starting with daac0f400c3da87df9c54382f3fde14dffc15a45c43519ceb712d33a1993098c not found: ID does not exist"
Jul 15 19:17:37.261497 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.261465    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:17:37.267462 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.267438    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ba1e3d30-8f7488c76-8vr9q"]
Jul 15 19:17:37.419478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:37.419445    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b5b894-9147-44b0-be63-8c26ef4066a5" path="/var/lib/kubelet/pods/c2b5b894-9147-44b0-be63-8c26ef4066a5/volumes"
Jul 15 19:17:53.421215 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.421184    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:17:53.421615 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.421600    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b5b894-9147-44b0-be63-8c26ef4066a5" containerName="maas-api"
Jul 15 19:17:53.421665 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.421618    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b5b894-9147-44b0-be63-8c26ef4066a5" containerName="maas-api"
Jul 15 19:17:53.421708 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.421689    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b5b894-9147-44b0-be63-8c26ef4066a5" containerName="maas-api"
Jul 15 19:17:53.426342 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.426320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.442677 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.442641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-9df5bb53-serving-cert\""
Jul 15 19:17:53.444899 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.444871    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:17:53.528306 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.528273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.528516 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.528423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.528516 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.528481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66rhp\" (UniqueName: \"kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.629815 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.629775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.629965 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.629828    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66rhp\" (UniqueName: \"kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.629965 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:17:53.629936    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-serving-cert: secret "maas-api-e2e-migrate-9df5bb53-serving-cert" not found
Jul 15 19:17:53.630054 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.630008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.630054 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:17:53.630025    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls podName:f868db48-5fbb-43c4-b383-0de8b52b01a1 nodeName:}" failed. No retries permitted until 2026-07-15 19:17:54.130000493 +0000 UTC m=+1643.241306988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls") pod "maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" (UID: "f868db48-5fbb-43c4-b383-0de8b52b01a1") : secret "maas-api-e2e-migrate-9df5bb53-serving-cert" not found
Jul 15 19:17:53.630619 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.630602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:53.669106 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:53.669070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66rhp\" (UniqueName: \"kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:54.134352 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:54.134312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:54.136992 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:54.136962    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") pod \"maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:54.337110 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:54.337065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:54.497806 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:54.497777    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:17:54.499464 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:17:54.499439    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf868db48_5fbb_43c4_b383_0de8b52b01a1.slice/crio-8b6a27f7c4df98957666b6ee9b8a30d6bbf1f50323534fd85ad2d488b558f3fc WatchSource:0}: Error finding container 8b6a27f7c4df98957666b6ee9b8a30d6bbf1f50323534fd85ad2d488b558f3fc: Status 404 returned error can't find the container with id 8b6a27f7c4df98957666b6ee9b8a30d6bbf1f50323534fd85ad2d488b558f3fc
Jul 15 19:17:55.330739 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:55.330707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" event={"ID":"f868db48-5fbb-43c4-b383-0de8b52b01a1","Type":"ContainerStarted","Data":"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"}
Jul 15 19:17:55.330914 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:55.330758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" event={"ID":"f868db48-5fbb-43c4-b383-0de8b52b01a1","Type":"ContainerStarted","Data":"8b6a27f7c4df98957666b6ee9b8a30d6bbf1f50323534fd85ad2d488b558f3fc"}
Jul 15 19:17:55.330914 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:55.330795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:17:55.350786 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:17:55.350736    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" podStartSLOduration=1.692974743 podStartE2EDuration="2.350719844s" totalImagesPullingTime="657.745101ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:17:55.349417339 +0000 UTC m=+1644.460723854" watchObservedRunningTime="2026-07-15 19:17:55.350719844 +0000 UTC m=+1644.462026360"
Jul 15 19:18:01.342345 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:18:01.342306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:19:03.374398 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.374300    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:19:03.374860 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.374592    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" podUID="f868db48-5fbb-43c4-b383-0de8b52b01a1" containerName="maas-api" containerID="cri-o://dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085" gracePeriod=30
Jul 15 19:19:03.624029 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.624003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:19:03.655707 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.655629    2562 generic.go:356] "Generic (PLEG): container finished" podID="f868db48-5fbb-43c4-b383-0de8b52b01a1" containerID="dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085" exitCode=0
Jul 15 19:19:03.655707 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.655675    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"
Jul 15 19:19:03.655880 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.655718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" event={"ID":"f868db48-5fbb-43c4-b383-0de8b52b01a1","Type":"ContainerDied","Data":"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"}
Jul 15 19:19:03.655880 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.655764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55" event={"ID":"f868db48-5fbb-43c4-b383-0de8b52b01a1","Type":"ContainerDied","Data":"8b6a27f7c4df98957666b6ee9b8a30d6bbf1f50323534fd85ad2d488b558f3fc"}
Jul 15 19:19:03.655880 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.655784    2562 scope.go:117] "RemoveContainer" containerID="dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"
Jul 15 19:19:03.665898 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.665874    2562 scope.go:117] "RemoveContainer" containerID="dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"
Jul 15 19:19:03.666204 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:19:03.666183    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085\": container with ID starting with dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085 not found: ID does not exist" containerID="dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"
Jul 15 19:19:03.666267 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.666219    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085"} err="failed to get container status \"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085\": rpc error: code = NotFound desc = could not find container \"dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085\": container with ID starting with dced5f4d7560d6529bff4d7652640ee5f7fe75a27552df9a0ed4651cc977b085 not found: ID does not exist"
Jul 15 19:19:03.777918 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.777886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca\") pod \"f868db48-5fbb-43c4-b383-0de8b52b01a1\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") "
Jul 15 19:19:03.777918 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.777924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66rhp\" (UniqueName: \"kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp\") pod \"f868db48-5fbb-43c4-b383-0de8b52b01a1\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") "
Jul 15 19:19:03.778171 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.777947    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") pod \"f868db48-5fbb-43c4-b383-0de8b52b01a1\" (UID: \"f868db48-5fbb-43c4-b383-0de8b52b01a1\") "
Jul 15 19:19:03.778276 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.778251    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f868db48-5fbb-43c4-b383-0de8b52b01a1" (UID: "f868db48-5fbb-43c4-b383-0de8b52b01a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:19:03.780210 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.780175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f868db48-5fbb-43c4-b383-0de8b52b01a1" (UID: "f868db48-5fbb-43c4-b383-0de8b52b01a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:19:03.780342 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.780277    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp" (OuterVolumeSpecName: "kube-api-access-66rhp") pod "f868db48-5fbb-43c4-b383-0de8b52b01a1" (UID: "f868db48-5fbb-43c4-b383-0de8b52b01a1"). InnerVolumeSpecName "kube-api-access-66rhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:19:03.884904 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.879966    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f868db48-5fbb-43c4-b383-0de8b52b01a1-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.884904 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.880005    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66rhp\" (UniqueName: \"kubernetes.io/projected/f868db48-5fbb-43c4-b383-0de8b52b01a1-kube-api-access-66rhp\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.884904 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.880019    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f868db48-5fbb-43c4-b383-0de8b52b01a1-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:19:03.978956 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.978921    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:19:03.983586 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:03.983546    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-9df5bb53-75c8577b66-8dx55"]
Jul 15 19:19:05.422134 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:05.422090    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f868db48-5fbb-43c4-b383-0de8b52b01a1" path="/var/lib/kubelet/pods/f868db48-5fbb-43c4-b383-0de8b52b01a1/volumes"
Jul 15 19:19:11.104160 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.104128    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:19:11.104604 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.104498    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f868db48-5fbb-43c4-b383-0de8b52b01a1" containerName="maas-api"
Jul 15 19:19:11.104604 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.104510    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f868db48-5fbb-43c4-b383-0de8b52b01a1" containerName="maas-api"
Jul 15 19:19:11.104604 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.104596    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f868db48-5fbb-43c4-b383-0de8b52b01a1" containerName="maas-api"
Jul 15 19:19:11.109257 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.109232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.112163 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.112134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-109e9634-serving-cert\""
Jul 15 19:19:11.120451 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.120424    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:19:11.246075 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.246036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjhf\" (UniqueName: \"kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.246277 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.246085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.246277 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.246173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.346914 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.346873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.347126 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.346955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjhf\" (UniqueName: \"kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.347126 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.346981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.347126 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:19:11.347096    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-serving-cert: secret "maas-api-e2e-ait-109e9634-serving-cert" not found
Jul 15 19:19:11.347307 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:19:11.347167    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls podName:05ba2d08-5aeb-4be7-8ef9-62203734bb13 nodeName:}" failed. No retries permitted until 2026-07-15 19:19:11.847148174 +0000 UTC m=+1720.958454669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls") pod "maas-api-e2e-ait-109e9634-77459bd7d8-4stft" (UID: "05ba2d08-5aeb-4be7-8ef9-62203734bb13") : secret "maas-api-e2e-ait-109e9634-serving-cert" not found
Jul 15 19:19:11.347555 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.347532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.357645 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.357556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjhf\" (UniqueName: \"kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.850785 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.850751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:11.853379 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:11.853354    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") pod \"maas-api-e2e-ait-109e9634-77459bd7d8-4stft\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:12.020809 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:12.020766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:12.167186 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:12.167154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:19:12.169465 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:19:12.169426    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ba2d08_5aeb_4be7_8ef9_62203734bb13.slice/crio-db4b37279a2ec6b45563ba01a212a2ca6a2d79ce88e3fa3bba818a952738d81c WatchSource:0}: Error finding container db4b37279a2ec6b45563ba01a212a2ca6a2d79ce88e3fa3bba818a952738d81c: Status 404 returned error can't find the container with id db4b37279a2ec6b45563ba01a212a2ca6a2d79ce88e3fa3bba818a952738d81c
Jul 15 19:19:12.705059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:12.705017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" event={"ID":"05ba2d08-5aeb-4be7-8ef9-62203734bb13","Type":"ContainerStarted","Data":"db4b37279a2ec6b45563ba01a212a2ca6a2d79ce88e3fa3bba818a952738d81c"}
Jul 15 19:19:13.711086 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:13.711047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" event={"ID":"05ba2d08-5aeb-4be7-8ef9-62203734bb13","Type":"ContainerStarted","Data":"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"}
Jul 15 19:19:13.711490 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:13.711186    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:19:13.735727 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:13.735678    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" podStartSLOduration=2.243255144 podStartE2EDuration="2.735660721s" totalImagesPullingTime="492.405577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:19:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:19:13.734049863 +0000 UTC m=+1722.845356381" watchObservedRunningTime="2026-07-15 19:19:13.735660721 +0000 UTC m=+1722.846967237"
Jul 15 19:19:19.721553 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:19:19.721523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:20:26.796346 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:26.796261    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:20:26.799126 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:26.796487    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" podUID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" containerName="maas-api" containerID="cri-o://e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436" gracePeriod=30
Jul 15 19:20:27.047181 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.047119    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:20:27.052024 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.052001    2562 generic.go:356] "Generic (PLEG): container finished" podID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" containerID="e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436" exitCode=0
Jul 15 19:20:27.052133 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.052036    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"
Jul 15 19:20:27.052133 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.052078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" event={"ID":"05ba2d08-5aeb-4be7-8ef9-62203734bb13","Type":"ContainerDied","Data":"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"}
Jul 15 19:20:27.052217 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.052133    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft" event={"ID":"05ba2d08-5aeb-4be7-8ef9-62203734bb13","Type":"ContainerDied","Data":"db4b37279a2ec6b45563ba01a212a2ca6a2d79ce88e3fa3bba818a952738d81c"}
Jul 15 19:20:27.052217 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.052160    2562 scope.go:117] "RemoveContainer" containerID="e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"
Jul 15 19:20:27.060337 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.060319    2562 scope.go:117] "RemoveContainer" containerID="e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"
Jul 15 19:20:27.060608 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:20:27.060590    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436\": container with ID starting with e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436 not found: ID does not exist" containerID="e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"
Jul 15 19:20:27.060659 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.060617    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436"} err="failed to get container status \"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436\": rpc error: code = NotFound desc = could not find container \"e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436\": container with ID starting with e9f7509ae8b6358063b5a1033d8ecd7c6d6e7e5e292eb7fdb5fb21923fa64436 not found: ID does not exist"
Jul 15 19:20:27.126976 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.126943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzjhf\" (UniqueName: \"kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf\") pod \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") "
Jul 15 19:20:27.127147 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.126998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") pod \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") "
Jul 15 19:20:27.127147 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.127028    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca\") pod \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\" (UID: \"05ba2d08-5aeb-4be7-8ef9-62203734bb13\") "
Jul 15 19:20:27.127468 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.127437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05ba2d08-5aeb-4be7-8ef9-62203734bb13" (UID: "05ba2d08-5aeb-4be7-8ef9-62203734bb13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:20:27.129234 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.129209    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf" (OuterVolumeSpecName: "kube-api-access-lzjhf") pod "05ba2d08-5aeb-4be7-8ef9-62203734bb13" (UID: "05ba2d08-5aeb-4be7-8ef9-62203734bb13"). InnerVolumeSpecName "kube-api-access-lzjhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:20:27.129234 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.129215    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05ba2d08-5aeb-4be7-8ef9-62203734bb13" (UID: "05ba2d08-5aeb-4be7-8ef9-62203734bb13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:20:27.227859 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.227819    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05ba2d08-5aeb-4be7-8ef9-62203734bb13-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:20:27.227859 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.227852    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05ba2d08-5aeb-4be7-8ef9-62203734bb13-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:20:27.227859 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.227865    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjhf\" (UniqueName: \"kubernetes.io/projected/05ba2d08-5aeb-4be7-8ef9-62203734bb13-kube-api-access-lzjhf\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:20:27.379217 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.379182    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:20:27.384978 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.384953    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-109e9634-77459bd7d8-4stft"]
Jul 15 19:20:27.419281 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:27.419237    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" path="/var/lib/kubelet/pods/05ba2d08-5aeb-4be7-8ef9-62203734bb13/volumes"
Jul 15 19:20:31.467166 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:31.467135    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:20:31.470150 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:31.470128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:20:31.470713 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:31.470695    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:20:31.473449 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:31.473428    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:20:43.863151 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.863114    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:20:43.863616 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.863503    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" containerName="maas-api"
Jul 15 19:20:43.863616 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.863518    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" containerName="maas-api"
Jul 15 19:20:43.863723 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.863629    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ba2d08-5aeb-4be7-8ef9-62203734bb13" containerName="maas-api"
Jul 15 19:20:43.866716 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.866698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:43.870267 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.870242    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b5322848-serving-cert\""
Jul 15 19:20:43.885907 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.885874    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:20:43.974919 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.974865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:43.975138 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.974934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgnkb\" (UniqueName: \"kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:43.975138 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:43.975028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.076278 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.076231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.076478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.076287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgnkb\" (UniqueName: \"kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.076478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.076323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.076478 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:20:44.076400    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-serving-cert: secret "maas-api-e2e-derive-b5322848-serving-cert" not found
Jul 15 19:20:44.076478 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:20:44.076470    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls podName:02e25968-176e-4556-abfa-89ed0fe6351e nodeName:}" failed. No retries permitted until 2026-07-15 19:20:44.576451784 +0000 UTC m=+1813.687758278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls") pod "maas-api-e2e-derive-b5322848-674c88c554-x62bz" (UID: "02e25968-176e-4556-abfa-89ed0fe6351e") : secret "maas-api-e2e-derive-b5322848-serving-cert" not found
Jul 15 19:20:44.076993 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.076974    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.096426 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.096395    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgnkb\" (UniqueName: \"kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.581813 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.581771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.584536 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.584509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") pod \"maas-api-e2e-derive-b5322848-674c88c554-x62bz\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.778298 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.778259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:44.923430 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:44.923397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:20:44.927157 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:20:44.927126    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e25968_176e_4556_abfa_89ed0fe6351e.slice/crio-79f17092436523bd222e1c9dfdbfe93dc19e8d13b23f5c032a8977f10e37d77f WatchSource:0}: Error finding container 79f17092436523bd222e1c9dfdbfe93dc19e8d13b23f5c032a8977f10e37d77f: Status 404 returned error can't find the container with id 79f17092436523bd222e1c9dfdbfe93dc19e8d13b23f5c032a8977f10e37d77f
Jul 15 19:20:45.140400 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:45.140306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" event={"ID":"02e25968-176e-4556-abfa-89ed0fe6351e","Type":"ContainerStarted","Data":"79f17092436523bd222e1c9dfdbfe93dc19e8d13b23f5c032a8977f10e37d77f"}
Jul 15 19:20:46.146942 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:46.146896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" event={"ID":"02e25968-176e-4556-abfa-89ed0fe6351e","Type":"ContainerStarted","Data":"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"}
Jul 15 19:20:46.147337 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:46.147011    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:20:46.172340 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:46.172287    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" podStartSLOduration=2.6388706600000003 podStartE2EDuration="3.172270486s" totalImagesPullingTime="533.399826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:20:46.168707267 +0000 UTC m=+1815.280013784" watchObservedRunningTime="2026-07-15 19:20:46.172270486 +0000 UTC m=+1815.283576999"
Jul 15 19:20:52.158499 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:20:52.158464    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:21:48.957132 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:48.957095    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:21:48.957664 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:48.957320    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" podUID="02e25968-176e-4556-abfa-89ed0fe6351e" containerName="maas-api" containerID="cri-o://d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5" gracePeriod=30
Jul 15 19:21:49.210121 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.210045    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:21:49.277733 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.277693    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgnkb\" (UniqueName: \"kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb\") pod \"02e25968-176e-4556-abfa-89ed0fe6351e\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") "
Jul 15 19:21:49.277733 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.277742    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca\") pod \"02e25968-176e-4556-abfa-89ed0fe6351e\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") "
Jul 15 19:21:49.277997 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.277797    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") pod \"02e25968-176e-4556-abfa-89ed0fe6351e\" (UID: \"02e25968-176e-4556-abfa-89ed0fe6351e\") "
Jul 15 19:21:49.278204 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.278170    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02e25968-176e-4556-abfa-89ed0fe6351e" (UID: "02e25968-176e-4556-abfa-89ed0fe6351e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:21:49.280012 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.279976    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02e25968-176e-4556-abfa-89ed0fe6351e" (UID: "02e25968-176e-4556-abfa-89ed0fe6351e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:21:49.280108 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.280044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb" (OuterVolumeSpecName: "kube-api-access-sgnkb") pod "02e25968-176e-4556-abfa-89ed0fe6351e" (UID: "02e25968-176e-4556-abfa-89ed0fe6351e"). InnerVolumeSpecName "kube-api-access-sgnkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:21:49.378915 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.378872    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e25968-176e-4556-abfa-89ed0fe6351e-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:21:49.378915 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.378907    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgnkb\" (UniqueName: \"kubernetes.io/projected/02e25968-176e-4556-abfa-89ed0fe6351e-kube-api-access-sgnkb\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:21:49.378915 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.378917    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e25968-176e-4556-abfa-89ed0fe6351e-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:21:49.456653 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.456618    2562 generic.go:356] "Generic (PLEG): container finished" podID="02e25968-176e-4556-abfa-89ed0fe6351e" containerID="d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5" exitCode=0
Jul 15 19:21:49.456830 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.456660    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"
Jul 15 19:21:49.456830 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.456685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" event={"ID":"02e25968-176e-4556-abfa-89ed0fe6351e","Type":"ContainerDied","Data":"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"}
Jul 15 19:21:49.456830 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.456736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz" event={"ID":"02e25968-176e-4556-abfa-89ed0fe6351e","Type":"ContainerDied","Data":"79f17092436523bd222e1c9dfdbfe93dc19e8d13b23f5c032a8977f10e37d77f"}
Jul 15 19:21:49.456830 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.456758    2562 scope.go:117] "RemoveContainer" containerID="d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"
Jul 15 19:21:49.466237 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.466224    2562 scope.go:117] "RemoveContainer" containerID="d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"
Jul 15 19:21:49.466879 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:21:49.466802    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5\": container with ID starting with d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5 not found: ID does not exist" containerID="d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"
Jul 15 19:21:49.466879 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.466839    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5"} err="failed to get container status \"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5\": rpc error: code = NotFound desc = could not find container \"d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5\": container with ID starting with d97263a4079f97e1fb02a63625d5a7976fffd4b725adf84efddb2270e31065d5 not found: ID does not exist"
Jul 15 19:21:49.477057 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.477031    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:21:49.479902 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:49.479876    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b5322848-674c88c554-x62bz"]
Jul 15 19:21:51.419194 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:21:51.419158    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e25968-176e-4556-abfa-89ed0fe6351e" path="/var/lib/kubelet/pods/02e25968-176e-4556-abfa-89ed0fe6351e/volumes"
Jul 15 19:23:47.725492 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.725405    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:23:47.726082 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.725994    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e25968-176e-4556-abfa-89ed0fe6351e" containerName="maas-api"
Jul 15 19:23:47.726082 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.726015    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e25968-176e-4556-abfa-89ed0fe6351e" containerName="maas-api"
Jul 15 19:23:47.726199 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.726110    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e25968-176e-4556-abfa-89ed0fe6351e" containerName="maas-api"
Jul 15 19:23:47.729183 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.729161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.731746 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.731723    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-23ae53ab-serving-cert\""
Jul 15 19:23:47.743730 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.743700    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:23:47.835480 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.835439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htsh4\" (UniqueName: \"kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.835729 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.835611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.835729 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.835660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.936887 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.936849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.936887 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.936891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.937146 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.937014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htsh4\" (UniqueName: \"kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.937619 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.937599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.939684 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.939656    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:47.949883 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:47.949861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htsh4\" (UniqueName: \"kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4\") pod \"maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:48.040486 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:48.040389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:48.189554 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:48.189508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:23:48.191918 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:23:48.191891    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7165b411_da40_4b1e_a633_a0d6af2059dd.slice/crio-a6ced276b6eba7ae2614a6615fe9e6b847ebc00e001fb4dc54512899c1abd268 WatchSource:0}: Error finding container a6ced276b6eba7ae2614a6615fe9e6b847ebc00e001fb4dc54512899c1abd268: Status 404 returned error can't find the container with id a6ced276b6eba7ae2614a6615fe9e6b847ebc00e001fb4dc54512899c1abd268
Jul 15 19:23:48.193292 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:48.193273    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:23:49.026518 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:49.026436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" event={"ID":"7165b411-da40-4b1e-a633-a0d6af2059dd","Type":"ContainerStarted","Data":"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"}
Jul 15 19:23:49.026518 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:49.026486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" event={"ID":"7165b411-da40-4b1e-a633-a0d6af2059dd","Type":"ContainerStarted","Data":"a6ced276b6eba7ae2614a6615fe9e6b847ebc00e001fb4dc54512899c1abd268"}
Jul 15 19:23:49.026991 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:49.026553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:23:49.051030 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:49.050980    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" podStartSLOduration=1.556955576 podStartE2EDuration="2.050961014s" totalImagesPullingTime="494.005438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:23:49.048793589 +0000 UTC m=+1998.160100105" watchObservedRunningTime="2026-07-15 19:23:49.050961014 +0000 UTC m=+1998.162267529"
Jul 15 19:23:55.037894 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:23:55.037860    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:24:10.313658 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.313625    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:24:10.314083 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.313866    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" podUID="7165b411-da40-4b1e-a633-a0d6af2059dd" containerName="maas-api" containerID="cri-o://c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8" gracePeriod=30
Jul 15 19:24:10.568557 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.568496    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:24:10.639625 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.639588    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca\") pod \"7165b411-da40-4b1e-a633-a0d6af2059dd\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") "
Jul 15 19:24:10.639794 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.639659    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls\") pod \"7165b411-da40-4b1e-a633-a0d6af2059dd\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") "
Jul 15 19:24:10.639794 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.639682    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htsh4\" (UniqueName: \"kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4\") pod \"7165b411-da40-4b1e-a633-a0d6af2059dd\" (UID: \"7165b411-da40-4b1e-a633-a0d6af2059dd\") "
Jul 15 19:24:10.639941 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.639879    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7165b411-da40-4b1e-a633-a0d6af2059dd" (UID: "7165b411-da40-4b1e-a633-a0d6af2059dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:24:10.642016 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.641979    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4" (OuterVolumeSpecName: "kube-api-access-htsh4") pod "7165b411-da40-4b1e-a633-a0d6af2059dd" (UID: "7165b411-da40-4b1e-a633-a0d6af2059dd"). InnerVolumeSpecName "kube-api-access-htsh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:24:10.642016 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.641997    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7165b411-da40-4b1e-a633-a0d6af2059dd" (UID: "7165b411-da40-4b1e-a633-a0d6af2059dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:24:10.740778 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.740736    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7165b411-da40-4b1e-a633-a0d6af2059dd-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:24:10.740778 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.740772    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7165b411-da40-4b1e-a633-a0d6af2059dd-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:24:10.740778 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:10.740781    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htsh4\" (UniqueName: \"kubernetes.io/projected/7165b411-da40-4b1e-a633-a0d6af2059dd-kube-api-access-htsh4\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:24:11.131509 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.131471    2562 generic.go:356] "Generic (PLEG): container finished" podID="7165b411-da40-4b1e-a633-a0d6af2059dd" containerID="c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8" exitCode=0
Jul 15 19:24:11.131690 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.131522    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"
Jul 15 19:24:11.131690 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.131559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" event={"ID":"7165b411-da40-4b1e-a633-a0d6af2059dd","Type":"ContainerDied","Data":"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"}
Jul 15 19:24:11.131690 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.131647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv" event={"ID":"7165b411-da40-4b1e-a633-a0d6af2059dd","Type":"ContainerDied","Data":"a6ced276b6eba7ae2614a6615fe9e6b847ebc00e001fb4dc54512899c1abd268"}
Jul 15 19:24:11.131690 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.131679    2562 scope.go:117] "RemoveContainer" containerID="c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"
Jul 15 19:24:11.141782 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.141755    2562 scope.go:117] "RemoveContainer" containerID="c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"
Jul 15 19:24:11.142119 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:24:11.142096    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8\": container with ID starting with c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8 not found: ID does not exist" containerID="c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"
Jul 15 19:24:11.142201 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.142129    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8"} err="failed to get container status \"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8\": rpc error: code = NotFound desc = could not find container \"c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8\": container with ID starting with c7e78caeb45020e313ac1d8759e6d6faa65474dd2ea8c49bc9d0718e695c02d8 not found: ID does not exist"
Jul 15 19:24:11.157160 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.157124    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:24:11.161239 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.161210    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-23ae53ab-b8748bd5b-zzqbv"]
Jul 15 19:24:11.419168 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:11.419074    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7165b411-da40-4b1e-a633-a0d6af2059dd" path="/var/lib/kubelet/pods/7165b411-da40-4b1e-a633-a0d6af2059dd/volumes"
Jul 15 19:24:48.821631 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.821593    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:24:48.822234 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.822212    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7165b411-da40-4b1e-a633-a0d6af2059dd" containerName="maas-api"
Jul 15 19:24:48.822300 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.822238    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7165b411-da40-4b1e-a633-a0d6af2059dd" containerName="maas-api"
Jul 15 19:24:48.822385 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.822371    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7165b411-da40-4b1e-a633-a0d6af2059dd" containerName="maas-api"
Jul 15 19:24:48.825922 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.825898    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.828805 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.828783    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-52712cae-serving-cert\""
Jul 15 19:24:48.837106 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.837083    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:24:48.887616 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.887556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcx6\" (UniqueName: \"kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.887804 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.887644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.887804 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.887684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.988583 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.988538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.988745 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.988617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcx6\" (UniqueName: \"kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.988745 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.988651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.989261 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.989244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:48.991097 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:48.991077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:49.003666 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:49.003631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcx6\" (UniqueName: \"kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6\") pod \"maas-api-e2e-mt-52712cae-64dffd9648-m9pq9\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:49.138930 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:49.138834    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:49.514531 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:49.514495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:24:49.523815 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:24:49.523783    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d094fc4_3387_4947_988f_4d51f2fc0f10.slice/crio-b439dcd81c4a0d012c184d0121b7899fa5f8d69847fb9a3ddee7f21ff193c4a1 WatchSource:0}: Error finding container b439dcd81c4a0d012c184d0121b7899fa5f8d69847fb9a3ddee7f21ff193c4a1: Status 404 returned error can't find the container with id b439dcd81c4a0d012c184d0121b7899fa5f8d69847fb9a3ddee7f21ff193c4a1
Jul 15 19:24:50.314137 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:50.314036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" event={"ID":"3d094fc4-3387-4947-988f-4d51f2fc0f10","Type":"ContainerStarted","Data":"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"}
Jul 15 19:24:50.314137 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:50.314132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" event={"ID":"3d094fc4-3387-4947-988f-4d51f2fc0f10","Type":"ContainerStarted","Data":"b439dcd81c4a0d012c184d0121b7899fa5f8d69847fb9a3ddee7f21ff193c4a1"}
Jul 15 19:24:50.314673 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:50.314180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:24:50.343356 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:50.343287    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" podStartSLOduration=1.849297681 podStartE2EDuration="2.343270312s" totalImagesPullingTime="493.972631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:24:50.341834836 +0000 UTC m=+2059.453141372" watchObservedRunningTime="2026-07-15 19:24:50.343270312 +0000 UTC m=+2059.454576880"
Jul 15 19:24:56.325507 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:24:56.325472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:25:31.497099 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:31.497066    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:25:31.500629 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:31.500608    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:25:31.500815 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:31.500796    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:25:31.504432 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:31.504411    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:25:57.940667 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:57.940634    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:25:57.941213 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:57.940833    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" podUID="3d094fc4-3387-4947-988f-4d51f2fc0f10" containerName="maas-api" containerID="cri-o://df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead" gracePeriod=30
Jul 15 19:25:58.192057 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.191989    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:25:58.318457 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.318419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca\") pod \"3d094fc4-3387-4947-988f-4d51f2fc0f10\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") "
Jul 15 19:25:58.318665 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.318527    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls\") pod \"3d094fc4-3387-4947-988f-4d51f2fc0f10\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") "
Jul 15 19:25:58.318665 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.318597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltcx6\" (UniqueName: \"kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6\") pod \"3d094fc4-3387-4947-988f-4d51f2fc0f10\" (UID: \"3d094fc4-3387-4947-988f-4d51f2fc0f10\") "
Jul 15 19:25:58.318870 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.318846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d094fc4-3387-4947-988f-4d51f2fc0f10" (UID: "3d094fc4-3387-4947-988f-4d51f2fc0f10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:25:58.320897 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.320867    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6" (OuterVolumeSpecName: "kube-api-access-ltcx6") pod "3d094fc4-3387-4947-988f-4d51f2fc0f10" (UID: "3d094fc4-3387-4947-988f-4d51f2fc0f10"). InnerVolumeSpecName "kube-api-access-ltcx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:25:58.320958 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.320912    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d094fc4-3387-4947-988f-4d51f2fc0f10" (UID: "3d094fc4-3387-4947-988f-4d51f2fc0f10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:25:58.419898 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.419863    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltcx6\" (UniqueName: \"kubernetes.io/projected/3d094fc4-3387-4947-988f-4d51f2fc0f10-kube-api-access-ltcx6\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:25:58.419898 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.419891    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d094fc4-3387-4947-988f-4d51f2fc0f10-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:25:58.419898 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.419901    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d094fc4-3387-4947-988f-4d51f2fc0f10-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:25:58.643855 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.643764    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d094fc4-3387-4947-988f-4d51f2fc0f10" containerID="df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead" exitCode=0
Jul 15 19:25:58.643855 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.643809    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"
Jul 15 19:25:58.644039 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.643856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" event={"ID":"3d094fc4-3387-4947-988f-4d51f2fc0f10","Type":"ContainerDied","Data":"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"}
Jul 15 19:25:58.644039 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.643910    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9" event={"ID":"3d094fc4-3387-4947-988f-4d51f2fc0f10","Type":"ContainerDied","Data":"b439dcd81c4a0d012c184d0121b7899fa5f8d69847fb9a3ddee7f21ff193c4a1"}
Jul 15 19:25:58.644039 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.643935    2562 scope.go:117] "RemoveContainer" containerID="df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"
Jul 15 19:25:58.653003 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.652980    2562 scope.go:117] "RemoveContainer" containerID="df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"
Jul 15 19:25:58.653299 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:25:58.653279    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead\": container with ID starting with df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead not found: ID does not exist" containerID="df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"
Jul 15 19:25:58.653351 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.653308    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead"} err="failed to get container status \"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead\": rpc error: code = NotFound desc = could not find container \"df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead\": container with ID starting with df4fe023c5db4936275ff755f4bef97e05ea2f7727819ead7deeae751b28eead not found: ID does not exist"
Jul 15 19:25:58.669520 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.669488    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:25:58.675101 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:58.675075    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-52712cae-64dffd9648-m9pq9"]
Jul 15 19:25:59.419447 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:25:59.419411    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d094fc4-3387-4947-988f-4d51f2fc0f10" path="/var/lib/kubelet/pods/3d094fc4-3387-4947-988f-4d51f2fc0f10/volumes"
Jul 15 19:28:02.825304 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.825266    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:28:02.825891 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.825868    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d094fc4-3387-4947-988f-4d51f2fc0f10" containerName="maas-api"
Jul 15 19:28:02.825969 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.825895    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d094fc4-3387-4947-988f-4d51f2fc0f10" containerName="maas-api"
Jul 15 19:28:02.826022 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.826003    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d094fc4-3387-4947-988f-4d51f2fc0f10" containerName="maas-api"
Jul 15 19:28:02.829127 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.829106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:02.833205 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.833183    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7b6049-serving-cert\""
Jul 15 19:28:02.842769 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.842740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:28:02.937760 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.937718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb9pj\" (UniqueName: \"kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:02.937760 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.937762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:02.938025 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:02.937819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.038785 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.038746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb9pj\" (UniqueName: \"kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.038785 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.038788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.039013 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.038817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.039528 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.039506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.041374 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.041355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.047967 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.047943    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb9pj\" (UniqueName: \"kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj\") pod \"maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.142112 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.142017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:03.292506 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:03.292478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:28:03.294659 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:28:03.294624    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda589b4_a1a0_4a9e_9f85_e34dcee8fec0.slice/crio-a6c2d47050de4466618163ab4be2a369e8f0e1ad4139d40bc6001931a985375f WatchSource:0}: Error finding container a6c2d47050de4466618163ab4be2a369e8f0e1ad4139d40bc6001931a985375f: Status 404 returned error can't find the container with id a6c2d47050de4466618163ab4be2a369e8f0e1ad4139d40bc6001931a985375f
Jul 15 19:28:04.256649 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:04.256617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" event={"ID":"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0","Type":"ContainerStarted","Data":"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"}
Jul 15 19:28:04.257037 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:04.256663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" event={"ID":"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0","Type":"ContainerStarted","Data":"a6c2d47050de4466618163ab4be2a369e8f0e1ad4139d40bc6001931a985375f"}
Jul 15 19:28:04.257037 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:04.256730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:04.295702 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:04.295646    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" podStartSLOduration=1.70749739 podStartE2EDuration="2.295627932s" totalImagesPullingTime="588.130542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:04.295482217 +0000 UTC m=+2253.406788743" watchObservedRunningTime="2026-07-15 19:28:04.295627932 +0000 UTC m=+2253.406934447"
Jul 15 19:28:10.267502 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:10.267465    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:28:11.015346 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.015310    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:28:11.019366 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.019328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.022217 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.022191    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1dfe1f-serving-cert\""
Jul 15 19:28:11.033148 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.033119    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:28:11.115011 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.114976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp4qx\" (UniqueName: \"kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.115011 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.115024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.115222 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.115049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.216271 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.216230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp4qx\" (UniqueName: \"kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.216271 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.216274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.216464 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.216292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.217056 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.216959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.218919 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.218897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.226087 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.226061    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp4qx\" (UniqueName: \"kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx\") pod \"maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.336159 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.336068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:11.487001 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:11.486969    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:28:11.489840 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:28:11.489810    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1cc0db_83c5_4d20_b920_dba4909ecb49.slice/crio-178dac07d283ef6169485ae242cdcade965b18694664603102ee6ee7359571da WatchSource:0}: Error finding container 178dac07d283ef6169485ae242cdcade965b18694664603102ee6ee7359571da: Status 404 returned error can't find the container with id 178dac07d283ef6169485ae242cdcade965b18694664603102ee6ee7359571da
Jul 15 19:28:12.297639 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:12.297600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" event={"ID":"ad1cc0db-83c5-4d20-b920-dba4909ecb49","Type":"ContainerStarted","Data":"178dac07d283ef6169485ae242cdcade965b18694664603102ee6ee7359571da"}
Jul 15 19:28:13.303637 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:13.303594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" event={"ID":"ad1cc0db-83c5-4d20-b920-dba4909ecb49","Type":"ContainerStarted","Data":"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"}
Jul 15 19:28:13.304042 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:13.303665    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:28:13.331984 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:13.331929    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" podStartSLOduration=2.493494082 podStartE2EDuration="3.331909997s" totalImagesPullingTime="838.415915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:28:13.32961674 +0000 UTC m=+2262.440923248" watchObservedRunningTime="2026-07-15 19:28:13.331909997 +0000 UTC m=+2262.443216519"
Jul 15 19:28:19.314101 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:28:19.314068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:29:15.247049 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.247016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:29:15.247636 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.247316    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerName="maas-api" containerID="cri-o://9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9" gracePeriod=30
Jul 15 19:29:15.262358 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.262318    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.42:8443/health\": dial tcp 10.132.0.42:8443: connect: connection refused"
Jul 15 19:29:15.502071 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.502004    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:29:15.516708 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.516682    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls\") pod \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") "
Jul 15 19:29:15.516802 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.516729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb9pj\" (UniqueName: \"kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj\") pod \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") "
Jul 15 19:29:15.516840 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.516810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca\") pod \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\" (UID: \"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0\") "
Jul 15 19:29:15.517182 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.517159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" (UID: "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:29:15.519406 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.519370    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" (UID: "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:29:15.519780 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.519750    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj" (OuterVolumeSpecName: "kube-api-access-lb9pj") pod "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" (UID: "fda589b4-a1a0-4a9e-9f85-e34dcee8fec0"). InnerVolumeSpecName "kube-api-access-lb9pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:29:15.609307 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.609269    2562 generic.go:356] "Generic (PLEG): container finished" podID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerID="9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9" exitCode=0
Jul 15 19:29:15.609497 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.609315    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"
Jul 15 19:29:15.609497 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.609324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" event={"ID":"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0","Type":"ContainerDied","Data":"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"}
Jul 15 19:29:15.609497 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.609367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw" event={"ID":"fda589b4-a1a0-4a9e-9f85-e34dcee8fec0","Type":"ContainerDied","Data":"a6c2d47050de4466618163ab4be2a369e8f0e1ad4139d40bc6001931a985375f"}
Jul 15 19:29:15.609497 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.609389    2562 scope.go:117] "RemoveContainer" containerID="9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"
Jul 15 19:29:15.617727 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.617703    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:15.617727 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.617728    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:15.617900 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.617737    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb9pj\" (UniqueName: \"kubernetes.io/projected/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0-kube-api-access-lb9pj\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:15.618821 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.618796    2562 scope.go:117] "RemoveContainer" containerID="9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"
Jul 15 19:29:15.619105 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:29:15.619085    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9\": container with ID starting with 9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9 not found: ID does not exist" containerID="9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"
Jul 15 19:29:15.619171 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.619113    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9"} err="failed to get container status \"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9\": rpc error: code = NotFound desc = could not find container \"9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9\": container with ID starting with 9e593f3ed321bebd713b3a6970f00f5219786c80b2c23453b65e7e224cb36dc9 not found: ID does not exist"
Jul 15 19:29:15.630620 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.630566    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:29:15.636041 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:15.636013    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7b6049-6cfbdcddc4-6m2tw"]
Jul 15 19:29:17.419868 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:17.419834    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" path="/var/lib/kubelet/pods/fda589b4-a1a0-4a9e-9f85-e34dcee8fec0/volumes"
Jul 15 19:29:41.649904 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:41.649862    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:29:41.650410 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:41.650112    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" podUID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" containerName="maas-api" containerID="cri-o://8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557" gracePeriod=30
Jul 15 19:29:41.911659 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:41.911562    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:29:42.051754 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.051711    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca\") pod \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") "
Jul 15 19:29:42.051952 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.051778    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp4qx\" (UniqueName: \"kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx\") pod \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") "
Jul 15 19:29:42.051952 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.051870    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls\") pod \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\" (UID: \"ad1cc0db-83c5-4d20-b920-dba4909ecb49\") "
Jul 15 19:29:42.052110 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.052082    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad1cc0db-83c5-4d20-b920-dba4909ecb49" (UID: "ad1cc0db-83c5-4d20-b920-dba4909ecb49"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:29:42.053997 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.053967    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad1cc0db-83c5-4d20-b920-dba4909ecb49" (UID: "ad1cc0db-83c5-4d20-b920-dba4909ecb49"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:29:42.054111 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.054084    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx" (OuterVolumeSpecName: "kube-api-access-jp4qx") pod "ad1cc0db-83c5-4d20-b920-dba4909ecb49" (UID: "ad1cc0db-83c5-4d20-b920-dba4909ecb49"). InnerVolumeSpecName "kube-api-access-jp4qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:29:42.152933 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.152894    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad1cc0db-83c5-4d20-b920-dba4909ecb49-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:42.152933 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.152928    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad1cc0db-83c5-4d20-b920-dba4909ecb49-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:42.152933 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.152938    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp4qx\" (UniqueName: \"kubernetes.io/projected/ad1cc0db-83c5-4d20-b920-dba4909ecb49-kube-api-access-jp4qx\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:29:42.741611 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.741562    2562 generic.go:356] "Generic (PLEG): container finished" podID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" containerID="8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557" exitCode=0
Jul 15 19:29:42.742033 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.741631    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"
Jul 15 19:29:42.742033 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.741657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" event={"ID":"ad1cc0db-83c5-4d20-b920-dba4909ecb49","Type":"ContainerDied","Data":"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"}
Jul 15 19:29:42.742033 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.741701    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs" event={"ID":"ad1cc0db-83c5-4d20-b920-dba4909ecb49","Type":"ContainerDied","Data":"178dac07d283ef6169485ae242cdcade965b18694664603102ee6ee7359571da"}
Jul 15 19:29:42.742033 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.741723    2562 scope.go:117] "RemoveContainer" containerID="8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"
Jul 15 19:29:42.751267 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.751242    2562 scope.go:117] "RemoveContainer" containerID="8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"
Jul 15 19:29:42.751554 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:29:42.751532    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557\": container with ID starting with 8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557 not found: ID does not exist" containerID="8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"
Jul 15 19:29:42.751657 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.751585    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557"} err="failed to get container status \"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557\": rpc error: code = NotFound desc = could not find container \"8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557\": container with ID starting with 8b05ef6399d377d4a2577228ddbdc8499d27df6fb1bc1ef6e9c11230ff080557 not found: ID does not exist"
Jul 15 19:29:42.764478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.764451    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:29:42.768689 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:42.768664    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1dfe1f-6f8b6b99bb-vdnvs"]
Jul 15 19:29:43.419492 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:29:43.419451    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" path="/var/lib/kubelet/pods/ad1cc0db-83c5-4d20-b920-dba4909ecb49/volumes"
Jul 15 19:30:00.516413 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.516377    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:00.516905 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.516829    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerName="maas-api"
Jul 15 19:30:00.516905 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.516850    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerName="maas-api"
Jul 15 19:30:00.516905 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.516870    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" containerName="maas-api"
Jul 15 19:30:00.516905 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.516876    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" containerName="maas-api"
Jul 15 19:30:00.517108 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.517037    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda589b4-a1a0-4a9e-9f85-e34dcee8fec0" containerName="maas-api"
Jul 15 19:30:00.517108 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.517052    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad1cc0db-83c5-4d20-b920-dba4909ecb49" containerName="maas-api"
Jul 15 19:30:00.520523 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.520499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.522634 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.522603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2c9d\" (UniqueName: \"kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.522766 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.522663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.522766 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.522718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.523498 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.523476    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-67b35f-serving-cert\""
Jul 15 19:30:00.532795 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.532759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:00.623358 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.623324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2c9d\" (UniqueName: \"kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.623623 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.623396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.623623 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.623440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.623623 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:30:00.623598    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-serving-cert: secret "maas-api-e2e-api-a-67b35f-serving-cert" not found
Jul 15 19:30:00.623819 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:30:00.623692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls podName:edf4632f-578a-4e22-87dc-6b6b92e9c17b nodeName:}" failed. No retries permitted until 2026-07-15 19:30:01.123667475 +0000 UTC m=+2370.234973980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls") pod "maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" (UID: "edf4632f-578a-4e22-87dc-6b6b92e9c17b") : secret "maas-api-e2e-api-a-67b35f-serving-cert" not found
Jul 15 19:30:00.624137 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.624118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:00.631743 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:00.631717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2c9d\" (UniqueName: \"kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:01.127604 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.127542    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:01.130092 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.130068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") pod \"maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:01.132955 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.132932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:01.276691 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.276665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:01.279002 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:30:01.278974    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf4632f_578a_4e22_87dc_6b6b92e9c17b.slice/crio-12a160cfcdc1526e8801af02190541aa657267b88ad0461e5848049dc4673029 WatchSource:0}: Error finding container 12a160cfcdc1526e8801af02190541aa657267b88ad0461e5848049dc4673029: Status 404 returned error can't find the container with id 12a160cfcdc1526e8801af02190541aa657267b88ad0461e5848049dc4673029
Jul 15 19:30:01.280275 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.280256    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:30:01.834387 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:01.834354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" event={"ID":"edf4632f-578a-4e22-87dc-6b6b92e9c17b","Type":"ContainerStarted","Data":"12a160cfcdc1526e8801af02190541aa657267b88ad0461e5848049dc4673029"}
Jul 15 19:30:02.841219 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:02.841187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" event={"ID":"edf4632f-578a-4e22-87dc-6b6b92e9c17b","Type":"ContainerStarted","Data":"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"}
Jul 15 19:30:02.841647 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:02.841250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:02.858778 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:02.858723    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" podStartSLOduration=2.17981297 podStartE2EDuration="2.858702406s" totalImagesPullingTime="678.889436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:02.858677938 +0000 UTC m=+2371.969984457" watchObservedRunningTime="2026-07-15 19:30:02.858702406 +0000 UTC m=+2371.970008949"
Jul 15 19:30:08.657679 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.657637    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:08.661905 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.661882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.664535 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.664509    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-97fde9-serving-cert\""
Jul 15 19:30:08.672667 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.672640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:08.694854 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.694811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.695010 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.694872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.695010 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.694962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ncjj\" (UniqueName: \"kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.796209 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.796166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.796388 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.796221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.796388 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.796242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ncjj\" (UniqueName: \"kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.796388 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:30:08.796358    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-serving-cert: secret "maas-api-e2e-api-b-97fde9-serving-cert" not found
Jul 15 19:30:08.796501 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:30:08.796439    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls podName:6b9f8bbd-df99-4c16-bd6e-20d19435429c nodeName:}" failed. No retries permitted until 2026-07-15 19:30:09.296416273 +0000 UTC m=+2378.407722774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls") pod "maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" (UID: "6b9f8bbd-df99-4c16-bd6e-20d19435429c") : secret "maas-api-e2e-api-b-97fde9-serving-cert" not found
Jul 15 19:30:08.796871 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.796845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.805981 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.805945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ncjj\" (UniqueName: \"kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:08.852952 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:08.852923    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:09.301159 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:09.301113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:09.303825 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:09.303801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") pod \"maas-api-e2e-api-b-97fde9-7694c64496-7fz2h\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:09.573925 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:09.573827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:09.718678 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:09.718561    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:09.721604 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:30:09.721555    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9f8bbd_df99_4c16_bd6e_20d19435429c.slice/crio-4fe63beb437f0983f5d3f9d06185e845237d842ae4056840fbba746f934d453d WatchSource:0}: Error finding container 4fe63beb437f0983f5d3f9d06185e845237d842ae4056840fbba746f934d453d: Status 404 returned error can't find the container with id 4fe63beb437f0983f5d3f9d06185e845237d842ae4056840fbba746f934d453d
Jul 15 19:30:09.877418 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:09.877328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" event={"ID":"6b9f8bbd-df99-4c16-bd6e-20d19435429c","Type":"ContainerStarted","Data":"4fe63beb437f0983f5d3f9d06185e845237d842ae4056840fbba746f934d453d"}
Jul 15 19:30:10.883918 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:10.883869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" event={"ID":"6b9f8bbd-df99-4c16-bd6e-20d19435429c","Type":"ContainerStarted","Data":"f39c65f37b0973a084f75fe0c1c97a86b5edd3cab1b1946dcf8d1f5f173b7fa9"}
Jul 15 19:30:10.884321 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:10.883964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:10.902800 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:10.902743    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" podStartSLOduration=2.509110347 podStartE2EDuration="2.902726054s" totalImagesPullingTime="393.615707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:30:10.901451173 +0000 UTC m=+2380.012757685" watchObservedRunningTime="2026-07-15 19:30:10.902726054 +0000 UTC m=+2380.014032570"
Jul 15 19:30:16.893725 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:16.893697    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:31.529959 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:31.529848    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:30:31.533242 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:31.533218    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:30:31.533675 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:31.533659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:30:31.536559 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:31.536541    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:30:32.006096 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.006044    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:32.006360 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.006308    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" podUID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" containerName="maas-api" containerID="cri-o://765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065" gracePeriod=30
Jul 15 19:30:32.260071 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.260005    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:32.410117 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.410070    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2c9d\" (UniqueName: \"kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d\") pod \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") "
Jul 15 19:30:32.410117 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.410126    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") pod \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") "
Jul 15 19:30:32.410379 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.410219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca\") pod \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\" (UID: \"edf4632f-578a-4e22-87dc-6b6b92e9c17b\") "
Jul 15 19:30:32.410618 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.410567    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edf4632f-578a-4e22-87dc-6b6b92e9c17b" (UID: "edf4632f-578a-4e22-87dc-6b6b92e9c17b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:30:32.412444 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.412425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d" (OuterVolumeSpecName: "kube-api-access-z2c9d") pod "edf4632f-578a-4e22-87dc-6b6b92e9c17b" (UID: "edf4632f-578a-4e22-87dc-6b6b92e9c17b"). InnerVolumeSpecName "kube-api-access-z2c9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:32.412537 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.412515    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edf4632f-578a-4e22-87dc-6b6b92e9c17b" (UID: "edf4632f-578a-4e22-87dc-6b6b92e9c17b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:30:32.511212 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.511107    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2c9d\" (UniqueName: \"kubernetes.io/projected/edf4632f-578a-4e22-87dc-6b6b92e9c17b-kube-api-access-z2c9d\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:32.511212 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.511154    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf4632f-578a-4e22-87dc-6b6b92e9c17b-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:32.511212 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.511164    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf4632f-578a-4e22-87dc-6b6b92e9c17b-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:32.995950 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.995913    2562 generic.go:356] "Generic (PLEG): container finished" podID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" containerID="765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065" exitCode=0
Jul 15 19:30:32.996427 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.995960    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"
Jul 15 19:30:32.996427 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.996003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" event={"ID":"edf4632f-578a-4e22-87dc-6b6b92e9c17b","Type":"ContainerDied","Data":"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"}
Jul 15 19:30:32.996427 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.996067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77" event={"ID":"edf4632f-578a-4e22-87dc-6b6b92e9c17b","Type":"ContainerDied","Data":"12a160cfcdc1526e8801af02190541aa657267b88ad0461e5848049dc4673029"}
Jul 15 19:30:32.996427 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:32.996105    2562 scope.go:117] "RemoveContainer" containerID="765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"
Jul 15 19:30:33.005002 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:33.004984    2562 scope.go:117] "RemoveContainer" containerID="765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"
Jul 15 19:30:33.005256 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:30:33.005237    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065\": container with ID starting with 765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065 not found: ID does not exist" containerID="765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"
Jul 15 19:30:33.005299 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:33.005264    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065"} err="failed to get container status \"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065\": rpc error: code = NotFound desc = could not find container \"765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065\": container with ID starting with 765e2128f827da324daca799c869277fa7e5661540fb966471cae4ee1c22d065 not found: ID does not exist"
Jul 15 19:30:33.017279 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:33.017253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:33.020913 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:33.020891    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-67b35f-6fcf546cb8-74b77"]
Jul 15 19:30:33.419864 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:33.419783    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" path="/var/lib/kubelet/pods/edf4632f-578a-4e22-87dc-6b6b92e9c17b/volumes"
Jul 15 19:30:57.972399 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:57.972352    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:57.972968 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:57.972720    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" podUID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" containerName="maas-api" containerID="cri-o://f39c65f37b0973a084f75fe0c1c97a86b5edd3cab1b1946dcf8d1f5f173b7fa9" gracePeriod=30
Jul 15 19:30:58.121868 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.121828    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" containerID="f39c65f37b0973a084f75fe0c1c97a86b5edd3cab1b1946dcf8d1f5f173b7fa9" exitCode=0
Jul 15 19:30:58.122045 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.121895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" event={"ID":"6b9f8bbd-df99-4c16-bd6e-20d19435429c","Type":"ContainerDied","Data":"f39c65f37b0973a084f75fe0c1c97a86b5edd3cab1b1946dcf8d1f5f173b7fa9"}
Jul 15 19:30:58.236184 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.236125    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:58.349393 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.349356    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ncjj\" (UniqueName: \"kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj\") pod \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") "
Jul 15 19:30:58.349566 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.349423    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") pod \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") "
Jul 15 19:30:58.349566 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.349521    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca\") pod \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\" (UID: \"6b9f8bbd-df99-4c16-bd6e-20d19435429c\") "
Jul 15 19:30:58.349907 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.349883    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b9f8bbd-df99-4c16-bd6e-20d19435429c" (UID: "6b9f8bbd-df99-4c16-bd6e-20d19435429c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:30:58.351600 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.351553    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj" (OuterVolumeSpecName: "kube-api-access-5ncjj") pod "6b9f8bbd-df99-4c16-bd6e-20d19435429c" (UID: "6b9f8bbd-df99-4c16-bd6e-20d19435429c"). InnerVolumeSpecName "kube-api-access-5ncjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:30:58.351728 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.351705    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b9f8bbd-df99-4c16-bd6e-20d19435429c" (UID: "6b9f8bbd-df99-4c16-bd6e-20d19435429c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:30:58.450987 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.450952    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b9f8bbd-df99-4c16-bd6e-20d19435429c-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:58.450987 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.450985    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ncjj\" (UniqueName: \"kubernetes.io/projected/6b9f8bbd-df99-4c16-bd6e-20d19435429c-kube-api-access-5ncjj\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:58.450987 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:58.450996    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b9f8bbd-df99-4c16-bd6e-20d19435429c-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:30:59.128364 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.128325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h" event={"ID":"6b9f8bbd-df99-4c16-bd6e-20d19435429c","Type":"ContainerDied","Data":"4fe63beb437f0983f5d3f9d06185e845237d842ae4056840fbba746f934d453d"}
Jul 15 19:30:59.128364 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.128347    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"
Jul 15 19:30:59.128956 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.128386    2562 scope.go:117] "RemoveContainer" containerID="f39c65f37b0973a084f75fe0c1c97a86b5edd3cab1b1946dcf8d1f5f173b7fa9"
Jul 15 19:30:59.149391 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.149359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:59.153767 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.153732    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-97fde9-7694c64496-7fz2h"]
Jul 15 19:30:59.419464 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:30:59.419383    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" path="/var/lib/kubelet/pods/6b9f8bbd-df99-4c16-bd6e-20d19435429c/volumes"
Jul 15 19:31:17.014848 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.014810    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:31:17.015236 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015218    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" containerName="maas-api"
Jul 15 19:31:17.015236 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015231    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" containerName="maas-api"
Jul 15 19:31:17.015345 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015241    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" containerName="maas-api"
Jul 15 19:31:17.015345 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015251    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" containerName="maas-api"
Jul 15 19:31:17.015345 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015325    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9f8bbd-df99-4c16-bd6e-20d19435429c" containerName="maas-api"
Jul 15 19:31:17.015345 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.015339    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf4632f-578a-4e22-87dc-6b6b92e9c17b" containerName="maas-api"
Jul 15 19:31:17.018421 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.018402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.023088 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.023064    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-257300-serving-cert\""
Jul 15 19:31:17.034022 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.033995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:31:17.119320 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.119277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.119494 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.119342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lwnw\" (UniqueName: \"kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.119494 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.119398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.220285 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.220253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.220453 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.220297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.220453 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.220341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lwnw\" (UniqueName: \"kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.221086 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.221065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.223058 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.223036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.246685 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.246653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lwnw\" (UniqueName: \"kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw\") pod \"maas-api-e2e-shared-a-257300-7845848c-dxrms\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.329553 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.329459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:17.506252 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:17.506215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:31:17.510636 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:31:17.510608    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dfddf8_31c8_43d0_8ab8_b27954b4c0e3.slice/crio-03f90b747d666df2e0c91080d10f3cb27a0a6b259a457a1ae34961fb4ae776c3 WatchSource:0}: Error finding container 03f90b747d666df2e0c91080d10f3cb27a0a6b259a457a1ae34961fb4ae776c3: Status 404 returned error can't find the container with id 03f90b747d666df2e0c91080d10f3cb27a0a6b259a457a1ae34961fb4ae776c3
Jul 15 19:31:18.226873 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:18.226835    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" event={"ID":"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3","Type":"ContainerStarted","Data":"03f90b747d666df2e0c91080d10f3cb27a0a6b259a457a1ae34961fb4ae776c3"}
Jul 15 19:31:19.233395 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:19.233362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" event={"ID":"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3","Type":"ContainerStarted","Data":"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"}
Jul 15 19:31:19.233835 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:19.233500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:19.252686 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:19.252635    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" podStartSLOduration=1.986108969 podStartE2EDuration="3.252617279s" totalImagesPullingTime="1.26650831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:31:19.250532977 +0000 UTC m=+2448.361839492" watchObservedRunningTime="2026-07-15 19:31:19.252617279 +0000 UTC m=+2448.363923794"
Jul 15 19:31:25.126254 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.126216    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:31:25.130436 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.130416    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.133104 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.133076    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-0dc297-serving-cert\""
Jul 15 19:31:25.140303 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.140279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:31:25.244532 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.244506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:31:25.292321 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.292287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.292501 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.292341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.292501 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.292359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nmd\" (UniqueName: \"kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.393947 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.393842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.393947 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.393925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.394200 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.393955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nmd\" (UniqueName: \"kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.394766 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.394690    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.396478 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.396450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.404211 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.404189    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nmd\" (UniqueName: \"kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd\") pod \"maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.442092 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.442056    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:25.599284 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:25.599258    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:31:25.601342 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:31:25.601314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a7ba8a2_eed6_4b65_8b9e_5efd4f733502.slice/crio-dfa4824a229414d450050c4259685168a9a77114bff7b3a7538e0b71020802a3 WatchSource:0}: Error finding container dfa4824a229414d450050c4259685168a9a77114bff7b3a7538e0b71020802a3: Status 404 returned error can't find the container with id dfa4824a229414d450050c4259685168a9a77114bff7b3a7538e0b71020802a3
Jul 15 19:31:26.268764 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:26.268728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" event={"ID":"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502","Type":"ContainerStarted","Data":"dfa4824a229414d450050c4259685168a9a77114bff7b3a7538e0b71020802a3"}
Jul 15 19:31:27.274853 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:27.274815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" event={"ID":"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502","Type":"ContainerStarted","Data":"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"}
Jul 15 19:31:27.275325 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:27.274951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:31:27.293917 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:27.293874    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" podStartSLOduration=1.419531122 podStartE2EDuration="2.293857353s" totalImagesPullingTime="874.326231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:31:27.291854095 +0000 UTC m=+2456.403160611" watchObservedRunningTime="2026-07-15 19:31:27.293857353 +0000 UTC m=+2456.405163870"
Jul 15 19:31:33.285305 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:31:33.285275    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:35:31.559763 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:35:31.559653    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:35:31.562886 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:35:31.562818    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:35:31.564773 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:35:31.564751    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:35:31.567761 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:35:31.567743    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65s8b_e9a8168d-371c-4be7-a300-a44ced01253e/ovn-acl-logging/0.log"
Jul 15 19:37:50.127860 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.127827    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:37:50.128349 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.128077    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerName="maas-api" containerID="cri-o://ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2" gracePeriod=30
Jul 15 19:37:50.240367 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.240315    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.46:8443/health\": dial tcp 10.132.0.46:8443: connect: connection refused"
Jul 15 19:37:50.385412 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.385345    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:37:50.503611 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.503560    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lwnw\" (UniqueName: \"kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw\") pod \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") "
Jul 15 19:37:50.503798 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.503632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca\") pod \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") "
Jul 15 19:37:50.503798 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.503653    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls\") pod \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\" (UID: \"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3\") "
Jul 15 19:37:50.504006 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.503981    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" (UID: "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:37:50.505907 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.505881    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw" (OuterVolumeSpecName: "kube-api-access-9lwnw") pod "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" (UID: "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3"). InnerVolumeSpecName "kube-api-access-9lwnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:37:50.505907 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.505884    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" (UID: "59dfddf8-31c8-43d0-8ab8-b27954b4c0e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:37:50.605037 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.605005    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lwnw\" (UniqueName: \"kubernetes.io/projected/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-kube-api-access-9lwnw\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:37:50.605037 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.605031    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:37:50.605240 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:50.605050    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:37:51.102373 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.102341    2562 generic.go:356] "Generic (PLEG): container finished" podID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerID="ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2" exitCode=0
Jul 15 19:37:51.102591 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.102387    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"
Jul 15 19:37:51.102591 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.102430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" event={"ID":"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3","Type":"ContainerDied","Data":"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"}
Jul 15 19:37:51.102591 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.102485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms" event={"ID":"59dfddf8-31c8-43d0-8ab8-b27954b4c0e3","Type":"ContainerDied","Data":"03f90b747d666df2e0c91080d10f3cb27a0a6b259a457a1ae34961fb4ae776c3"}
Jul 15 19:37:51.102591 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.102507    2562 scope.go:117] "RemoveContainer" containerID="ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"
Jul 15 19:37:51.119109 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.119089    2562 scope.go:117] "RemoveContainer" containerID="ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"
Jul 15 19:37:51.119427 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:37:51.119407    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2\": container with ID starting with ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2 not found: ID does not exist" containerID="ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"
Jul 15 19:37:51.119471 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.119437    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2"} err="failed to get container status \"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2\": rpc error: code = NotFound desc = could not find container \"ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2\": container with ID starting with ea83ac1d633769d50a1bd54c3f5f167e4613be6d2af4fe7e4f47c9e287bc41c2 not found: ID does not exist"
Jul 15 19:37:51.128316 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.128283    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:37:51.132263 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.132235    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-257300-7845848c-dxrms"]
Jul 15 19:37:51.420250 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:37:51.420165    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" path="/var/lib/kubelet/pods/59dfddf8-31c8-43d0-8ab8-b27954b4c0e3/volumes"
Jul 15 19:38:16.383521 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.383486    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:38:16.384143 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.383800    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" podUID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" containerName="maas-api" containerID="cri-o://e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383" gracePeriod=30
Jul 15 19:38:16.634880 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.634815    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:38:16.652646 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.652606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls\") pod \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") "
Jul 15 19:38:16.652822 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.652701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca\") pod \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") "
Jul 15 19:38:16.652822 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.652745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6nmd\" (UniqueName: \"kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd\") pod \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\" (UID: \"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502\") "
Jul 15 19:38:16.653175 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.653116    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" (UID: "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:38:16.655526 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.655495    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd" (OuterVolumeSpecName: "kube-api-access-k6nmd") pod "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" (UID: "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502"). InnerVolumeSpecName "kube-api-access-k6nmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:38:16.655808 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.655770    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" (UID: "1a7ba8a2-eed6-4b65-8b9e-5efd4f733502"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:38:16.753730 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.753688    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6nmd\" (UniqueName: \"kubernetes.io/projected/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-kube-api-access-k6nmd\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:38:16.753730 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.753734    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-maas-api-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:38:16.753957 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:16.753749    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502-openshift-service-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\""
Jul 15 19:38:17.231265 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.231228    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" containerID="e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383" exitCode=0
Jul 15 19:38:17.231477 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.231277    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"
Jul 15 19:38:17.231477 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.231319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" event={"ID":"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502","Type":"ContainerDied","Data":"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"}
Jul 15 19:38:17.231477 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.231378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj" event={"ID":"1a7ba8a2-eed6-4b65-8b9e-5efd4f733502","Type":"ContainerDied","Data":"dfa4824a229414d450050c4259685168a9a77114bff7b3a7538e0b71020802a3"}
Jul 15 19:38:17.231477 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.231406    2562 scope.go:117] "RemoveContainer" containerID="e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"
Jul 15 19:38:17.241260 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.241244    2562 scope.go:117] "RemoveContainer" containerID="e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"
Jul 15 19:38:17.241481 ip-10-0-133-23 kubenswrapper[2562]: E0715 19:38:17.241464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383\": container with ID starting with e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383 not found: ID does not exist" containerID="e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"
Jul 15 19:38:17.241526 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.241488    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383"} err="failed to get container status \"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383\": rpc error: code = NotFound desc = could not find container \"e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383\": container with ID starting with e15602a486787dfeff9236c98dd0664a7730eed2056d4976452a4f4f407a9383 not found: ID does not exist"
Jul 15 19:38:17.255074 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.255047    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:38:17.263238 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.263213    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-0dc297-9f79c798-cvlgj"]
Jul 15 19:38:17.419235 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:17.419205    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" path="/var/lib/kubelet/pods/1a7ba8a2-eed6-4b65-8b9e-5efd4f733502/volumes"
Jul 15 19:38:38.386738 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:38.386706    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zjbgf_e17f98dc-9769-4ebe-83cc-0101393b76da/manager/0.log"
Jul 15 19:38:38.897970 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:38.897937    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-6glpj_9a2126e7-eeb1-4db9-b912-c9665a0cfc1f/copy-manifests/0.log"
Jul 15 19:38:38.905707 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:38.905659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-6glpj_9a2126e7-eeb1-4db9-b912-c9665a0cfc1f/manager/0.log"
Jul 15 19:38:39.565114 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:39.565071    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-755b754868-s49xv_3832b0c6-e144-4756-a568-68e0ccb69c59/maas-api/0.log"
Jul 15 19:38:41.388195 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:41.388164    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sfq8n_2cdcd185-23b0-4c0d-ba31-1794597aedc3/postgres/0.log"
Jul 15 19:38:42.916232 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:42.916199    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s6s66_8f30b6d3-a6b3-49b3-9264-95862909114b/manager/0.log"
Jul 15 19:38:44.673824 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:44.673792    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-ztc69_9c871f9d-e156-4b60-af9f-cd2dc05ea0f7/payload-pre-processing/0.log"
Jul 15 19:38:44.913504 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:44.913473    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b987544d6-22jms_238d2bad-610b-47c4-bb77-eb08fa07c7c5/router/0.log"
Jul 15 19:38:45.281314 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:45.281280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wtgsx_fba67d6b-599f-4941-8df8-86ec4f766906/main/0.log"
Jul 15 19:38:45.651157 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:45.651073    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbz8fc_5e84f332-1112-40b1-a088-39b59d14145c/main/0.log"
Jul 15 19:38:45.766034 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:45.766004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wnkhw_70552801-d897-49f1-9eb2-53c9f0e30b7f/main/0.log"
Jul 15 19:38:55.561873 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:55.561841    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kvjqc_052485cd-74e9-4c40-8fc3-4efc09ec052d/global-pull-secret-syncer/0.log"
Jul 15 19:38:55.763750 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:55.763720    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xzcc5_7169f3ef-afeb-4a89-a408-9f6b5e185736/konnectivity-agent/0.log"
Jul 15 19:38:55.812928 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:38:55.812850    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-23.ec2.internal_db04d6671f4cd1e28684b053242e01cc/haproxy/0.log"
Jul 15 19:39:00.761671 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:00.761639    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s6s66_8f30b6d3-a6b3-49b3-9264-95862909114b/manager/0.log"
Jul 15 19:39:03.049162 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:03.049118    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-jgbqc_4c3db7f6-a103-4a53-bfde-668821d83785/cluster-monitoring-operator/0.log"
Jul 15 19:39:03.448946 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:03.448920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgcb9_9d36e4c4-4088-4336-92ca-8a69fb705785/node-exporter/0.log"
Jul 15 19:39:03.472117 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:03.472078    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgcb9_9d36e4c4-4088-4336-92ca-8a69fb705785/kube-rbac-proxy/0.log"
Jul 15 19:39:03.500297 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:03.500275    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgcb9_9d36e4c4-4088-4336-92ca-8a69fb705785/init-textfile/0.log"
Jul 15 19:39:05.320858 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.320826    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-bwwsw_69e4df55-2061-4d92-b1c1-42a8abfe7067/networking-console-plugin/0.log"
Jul 15 19:39:05.809629 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.809590    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"]
Jul 15 19:39:05.809967 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.809954    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" containerName="maas-api"
Jul 15 19:39:05.810018 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.809968    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" containerName="maas-api"
Jul 15 19:39:05.810018 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.809986    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerName="maas-api"
Jul 15 19:39:05.810018 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.809992    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerName="maas-api"
Jul 15 19:39:05.810115 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.810061    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a7ba8a2-eed6-4b65-8b9e-5efd4f733502" containerName="maas-api"
Jul 15 19:39:05.810115 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.810071    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dfddf8-31c8-43d0-8ab8-b27954b4c0e3" containerName="maas-api"
Jul 15 19:39:05.813146 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.813128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:05.817036 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.817014    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vp87\"/\"openshift-service-ca.crt\""
Jul 15 19:39:05.817187 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.817014    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6vp87\"/\"default-dockercfg-ttwfw\""
Jul 15 19:39:05.817187 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.817016    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6vp87\"/\"kube-root-ca.crt\""
Jul 15 19:39:05.835059 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.835024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"]
Jul 15 19:39:05.970319 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.970271    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/1.log"
Jul 15 19:39:05.974313 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.974274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lst2h_7af06135-7c6a-40fb-a835-967e12272c28/console-operator/2.log"
Jul 15 19:39:05.976453 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.976433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-sys\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:05.976522 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.976499    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-proc\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:05.976587 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.976522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9ph8\" (UniqueName: \"kubernetes.io/projected/58514a10-a9d1-4b4f-b167-57378db7b5e9-kube-api-access-n9ph8\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:05.976587 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.976544    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-lib-modules\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:05.976676 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:05.976637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-podres\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077451 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-lib-modules\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077451 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-podres\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077680 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-sys\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077680 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-sys\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077680 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-podres\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077680 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077554    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-lib-modules\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077821 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-proc\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077821 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9ph8\" (UniqueName: \"kubernetes.io/projected/58514a10-a9d1-4b4f-b167-57378db7b5e9-kube-api-access-n9ph8\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.077821 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.077750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58514a10-a9d1-4b4f-b167-57378db7b5e9-proc\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.086827 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.086799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9ph8\" (UniqueName: \"kubernetes.io/projected/58514a10-a9d1-4b4f-b167-57378db7b5e9-kube-api-access-n9ph8\") pod \"perf-node-gather-daemonset-q5hm2\" (UID: \"58514a10-a9d1-4b4f-b167-57378db7b5e9\") " pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.122874 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.122841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:06.264840 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.264812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"]
Jul 15 19:39:06.267564 ip-10-0-133-23 kubenswrapper[2562]: W0715 19:39:06.267535    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58514a10_a9d1_4b4f_b167_57378db7b5e9.slice/crio-c71a5abb26ac0f412d1529697a6162237664d2dbda3cea8d82af8df3c38d1b4b WatchSource:0}: Error finding container c71a5abb26ac0f412d1529697a6162237664d2dbda3cea8d82af8df3c38d1b4b: Status 404 returned error can't find the container with id c71a5abb26ac0f412d1529697a6162237664d2dbda3cea8d82af8df3c38d1b4b
Jul 15 19:39:06.461518 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.461484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2" event={"ID":"58514a10-a9d1-4b4f-b167-57378db7b5e9","Type":"ContainerStarted","Data":"736d2f8645c33df7fbe7ddd5d12b7b4c215131c9fa59428f28026846d4637998"}
Jul 15 19:39:06.461917 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.461535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2" event={"ID":"58514a10-a9d1-4b4f-b167-57378db7b5e9","Type":"ContainerStarted","Data":"c71a5abb26ac0f412d1529697a6162237664d2dbda3cea8d82af8df3c38d1b4b"}
Jul 15 19:39:06.461917 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:06.461566    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:07.228619 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:07.228589    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-7bvx2_44cfea73-0599-4874-9390-aa430cb967ee/volume-data-source-validator/0.log"
Jul 15 19:39:08.324254 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:08.324221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7dmm_d804f410-ec9a-4c74-addc-df3211085594/dns/0.log"
Jul 15 19:39:08.349547 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:08.349516    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m7dmm_d804f410-ec9a-4c74-addc-df3211085594/kube-rbac-proxy/0.log"
Jul 15 19:39:08.480447 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:08.480418    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-stb4z_32b4affa-a511-4ed5-8efa-e039902c0a90/dns-node-resolver/0.log"
Jul 15 19:39:09.143956 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:09.143917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rzwzk_782738dc-bbda-4dac-81fa-3bd0c9eb1cf5/node-ca/0.log"
Jul 15 19:39:10.392310 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:10.392278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-ztc69_9c871f9d-e156-4b60-af9f-cd2dc05ea0f7/payload-pre-processing/0.log"
Jul 15 19:39:10.457962 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:10.457929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b987544d6-22jms_238d2bad-610b-47c4-bb77-eb08fa07c7c5/router/0.log"
Jul 15 19:39:11.266193 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.266165    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wccv_9ed1afa1-9bf3-46f3-85c7-e47d161c4d54/serve-healthcheck-canary/0.log"
Jul 15 19:39:11.788233 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.788203    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pqwsf_959b2256-3d5b-4362-9dd5-bfe4767856c4/insights-operator/0.log"
Jul 15 19:39:11.788924 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.788908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-pqwsf_959b2256-3d5b-4362-9dd5-bfe4767856c4/insights-operator/1.log"
Jul 15 19:39:11.814585 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.814555    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfhdd_6f4de0f4-dcc9-45f4-b357-4ddd1defd302/kube-rbac-proxy/0.log"
Jul 15 19:39:11.839308 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.839282    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfhdd_6f4de0f4-dcc9-45f4-b357-4ddd1defd302/exporter/0.log"
Jul 15 19:39:11.864108 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:11.864080    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bfhdd_6f4de0f4-dcc9-45f4-b357-4ddd1defd302/extractor/0.log"
Jul 15 19:39:12.477466 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:12.477433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2"
Jul 15 19:39:12.503628 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:12.503544    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6vp87/perf-node-gather-daemonset-q5hm2" podStartSLOduration=7.503381878 podStartE2EDuration="7.503381878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:39:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:06.478140579 +0000 UTC m=+2915.589447095" watchObservedRunningTime="2026-07-15 19:39:12.503381878 +0000 UTC m=+2921.614688394"
Jul 15 19:39:14.665701 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:14.665662    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zjbgf_e17f98dc-9769-4ebe-83cc-0101393b76da/manager/0.log"
Jul 15 19:39:14.947788 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:14.947756    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-6glpj_9a2126e7-eeb1-4db9-b912-c9665a0cfc1f/manager/0.log"
Jul 15 19:39:14.976148 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:14.976121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dbd7b8848-6glpj_9a2126e7-eeb1-4db9-b912-c9665a0cfc1f/copy-manifests/0.log"
Jul 15 19:39:16.419229 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:16.419147    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7db65df97c-j5295_6790a639-abe7-4388-bb41-4b84c2648f91/manager/0.log"
Jul 15 19:39:16.973777 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:16.973744    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-ztc69_9c871f9d-e156-4b60-af9f-cd2dc05ea0f7/payload-pre-processing/0.log"
Jul 15 19:39:17.011473 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:17.011445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b987544d6-22jms_238d2bad-610b-47c4-bb77-eb08fa07c7c5/router/0.log"
Jul 15 19:39:18.427349 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:18.427312    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-ztc69_9c871f9d-e156-4b60-af9f-cd2dc05ea0f7/payload-pre-processing/0.log"
Jul 15 19:39:18.479314 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:18.479274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b987544d6-22jms_238d2bad-610b-47c4-bb77-eb08fa07c7c5/router/0.log"
Jul 15 19:39:21.741012 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:21.740977    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jskpd_182757e4-04c0-4664-9a4b-7899b4321235/migrator/0.log"
Jul 15 19:39:21.790584 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:21.790541    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-jskpd_182757e4-04c0-4664-9a4b-7899b4321235/graceful-termination/0.log"
Jul 15 19:39:22.188936 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:22.188901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-g42sf_09f51599-39a1-4b35-8546-d81177619edf/kube-storage-version-migrator-operator/1.log"
Jul 15 19:39:22.189702 ip-10-0-133-23 kubenswrapper[2562]: I0715 19:39:22.189683    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-g42sf_09f51599-39a1-4b35-8546-d81177619edf/kube-storage-version-migrator-operator/0.log"