Jul 22 01:25:47.465507 ip-10-0-135-67 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 01:25:47.465517 ip-10-0-135-67 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 01:25:47.465524 ip-10-0-135-67 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 01:25:47.465745 ip-10-0-135-67 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 01:25:57.647314 ip-10-0-135-67 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 01:25:57.647330 ip-10-0-135-67 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8bd7ca8a05754b90aa46b61e7f70f85a --
Jul 22 01:27:33.050446 ip-10-0-135-67 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 01:27:33.460199 ip-10-0-135-67 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 01:27:33.460199 ip-10-0-135-67 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 01:27:33.460199 ip-10-0-135-67 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 01:27:33.460199 ip-10-0-135-67 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 01:27:33.460199 ip-10-0-135-67 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 01:27:33.463052 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.462955    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 01:27:33.469716 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469690    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.469716 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469711    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.469716 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469716    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.469716 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469721    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.469716 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469726    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469730    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469734    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469738    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469741    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469745    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469749    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469753    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469756    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469760    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469763    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469766    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469770    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469773    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469777    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469791    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469798    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469802    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469805    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469809    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.470034 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469813    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469816    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469820    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469824    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469831    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469838    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469843    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469847    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469851    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469855    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469859    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469863    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469869    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469874    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469879    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469884    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469888    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469892    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469896    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469901    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.470873 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469905    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469909    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469914    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469918    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469922    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469926    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469931    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469935    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469939    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469944    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469948    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469952    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469957    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469961    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469965    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469969    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469974    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469980    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469984    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469988    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.471729 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469994    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.469998    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470002    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470007    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470011    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470016    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470020    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470026    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470029    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470034    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470038    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470042    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470047    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470053    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470060    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470065    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470070    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470074    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470078    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.472559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470082    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470089    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470093    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470097    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470104    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470111    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470116    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470120    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470143    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470148    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470153    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470157    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470161    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470165    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470169    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.470174    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471454    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471465    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471471    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.473434 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471477    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471482    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471488    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471492    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471496    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471501    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471505    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471509    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471513    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471517    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471522    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471526    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471530    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471534    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471538    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471542    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471547    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471551    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471555    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471560    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.474259 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471564    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471568    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471572    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471577    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471582    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471586    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471590    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471594    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471598    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471603    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471607    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471611    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471617    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471621    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471625    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471630    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471634    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471638    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471642    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471647    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.474935 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471651    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471655    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471659    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471664    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471668    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471672    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471676    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471680    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471684    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471691    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471697    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471704    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471708    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471713    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471718    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471723    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471729    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471733    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471737    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.475467 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471741    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471745    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471749    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471754    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471758    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471762    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471768    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471774    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471781    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471787    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471794    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471799    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471804    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471808    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471812    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471816    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471820    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471824    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471828    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.476019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471833    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471837    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471841    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471845    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471849    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471854    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471858    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471862    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471866    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471875    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471879    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471884    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471888    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471892    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471896    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471901    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471905    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.471909    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472549    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472557    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.476627 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472561    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472565    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472570    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472574    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472578    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472582    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472586    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472591    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472595    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472600    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472604    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472609    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472613    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472617    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472622    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472626    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472630    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472634    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472639    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472643    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.477321 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472647    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472654    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472659    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472663    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472667    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472671    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472675    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472679    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472684    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472688    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472694    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472699    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472704    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472708    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472713    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472717    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472722    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472726    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472729    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472734    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.477794 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472737    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472742    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472746    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472753    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472759    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472763    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472769    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472773    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472778    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472786    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472791    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472796    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472802    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472809    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472813    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472817    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472822    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472826    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.478327 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472830    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472834    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472838    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472843    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472849    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472854    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472858    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472862    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472868    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472872    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472877    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472881    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472885    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472889    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472893    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472898    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472901    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472906    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472910    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472914    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.478915 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472918    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472922    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472926    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472930    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472934    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472938    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472942    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472948    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472952    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472956    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472960    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472964    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472969    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472973    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472977    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472981    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472985    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472989    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.472994    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473101    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473122    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 01:27:33.479457 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473152    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473159    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473167    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473172    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473178    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473185    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473190    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473194    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473200    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473206    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473211    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473215    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473220    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473225    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473230    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473234    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473241    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473245    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473252    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473257    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473262    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473268    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473273    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 01:27:33.479991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473278    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473284    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473289    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473293    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473298    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473303    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473308    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473314    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473321    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473326    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473331    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473336    2559 flags.go:64] FLAG: --enable-server="true"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473341    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473349    2559 flags.go:64] FLAG: --event-burst="100"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473353    2559 flags.go:64] FLAG: --event-qps="50"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473358    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473364    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473369    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473376    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473380    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473385    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473390    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473394    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473399    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473404    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 01:27:33.480570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473408    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473413    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473419    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473424    2559 flags.go:64] FLAG: --feature-gates=""
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473430    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473435    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473439    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473444    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473448    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473453    2559 flags.go:64] FLAG: --help="false"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473457    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473462    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473467    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473472    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473477    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473483    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473488    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473493    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473497    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473502    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473507    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473512    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473517    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473521    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 01:27:33.481196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473526    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473531    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473535    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473540    2559 flags.go:64] FLAG: --lock-file=""
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473544    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473548    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473553    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473562    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473567    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473571    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473578    2559 flags.go:64] FLAG: --logging-format="text"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473582    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473587    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473592    2559 flags.go:64] FLAG: --manifest-url=""
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473596    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473603    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473608    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473614    2559 flags.go:64] FLAG: --max-pods="110"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473619    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473624    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473628    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473632    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473637    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473642    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473647    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 01:27:33.481837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473659    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473664    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473670    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473674    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473690    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473701    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473706    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473711    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473716    2559 flags.go:64] FLAG: --port="10250"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473721    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473726    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-047969d9e0a9c29fa"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473731    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473736    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473741    2559 flags.go:64] FLAG: --register-node="true"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473745    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473757    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473762    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473766    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473773    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473779    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473784    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473789    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473793    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473798    2559 flags.go:64] FLAG: --runonce="false"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473803    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 01:27:33.482757 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473808    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473812    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473817    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473821    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473826    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473831    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473837    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473841    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473846    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473851    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473855    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473860    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473865    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473871    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473880    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473885    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473889    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473896    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473900    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473905    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473909    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473914    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473918    2559 flags.go:64] FLAG: --v="2"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473925    2559 flags.go:64] FLAG: --version="false"
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473935    2559 flags.go:64] FLAG: --vmodule=""
Jul 22 01:27:33.483756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473942    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.473948    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474156    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474163    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474168    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474172    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474176    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474180    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474184    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474188    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474192    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474196    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474201    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474205    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474209    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474213    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474218    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474221    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474226    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474230    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.484582 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474235    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474239    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474244    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474248    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474252    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474256    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474260    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474264    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474268    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474272    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474278    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474285    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474292    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474297    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474302    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474306    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474310    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474315    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474319    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.485075 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474324    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474328    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474334    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474339    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474344    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474350    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474354    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474359    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474363    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474368    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474372    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474377    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474381    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474385    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474390    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474394    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474398    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474402    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474406    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474410    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.485559 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474414    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474418    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474423    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474427    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474431    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474436    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474441    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474445    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474450    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474454    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474471    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474478    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474482    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474486    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474490    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474494    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474498    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474504    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474508    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474513    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.486047 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474517    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474521    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474526    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474530    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474534    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474538    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474542    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474547    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474552    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474556    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474561    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474565    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474571    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474576    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474581    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474585    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474590    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474597    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474601    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.486561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474606    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474610    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.474614    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.475548    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.485351    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.485369    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.485390    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.485400    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485460    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485465    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485469    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485472    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485474    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485478    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485481    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.487019 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485483    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485486    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485488    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485491    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485494    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485497    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485499    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485502    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485504    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485507    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485509    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485512    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485514    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485517    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485519    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485522    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485524    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485527    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485529    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.487477 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485533    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485542    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485546    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485549    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485552    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485555    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485557    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485560    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485563    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485565    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485568    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485570    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485573    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485575    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485578    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485581    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485583    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485586    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485588    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.487928 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485590    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485593    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485596    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485598    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485601    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485603    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485606    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485608    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485611    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485613    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485615    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485618    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485620    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485623    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485625    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485628    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485632    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485634    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485637    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485639    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.488405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485642    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485646    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485650    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485653    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485655    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485658    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485660    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485663    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485665    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485668    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485670    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485673    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485675    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485678    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485681    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485683    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485686    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485688    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485691    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485694    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.488894 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485696    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485699    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485701    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485704    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485707    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485709    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485713    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485716    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485719    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485723    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485725    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485728    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485731    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485733    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.485739    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 01:27:33.489383 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485865    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485870    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485873    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485876    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485879    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485882    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485885    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485888    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485890    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485893    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485896    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485898    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485902    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485904    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485907    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485910    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485913    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485916    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485919    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485921    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 01:27:33.489760 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485924    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485927    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485929    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485932    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485934    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485937    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485940    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485942    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485945    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485947    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485950    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485952    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485955    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485957    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485959    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485962    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485964    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485967    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485969    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485972    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 01:27:33.490264 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485975    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485977    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485981    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485985    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485988    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485992    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485994    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485997    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.485999    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486002    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486005    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486007    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486010    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486012    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486015    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486017    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486020    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486022    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486024    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486027    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 01:27:33.490749 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486029    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486031    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486034    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486036    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486039    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486043    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486046    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486049    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486052    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486055    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486058    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486061    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486064    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486067    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486069    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486072    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486074    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486077    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486080    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486083    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 01:27:33.491260 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486085    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486088    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486091    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486093    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486095    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486098    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486100    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486103    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486105    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486107    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486110    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486112    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486115    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486117    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486120    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486122    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486147    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486150    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 01:27:33.491736 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:33.486153    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.486158    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.486288    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.489517    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.491296    2559 server.go:1019] "Starting client certificate rotation"
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.491398    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 01:27:33.492185 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.491431    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 01:27:33.494244 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.494226    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 01:27:33.495495 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.495475    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 01:27:33.511296 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.511271    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 22 01:27:33.514688 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.514607    2559 log.go:25] "Validated CRI v1 image API"
Jul 22 01:27:33.515696 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.515678    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 01:27:33.518517 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.518494    2559 fs.go:135] Filesystem UUIDs: map[0f02eba9-3bf2-4b2d-bc3c-e331d49f20c9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 82a9abce-cc39-483d-9000-cb56192d4080:/dev/nvme0n1p4]
Jul 22 01:27:33.518597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.518524    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 01:27:33.520179 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.520159    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 01:27:33.525472 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.525358    2559 manager.go:216] Machine: {Timestamp:2026-07-22 01:27:33.523943508 +0000 UTC m=+0.353880309 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100201 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21e9d55933a18f1a8fc38db53abd65 SystemUUID:ec21e9d5-5933-a18f-1a8f-c38db53abd65 BootID:8bd7ca8a-0575-4b90-aa46-b61e7f70f85a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:e8:83:f0:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:e8:83:f0:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:d5:b7:ad:d5:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 01:27:33.525472 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.525462    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 01:27:33.525611 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.525590    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 01:27:33.529081 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.529056    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 01:27:33.529246 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.529083    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 01:27:33.530070 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.530060    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 01:27:33.530101 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.530073    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 01:27:33.530101 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.530081    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 01:27:33.531845 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.531833    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 01:27:33.533663 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.533653    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 01:27:33.538287 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538273    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 01:27:33.538430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538420    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 01:27:33.538481 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538452    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 01:27:33.538481 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538473    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 01:27:33.538553 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538489    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 01:27:33.538553 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538498    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 22 01:27:33.538553 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538508    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 01:27:33.538957 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538939    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 01:27:33.538991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.538975    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 01:27:33.541449 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.541432    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 01:27:33.543847 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.543803    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 01:27:33.543847 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.543834    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 01:27:33.545233 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545211    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 01:27:33.545233 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545228    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 01:27:33.545233 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545235    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545240    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545249    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545255    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545263    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545275    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545282    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545288    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545300    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545306    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545330    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 01:27:33.545349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.545335    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 01:27:33.548546 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.548530    2559 server.go:1268] "Started kubelet"
Jul 22 01:27:33.548681 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.548633    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 01:27:33.548930 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.548614    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 01:27:33.549015 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.548985    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 01:27:33.549475 ip-10-0-135-67 systemd[1]: Started Kubernetes Kubelet.
Jul 22 01:27:33.550359 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.550342    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 01:27:33.550991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.550974    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 01:27:33.551066 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.551005    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 01:27:33.551147 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.551077    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 01:27:33.551147 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.551085    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 01:27:33.556109 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.556089    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 01:27:33.557763 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.556624    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-67.ec2.internal.18c47853c6346a14  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-67.ec2.internal,UID:ip-10-0-135-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-67.ec2.internal,},FirstTimestamp:2026-07-22 01:27:33.548501524 +0000 UTC m=+0.378438325,LastTimestamp:2026-07-22 01:27:33.548501524 +0000 UTC m=+0.378438325,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-67.ec2.internal,}"
Jul 22 01:27:33.560160 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.560148    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 01:27:33.560224 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.560172    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 01:27:33.560326 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.560302    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.561083 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561057    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 01:27:33.561198 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561087    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 01:27:33.561198 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561101    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 01:27:33.561286 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561217    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 01:27:33.561286 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561230    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 01:27:33.561580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561545    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 01:27:33.561580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561578    2559 factory.go:55] Registering systemd factory
Jul 22 01:27:33.561580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561585    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 22 01:27:33.561786 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561773    2559 factory.go:153] Registering CRI-O factory
Jul 22 01:27:33.561859 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561789    2559 factory.go:223] Registration of the crio container factory successfully
Jul 22 01:27:33.561859 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561810    2559 factory.go:103] Registering Raw factory
Jul 22 01:27:33.561859 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.561821    2559 manager.go:1196] Started watching for new ooms in manager
Jul 22 01:27:33.562989 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.562933    2559 manager.go:349] Starting recovery of all containers
Jul 22 01:27:33.564089 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.564062    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 01:27:33.564224 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.564153    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 01:27:33.576542 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.576523    2559 manager.go:354] Recovery completed
Jul 22 01:27:33.581188 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.581174    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.581814 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.581794    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmggv"
Jul 22 01:27:33.582928 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.582910    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.582998 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.582941    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.582998 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.582956    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.583502 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.583489    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 01:27:33.583545 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.583503    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 01:27:33.583545 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.583523    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 01:27:33.583614 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.583494    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.584314 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.584299    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.584375 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.584327    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.584375 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.584338    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.585006 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.584932    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-67.ec2.internal.18c47853c841b8d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-67.ec2.internal,UID:ip-10-0-135-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-67.ec2.internal,},FirstTimestamp:2026-07-22 01:27:33.582928083 +0000 UTC m=+0.412864886,LastTimestamp:2026-07-22 01:27:33.582928083 +0000 UTC m=+0.412864886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-67.ec2.internal,}"
Jul 22 01:27:33.585669 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.585657    2559 policy_none.go:49] "None policy: Start"
Jul 22 01:27:33.585702 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.585673    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 01:27:33.585702 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.585683    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 01:27:33.587553 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.587542    2559 policy_none.go:47] "Start"
Jul 22 01:27:33.590144 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.590107    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cmggv"
Jul 22 01:27:33.594331 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.594222    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-67.ec2.internal.18c47853c8420773  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-67.ec2.internal,UID:ip-10-0-135-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-67.ec2.internal,},FirstTimestamp:2026-07-22 01:27:33.582948211 +0000 UTC m=+0.412885014,LastTimestamp:2026-07-22 01:27:33.582948211 +0000 UTC m=+0.412885014,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-67.ec2.internal,}"
Jul 22 01:27:33.620968 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.620766    2559 manager.go:337] "Starting Device Plugin manager"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.620989    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621005    2559 server.go:87] "Starting device plugin registration server"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621288    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621303    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621396    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621485    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.621495    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.622260    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 01:27:33.644398 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.622306    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.688282 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.688236    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 01:27:33.689699 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.689677    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 01:27:33.689805 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.689725    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 01:27:33.689805 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.689756    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 01:27:33.689805 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.689799    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 01:27:33.692687 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.692663    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:33.722995 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.722959    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.723988 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.723966    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.724106 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.724000    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.724106 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.724011    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.724106 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.724048    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.731855 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.731832    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.731964 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.731863    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-67.ec2.internal\": node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.758756 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.758721    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.790804 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.790767    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"]
Jul 22 01:27:33.791040 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.790856    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.792359 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.792341    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.792463 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.792376    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.792463 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.792390    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.794381 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.794333    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.794527 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.794512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.794579 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.794570    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.795144 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795110    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.795203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795168    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.795203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795184    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.795203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795189    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.795324 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795220    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.795324 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.795233    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.797123 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.797106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.797219 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.797154    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 01:27:33.797910 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.797895    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 01:27:33.797971 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.797919    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 01:27:33.797971 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.797931    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeHasSufficientPID"
Jul 22 01:27:33.812735 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.812713    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-67.ec2.internal\" not found" node="ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.816048 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.816032    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-67.ec2.internal\" not found" node="ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.859280 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.859238    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.862540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.862517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.862639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.862552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.862639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.862577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a131ae19b4796263370658bdbdc05dd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"1a131ae19b4796263370658bdbdc05dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.959415 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:33.959372    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:33.963743 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963725    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.963816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.963816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a131ae19b4796263370658bdbdc05dd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"1a131ae19b4796263370658bdbdc05dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.963907 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1a131ae19b4796263370658bdbdc05dd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-67.ec2.internal\" (UID: \"1a131ae19b4796263370658bdbdc05dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.963907 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:33.963907 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:33.963850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/968803dba3a1a993b95d207e5539865b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal\" (UID: \"968803dba3a1a993b95d207e5539865b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:34.060252 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.060174    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:34.115601 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.115568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:34.118803 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.118782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:34.160660 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.160619    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:34.261122 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.261083    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:34.361584 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.361516    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-67.ec2.internal\" not found"
Jul 22 01:27:34.430333 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.430303    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:34.460545 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.460513    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:34.473492 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.473459    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 01:27:34.475200 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.475184    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal"
Jul 22 01:27:34.482015 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.481989    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 01:27:34.490122 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.490099    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 01:27:34.490302 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.490281    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 01:27:34.490362 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.490281    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 01:27:34.539434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.539401    2559 apiserver.go:52] "Watching apiserver"
Jul 22 01:27:34.553147 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.553095    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 01:27:34.553500 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.553478    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal","openshift-multus/multus-additional-cni-plugins-bwnwf","openshift-multus/multus-srdnp","openshift-network-operator/iptables-alerter-kjqnk","openshift-cluster-node-tuning-operator/tuned-8npf4","openshift-dns/node-resolver-pfnkz","openshift-image-registry/node-ca-md9fz","openshift-multus/network-metrics-daemon-l2vqz","openshift-network-diagnostics/network-check-target-mhqbm","openshift-ovn-kubernetes/ovnkube-node-jvcvc","kube-system/global-pull-secret-syncer-9znw5","kube-system/konnectivity-agent-rczm4"]
Jul 22 01:27:34.555820 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.555797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.557833 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.557807    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.557937 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.557893    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:34.558001 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.557966    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gzgpn\""
Jul 22 01:27:34.558045 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.557969    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.558045 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.558028    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.559866 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.559850    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.560264 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.560247    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 01:27:34.561821 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.561804    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 01:27:34.561951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.561934    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wrb6w\""
Jul 22 01:27:34.562015 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.561948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.562015 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.561976    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.563889    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.563924    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.563892    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k7k26\""
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.564000    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.564012    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.564047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.564043    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.564355 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.564336    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 01:27:34.566110 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.566110 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566105    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-89vjd\""
Jul 22 01:27:34.566295 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566156    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 01:27:34.566764 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-sys\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.566807 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-kubelet-config\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.566838 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-system-cni-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.566867 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-os-release\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.566900 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.566900 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566893    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysconfig\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.566956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-lib-modules\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.566956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9124ada-91a6-4a83-b3d5-1fd257417ef9-agent-certs\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.566956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-cnibin\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.567041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.566979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-conf\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-tmp\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9124ada-91a6-4a83-b3d5-1fd257417ef9-konnectivity-ca\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.567176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-modprobe-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-host\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.567176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mzn7\" (UniqueName: \"kubernetes.io/projected/d63b10fd-d51f-453e-bd34-07c7550ab782-kube-api-access-8mzn7\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-systemd\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-dbus\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-kubernetes\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-var-lib-kubelet\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-tuned\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567563 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkjd6\" (UniqueName: \"kubernetes.io/projected/e93d8f30-2cec-4c2c-9698-7587aeda7457-kube-api-access-nkjd6\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.567563 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.567539    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-run\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.568650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.568624    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 01:27:34.568942 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.568922    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-frnwp\""
Jul 22 01:27:34.569213 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.569193    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.569466 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.569448    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.570087 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.570062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.570577 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.570558    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 01:27:34.571868 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.571848    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 01:27:34.572052 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.572037    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.572155 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.572140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.572292 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.572275    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-244z9\""
Jul 22 01:27:34.572355 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.572281    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.573884 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.573869    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.573960 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.573874    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-clm7z\""
Jul 22 01:27:34.574054 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.574039    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.574442 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.574425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.576327 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.576306    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 01:27:34.576393 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.576340    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-998sh\""
Jul 22 01:27:34.576592 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.576574    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.576681 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.576593    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.576810 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.576795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.576892 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.576874    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:34.578941 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.578923    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:34.579018 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.578998    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:34.581355 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.581340    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.583557 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583539    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 01:27:34.583673 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583655    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 01:27:34.583673 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z9w8m\""
Jul 22 01:27:34.583761 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583717    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 01:27:34.583844 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583829    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 01:27:34.583910 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583888    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 01:27:34.583959 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.583923    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 01:27:34.590795 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.590779    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mlxdz"
Jul 22 01:27:34.596450 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.596397    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 01:22:34 +0000 UTC" deadline="2028-04-04 03:41:33.145054846 +0000 UTC"
Jul 22 01:27:34.596450 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.596450    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14930h13m58.548607582s"
Jul 22 01:27:34.598023 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.598008    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mlxdz"
Jul 22 01:27:34.662999 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.662964    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 01:27:34.668300 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-hostroot\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-conf\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-tmp\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-kubelet\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-conf-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c949326-9864-4f26-9a35-c256ed1653d7-hosts-file\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7xs5\" (UniqueName: \"kubernetes.io/projected/3c949326-9864-4f26-9a35-c256ed1653d7-kube-api-access-p7xs5\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.668433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-conf\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668476    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81170063-939f-49b3-8b90-8a0c1d2d1cac-iptables-alerter-script\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-host\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6974\" (UniqueName: \"kubernetes.io/projected/dca8765b-c288-4e68-b70a-411adfad43ba-kube-api-access-h6974\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-systemd-units\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cnibin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668635    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-dbus\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.668711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-host\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-netns\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.668766    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668775    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6qd\" (UniqueName: \"kubernetes.io/projected/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kube-api-access-wr6qd\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.668852    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:35.168807376 +0000 UTC m=+1.998744178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-dbus\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81170063-939f-49b3-8b90-8a0c1d2d1cac-host-slash\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-multus\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-kubernetes\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-var-lib-kubelet\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.668984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-bin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-registration-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-var-lib-kubelet\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-run\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-sys\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-kubernetes\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669166 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-kubelet-config\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669076    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-run\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669109    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-sys\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-kubelet-config\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669188    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-etc-kubernetes\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-socket-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-env-overrides\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-system-cni-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669284    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-system-cni-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669350    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysconfig\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-slash\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-bin\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-config\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.669903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysconfig\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669479    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-sys-fs\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-netd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-lib-modules\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca8765b-c288-4e68-b70a-411adfad43ba-host\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669627    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-lib-modules\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669682    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cni-binary-copy\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-k8s-cni-cncf-io\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c949326-9864-4f26-9a35-c256ed1653d7-tmp-dir\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-cni-binary-copy\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9124ada-91a6-4a83-b3d5-1fd257417ef9-agent-certs\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-cnibin\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-etc-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9124ada-91a6-4a83-b3d5-1fd257417ef9-konnectivity-ca\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.670923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-cnibin\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-modprobe-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-var-lib-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-os-release\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-sysctl-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.669956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-modprobe-d\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670004    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfj4\" (UniqueName: \"kubernetes.io/projected/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-kube-api-access-5tfj4\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvl7\" (UniqueName: \"kubernetes.io/projected/81170063-939f-49b3-8b90-8a0c1d2d1cac-kube-api-access-tzvl7\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mzn7\" (UniqueName: \"kubernetes.io/projected/d63b10fd-d51f-453e-bd34-07c7550ab782-kube-api-access-8mzn7\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-systemd\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-log-socket\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-script-lib\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzwl4\" (UniqueName: \"kubernetes.io/projected/5aeaefaa-8d8d-472d-b589-4c2e097ff562-kube-api-access-rzwl4\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670234    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-socket-dir-parent\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670260    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670267    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-systemd\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.671678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-system-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-daemon-config\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670336    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9124ada-91a6-4a83-b3d5-1fd257417ef9-konnectivity-ca\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-tuned\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkjd6\" (UniqueName: \"kubernetes.io/projected/e93d8f30-2cec-4c2c-9698-7587aeda7457-kube-api-access-nkjd6\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-device-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-systemd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-node-log\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-kubelet\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-os-release\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-multus-certs\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d63b10fd-d51f-453e-bd34-07c7550ab782-os-release\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.670906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca8765b-c288-4e68-b70a-411adfad43ba-serviceca\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.671081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwd5\" (UniqueName: \"kubernetes.io/projected/990ff928-53f5-4276-a484-7ca62515f310-kube-api-access-hgwd5\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.671110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-netns\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.671165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d63b10fd-d51f-453e-bd34-07c7550ab782-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.671190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-ovn\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.672718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-etc-tuned\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.672741    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d8f30-2cec-4c2c-9698-7587aeda7457-tmp\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.672945 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.672855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9124ada-91a6-4a83-b3d5-1fd257417ef9-agent-certs\") pod \"konnectivity-agent-rczm4\" (UID: \"a9124ada-91a6-4a83-b3d5-1fd257417ef9\") " pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.678347 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.678323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkjd6\" (UniqueName: \"kubernetes.io/projected/e93d8f30-2cec-4c2c-9698-7587aeda7457-kube-api-access-nkjd6\") pod \"tuned-8npf4\" (UID: \"e93d8f30-2cec-4c2c-9698-7587aeda7457\") " pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.678506 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.678488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mzn7\" (UniqueName: \"kubernetes.io/projected/d63b10fd-d51f-453e-bd34-07c7550ab782-kube-api-access-8mzn7\") pod \"multus-additional-cni-plugins-bwnwf\" (UID: \"d63b10fd-d51f-453e-bd34-07c7550ab782\") " pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.771517 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771491    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:34.771707 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-var-lib-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771760 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-os-release\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.771795 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfj4\" (UniqueName: \"kubernetes.io/projected/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-kube-api-access-5tfj4\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.771795 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-os-release\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.771795 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvl7\" (UniqueName: \"kubernetes.io/projected/81170063-939f-49b3-8b90-8a0c1d2d1cac-kube-api-access-tzvl7\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-log-socket\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771836    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-script-lib\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwl4\" (UniqueName: \"kubernetes.io/projected/5aeaefaa-8d8d-472d-b589-4c2e097ff562-kube-api-access-rzwl4\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-var-lib-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-socket-dir-parent\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-log-socket\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.771911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-system-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771935    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-daemon-config\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-socket-dir-parent\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-device-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.771999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-system-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-systemd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772045    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-device-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-node-log\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-kubelet\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-multus-certs\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-node-log\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-kubelet\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772210    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772251    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-multus-certs\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772256    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.772269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-systemd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca8765b-c288-4e68-b70a-411adfad43ba-serviceca\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwd5\" (UniqueName: \"kubernetes.io/projected/990ff928-53f5-4276-a484-7ca62515f310-kube-api-access-hgwd5\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-netns\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-netns\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-ovn\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-hostroot\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772504    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-ovn\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-kubelet\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-kubelet\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-conf-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c949326-9864-4f26-9a35-c256ed1653d7-hosts-file\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7xs5\" (UniqueName: \"kubernetes.io/projected/3c949326-9864-4f26-9a35-c256ed1653d7-kube-api-access-p7xs5\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-daemon-config\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-hostroot\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-script-lib\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772614    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-conf-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c949326-9864-4f26-9a35-c256ed1653d7-hosts-file\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.773060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81170063-939f-49b3-8b90-8a0c1d2d1cac-iptables-alerter-script\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6974\" (UniqueName: \"kubernetes.io/projected/dca8765b-c288-4e68-b70a-411adfad43ba-kube-api-access-h6974\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-etc-selinux\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-systemd-units\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dca8765b-c288-4e68-b70a-411adfad43ba-serviceca\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772801    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cnibin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-systemd-units\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-netns\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cnibin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772870    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-netns\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6qd\" (UniqueName: \"kubernetes.io/projected/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kube-api-access-wr6qd\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81170063-939f-49b3-8b90-8a0c1d2d1cac-host-slash\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-multus\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-bin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-registration-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.773879 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-multus\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.772911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81170063-939f-49b3-8b90-8a0c1d2d1cac-host-slash\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-var-lib-cni-bin\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-registration-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.773143    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-run-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-etc-kubernetes\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-etc-kubernetes\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-socket-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.773285    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:35.273255454 +0000 UTC m=+2.103192242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81170063-939f-49b3-8b90-8a0c1d2d1cac-iptables-alerter-script\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-socket-dir\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773389    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-env-overrides\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-slash\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-bin\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-slash\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-config\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773513    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-sys-fs\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-netd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-bin\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773573    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca8765b-c288-4e68-b70a-411adfad43ba-host\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-cni-netd\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773583    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-sys-fs\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773629    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dca8765b-c288-4e68-b70a-411adfad43ba-host\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cni-binary-copy\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-host-run-ovn-kubernetes\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-k8s-cni-cncf-io\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773687    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-multus-cni-dir\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c949326-9864-4f26-9a35-c256ed1653d7-tmp-dir\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-host-run-k8s-cni-cncf-io\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.774972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-etc-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-env-overrides\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5aeaefaa-8d8d-472d-b589-4c2e097ff562-etc-openvswitch\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.773997    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c949326-9864-4f26-9a35-c256ed1653d7-tmp-dir\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.774019    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovnkube-config\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.774181    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-cni-binary-copy\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.775539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.774698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aeaefaa-8d8d-472d-b589-4c2e097ff562-ovn-node-metrics-cert\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.783800 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.783774    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:34.783800 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.783797    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:34.783999 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.783814    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:34.783999 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:34.783873    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:27:35.283859675 +0000 UTC m=+2.113796468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:34.784548 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.784527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvl7\" (UniqueName: \"kubernetes.io/projected/81170063-939f-49b3-8b90-8a0c1d2d1cac-kube-api-access-tzvl7\") pod \"iptables-alerter-kjqnk\" (UID: \"81170063-939f-49b3-8b90-8a0c1d2d1cac\") " pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.785307 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.785287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwd5\" (UniqueName: \"kubernetes.io/projected/990ff928-53f5-4276-a484-7ca62515f310-kube-api-access-hgwd5\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:34.791097 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.791074    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7xs5\" (UniqueName: \"kubernetes.io/projected/3c949326-9864-4f26-9a35-c256ed1653d7-kube-api-access-p7xs5\") pod \"node-resolver-pfnkz\" (UID: \"3c949326-9864-4f26-9a35-c256ed1653d7\") " pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.791576 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.791539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6974\" (UniqueName: \"kubernetes.io/projected/dca8765b-c288-4e68-b70a-411adfad43ba-kube-api-access-h6974\") pod \"node-ca-md9fz\" (UID: \"dca8765b-c288-4e68-b70a-411adfad43ba\") " pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.791936 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.791916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6qd\" (UniqueName: \"kubernetes.io/projected/76fbffd7-5a5b-433b-94ef-a9ae6fc2794c-kube-api-access-wr6qd\") pod \"aws-ebs-csi-driver-node-kd2zr\" (UID: \"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:34.792018 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.791922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfj4\" (UniqueName: \"kubernetes.io/projected/9af0d31f-21bd-4e85-8ef6-dab26ed9bd46-kube-api-access-5tfj4\") pod \"multus-srdnp\" (UID: \"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46\") " pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.792018 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.791964    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzwl4\" (UniqueName: \"kubernetes.io/projected/5aeaefaa-8d8d-472d-b589-4c2e097ff562-kube-api-access-rzwl4\") pod \"ovnkube-node-jvcvc\" (UID: \"5aeaefaa-8d8d-472d-b589-4c2e097ff562\") " pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:34.839808 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.839771    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a131ae19b4796263370658bdbdc05dd.slice/crio-4105f978210c76d38fd93a529bd336376097be771d36e5cdfe78b0205702680e WatchSource:0}: Error finding container 4105f978210c76d38fd93a529bd336376097be771d36e5cdfe78b0205702680e: Status 404 returned error can't find the container with id 4105f978210c76d38fd93a529bd336376097be771d36e5cdfe78b0205702680e
Jul 22 01:27:34.844688 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.844669    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 01:27:34.868731 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.868662    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:34.878605 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.878579    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968803dba3a1a993b95d207e5539865b.slice/crio-98656fe88bcba4ddfbb39f70337516959d4cd69fe16d66b9d03d0de467dcbdcc WatchSource:0}: Error finding container 98656fe88bcba4ddfbb39f70337516959d4cd69fe16d66b9d03d0de467dcbdcc: Status 404 returned error can't find the container with id 98656fe88bcba4ddfbb39f70337516959d4cd69fe16d66b9d03d0de467dcbdcc
Jul 22 01:27:34.879986 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.879912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8npf4"
Jul 22 01:27:34.888154 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.888122    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93d8f30_2cec_4c2c_9698_7587aeda7457.slice/crio-ee5c675644841d2e5552600f2e97ff4d318303f0f2d078213e18e3d1cb0cdce4 WatchSource:0}: Error finding container ee5c675644841d2e5552600f2e97ff4d318303f0f2d078213e18e3d1cb0cdce4: Status 404 returned error can't find the container with id ee5c675644841d2e5552600f2e97ff4d318303f0f2d078213e18e3d1cb0cdce4
Jul 22 01:27:34.901103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.901080    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:34.909482 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.909443    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9124ada_91a6_4a83_b3d5_1fd257417ef9.slice/crio-f40a4ec4e762bd051a7ecbb343df463071cc854a0167f93ddb71b0d43a43e49e WatchSource:0}: Error finding container f40a4ec4e762bd051a7ecbb343df463071cc854a0167f93ddb71b0d43a43e49e: Status 404 returned error can't find the container with id f40a4ec4e762bd051a7ecbb343df463071cc854a0167f93ddb71b0d43a43e49e
Jul 22 01:27:34.919387 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.919369    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bwnwf"
Jul 22 01:27:34.927700 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.927670    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63b10fd_d51f_453e_bd34_07c7550ab782.slice/crio-abf79acc2355bc092dbb625ff481b9f1a2a66187358b563d496c6ad9db845f08 WatchSource:0}: Error finding container abf79acc2355bc092dbb625ff481b9f1a2a66187358b563d496c6ad9db845f08: Status 404 returned error can't find the container with id abf79acc2355bc092dbb625ff481b9f1a2a66187358b563d496c6ad9db845f08
Jul 22 01:27:34.933948 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.933931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-srdnp"
Jul 22 01:27:34.942212 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.942189    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af0d31f_21bd_4e85_8ef6_dab26ed9bd46.slice/crio-229fb9187ac418eb1e4ed00033eb1087ac1a1d8aa55609504ff44322323e0f92 WatchSource:0}: Error finding container 229fb9187ac418eb1e4ed00033eb1087ac1a1d8aa55609504ff44322323e0f92: Status 404 returned error can't find the container with id 229fb9187ac418eb1e4ed00033eb1087ac1a1d8aa55609504ff44322323e0f92
Jul 22 01:27:34.949364 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.949344    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kjqnk"
Jul 22 01:27:34.958045 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.958019    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81170063_939f_49b3_8b90_8a0c1d2d1cac.slice/crio-04669198479f2c8abd7363ef86fe60fc1893a1b8a1c7a0772b48aa2be0ad80f1 WatchSource:0}: Error finding container 04669198479f2c8abd7363ef86fe60fc1893a1b8a1c7a0772b48aa2be0ad80f1: Status 404 returned error can't find the container with id 04669198479f2c8abd7363ef86fe60fc1893a1b8a1c7a0772b48aa2be0ad80f1
Jul 22 01:27:34.964202 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.964184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-md9fz"
Jul 22 01:27:34.972961 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.972939    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca8765b_c288_4e68_b70a_411adfad43ba.slice/crio-31ea977c6fb2361e576683eb290ffec645fddf599df94e81c334de5a00472483 WatchSource:0}: Error finding container 31ea977c6fb2361e576683eb290ffec645fddf599df94e81c334de5a00472483: Status 404 returned error can't find the container with id 31ea977c6fb2361e576683eb290ffec645fddf599df94e81c334de5a00472483
Jul 22 01:27:34.985574 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:34.985551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pfnkz"
Jul 22 01:27:34.993648 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:34.993627    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c949326_9864_4f26_9a35_c256ed1653d7.slice/crio-1be10099a8148daea88de2ec7c3eb9034100aef4b3d1d3f386ce63a91991b839 WatchSource:0}: Error finding container 1be10099a8148daea88de2ec7c3eb9034100aef4b3d1d3f386ce63a91991b839: Status 404 returned error can't find the container with id 1be10099a8148daea88de2ec7c3eb9034100aef4b3d1d3f386ce63a91991b839
Jul 22 01:27:35.008582 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.008556    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr"
Jul 22 01:27:35.014381 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.014355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:27:35.017920 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:35.017894    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fbffd7_5a5b_433b_94ef_a9ae6fc2794c.slice/crio-ab7c784ecd3bca1f65684a8616bf561a997b6d0282b89618c4fac82b8d910288 WatchSource:0}: Error finding container ab7c784ecd3bca1f65684a8616bf561a997b6d0282b89618c4fac82b8d910288: Status 404 returned error can't find the container with id ab7c784ecd3bca1f65684a8616bf561a997b6d0282b89618c4fac82b8d910288
Jul 22 01:27:35.022871 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:27:35.022845    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aeaefaa_8d8d_472d_b589_4c2e097ff562.slice/crio-8506d252cbb855d5977f718f117a6e7b69b271fcea47366c0439af8a5f6db39b WatchSource:0}: Error finding container 8506d252cbb855d5977f718f117a6e7b69b271fcea47366c0439af8a5f6db39b: Status 404 returned error can't find the container with id 8506d252cbb855d5977f718f117a6e7b69b271fcea47366c0439af8a5f6db39b
Jul 22 01:27:35.024479 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.024456    2559 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-jvcvc_openshift-ovn-kubernetes(5aeaefaa-8d8d-472d-b589-4c2e097ff562): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 22 01:27:35.025993 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.025975    2559 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-jvcvc_openshift-ovn-kubernetes(5aeaefaa-8d8d-472d-b589-4c2e097ff562): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 22 01:27:35.028977 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.028936    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:534ab2ea2f6c22eaf4d2267274394590a29319c3d5e0da72bef87bc86f428dec\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" podUID="5aeaefaa-8d8d-472d-b589-4c2e097ff562"
Jul 22 01:27:35.177215 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.177114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:35.177359 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.177254    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:35.177359 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.177310    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:36.177294927 +0000 UTC m=+3.007231716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:35.277981 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.277950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:35.278162 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.278072    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:35.278162 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.278143    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:36.278108629 +0000 UTC m=+3.108045421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:35.326946 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.326915    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:35.378329 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.378285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:35.378514 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.378431    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:35.378514 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.378451    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:35.378514 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.378471    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:35.378676 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.378532    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:27:36.378513803 +0000 UTC m=+3.208450592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:35.601078 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.600962    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:22:35 +0000 UTC" deadline="2028-04-11 03:28:48.968517854 +0000 UTC"
Jul 22 01:27:35.601078 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.601026    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15098h1m13.367495457s"
Jul 22 01:27:35.690050 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.690011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:35.690257 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.690167    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:35.700005 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.699942    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfnkz" event={"ID":"3c949326-9864-4f26-9a35-c256ed1653d7","Type":"ContainerStarted","Data":"1be10099a8148daea88de2ec7c3eb9034100aef4b3d1d3f386ce63a91991b839"}
Jul 22 01:27:35.701870 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.701838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8npf4" event={"ID":"e93d8f30-2cec-4c2c-9698-7587aeda7457","Type":"ContainerStarted","Data":"ee5c675644841d2e5552600f2e97ff4d318303f0f2d078213e18e3d1cb0cdce4"}
Jul 22 01:27:35.703973 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.703907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" event={"ID":"1a131ae19b4796263370658bdbdc05dd","Type":"ContainerStarted","Data":"4105f978210c76d38fd93a529bd336376097be771d36e5cdfe78b0205702680e"}
Jul 22 01:27:35.706469 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.705470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"8506d252cbb855d5977f718f117a6e7b69b271fcea47366c0439af8a5f6db39b"}
Jul 22 01:27:35.708365 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.708272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr" event={"ID":"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c","Type":"ContainerStarted","Data":"ab7c784ecd3bca1f65684a8616bf561a997b6d0282b89618c4fac82b8d910288"}
Jul 22 01:27:35.714026 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.713951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-md9fz" event={"ID":"dca8765b-c288-4e68-b70a-411adfad43ba","Type":"ContainerStarted","Data":"31ea977c6fb2361e576683eb290ffec645fddf599df94e81c334de5a00472483"}
Jul 22 01:27:35.716311 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.716287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjqnk" event={"ID":"81170063-939f-49b3-8b90-8a0c1d2d1cac","Type":"ContainerStarted","Data":"04669198479f2c8abd7363ef86fe60fc1893a1b8a1c7a0772b48aa2be0ad80f1"}
Jul 22 01:27:35.719403 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.719375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srdnp" event={"ID":"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46","Type":"ContainerStarted","Data":"229fb9187ac418eb1e4ed00033eb1087ac1a1d8aa55609504ff44322323e0f92"}
Jul 22 01:27:35.721840 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:35.721774    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:534ab2ea2f6c22eaf4d2267274394590a29319c3d5e0da72bef87bc86f428dec\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:534ab2ea2f6c22eaf4d2267274394590a29319c3d5e0da72bef87bc86f428dec\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:241e47351d3f7eef8ef00c2c9acba53c54ac799f4e751de5b4d4e13016eaa997\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" podUID="5aeaefaa-8d8d-472d-b589-4c2e097ff562"
Jul 22 01:27:35.722351 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.722326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerStarted","Data":"abf79acc2355bc092dbb625ff481b9f1a2a66187358b563d496c6ad9db845f08"}
Jul 22 01:27:35.724496 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.724443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rczm4" event={"ID":"a9124ada-91a6-4a83-b3d5-1fd257417ef9","Type":"ContainerStarted","Data":"f40a4ec4e762bd051a7ecbb343df463071cc854a0167f93ddb71b0d43a43e49e"}
Jul 22 01:27:35.726412 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:35.726351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"968803dba3a1a993b95d207e5539865b","Type":"ContainerStarted","Data":"98656fe88bcba4ddfbb39f70337516959d4cd69fe16d66b9d03d0de467dcbdcc"}
Jul 22 01:27:36.184232 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.184186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:36.184446 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.184407    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:36.184520 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.184479    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:38.184459831 +0000 UTC m=+5.014396644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:36.285178 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.285120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:36.285378 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.285297    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:36.285378 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.285368    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:38.285347484 +0000 UTC m=+5.115284290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:36.386032 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.385984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:36.386304 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.386249    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:36.386304 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.386278    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:36.386304 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.386294    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:36.386509 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.386363    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:27:38.386341174 +0000 UTC m=+5.216277993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:36.428432 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.428125    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 01:27:36.601920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.601790    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 01:22:35 +0000 UTC" deadline="2028-03-25 21:05:24.224890559 +0000 UTC"
Jul 22 01:27:36.601920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.601862    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14707h37m47.62303321s"
Jul 22 01:27:36.690481 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.690447    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:36.690682 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.690588    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:36.691099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:36.691073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:36.691237 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:36.691218    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:37.696241 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:37.692431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:37.696241 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:37.692584    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:38.204784 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:38.204717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:38.205057 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.205002    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:38.205152 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.205107    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:42.205085556 +0000 UTC m=+9.035022349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:38.306028 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:38.305988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:38.306262 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.306229    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:38.306336 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.306305    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:42.306284509 +0000 UTC m=+9.136221304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:38.406642 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:38.406599    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:38.406934 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.406911    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:38.407066 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.406943    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:38.407066 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.406957    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:38.407066 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.407028    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:27:42.40700687 +0000 UTC m=+9.236943674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:38.690483 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:38.690393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:38.690637 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.690560    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:38.691005 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:38.690976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:38.691164 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:38.691100    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:39.693625 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:39.693584    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:39.694126 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:39.693754    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:40.690951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:40.690911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:40.691179 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:40.690925    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:40.691179 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:40.691073    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:40.691377 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:40.691197    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:41.691099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:41.691051    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:41.691616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:41.691238    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:42.241665 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:42.241615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:42.241881 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.241823    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:42.241940 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.241932    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:50.241908694 +0000 UTC m=+17.071845499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:42.342738 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:42.342705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:42.342901 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.342887    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:42.342970 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.342962    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:27:50.34294431 +0000 UTC m=+17.172881100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:42.443672 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:42.443624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:42.443859 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.443787    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:42.443859 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.443806    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:42.443859 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.443818    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:42.443998 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.443892    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:27:50.443872293 +0000 UTC m=+17.273809108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:42.690682 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:42.690582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:42.690857 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.690724    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:42.690857 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:42.690790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:42.690961 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:42.690890    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:43.693987 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:43.693954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:43.694442 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:43.694067    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:44.690446 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:44.690408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:44.690446 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:44.690431    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:44.690721 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:44.690545    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:44.690721 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:44.690679    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:45.690349 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:45.690236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:45.690794 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:45.690410    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:46.690519 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:46.690478    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:46.690948 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:46.690596    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:46.690948 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:46.690652    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:46.690948 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:46.690790    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:47.690848 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:47.690811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:47.691345 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:47.690950    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:48.689994 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:48.689957    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:48.690212 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:48.690075    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:48.690212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:48.690143    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:48.690330 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:48.690239    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:49.690472 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:49.690441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:49.690927 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:49.690552    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:50.308748 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.308482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:50.308748 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.308656    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:50.308748 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.308715    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.308693285 +0000 UTC m=+33.138630155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:27:50.409149 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.409100    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:50.409327 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.409312    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:50.409387 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.409375    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.409356117 +0000 UTC m=+33.239292925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:27:50.509792 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.509748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:50.509948 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.509914    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:27:50.509948 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.509937    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:27:50.510022 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.509950    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:50.510022 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.510012    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:28:06.50999489 +0000 UTC m=+33.339931683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:27:50.690173 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.690139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:50.690334 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.690281    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:50.690622 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.690123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:50.690982 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:50.690718    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:50.773796 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.773752    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr" event={"ID":"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c","Type":"ContainerStarted","Data":"0748f22cd239bd308dd84d32140f8398027a5a6dc861ce48586fdd475b7c15ee"}
Jul 22 01:27:50.775665 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.775628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-md9fz" event={"ID":"dca8765b-c288-4e68-b70a-411adfad43ba","Type":"ContainerStarted","Data":"186c34363d5e5eff2dc6aaae757015546ca4592728cce24557197b17c788ad9e"}
Jul 22 01:27:50.778049 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.778017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-srdnp" event={"ID":"9af0d31f-21bd-4e85-8ef6-dab26ed9bd46","Type":"ContainerStarted","Data":"e4f2edf7ceb7d562c2aa89b55768d56bf5f6d2e59331d44d276b09c87b3cbc94"}
Jul 22 01:27:50.779686 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.779657    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="9297b453a026802efa52bef4d1197eff6a6c1e36a89422e0686bb02309de07c5" exitCode=0
Jul 22 01:27:50.779811 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.779731    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"9297b453a026802efa52bef4d1197eff6a6c1e36a89422e0686bb02309de07c5"}
Jul 22 01:27:50.781493 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.781469    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rczm4" event={"ID":"a9124ada-91a6-4a83-b3d5-1fd257417ef9","Type":"ContainerStarted","Data":"9fc8e38282d322b38aab2667fd2905dc8cdfdd586cf0c7216970702f0e2821dc"}
Jul 22 01:27:50.782664 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.782485    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:50.783033 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.782944    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:50.784714 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.784238    2559 generic.go:356] "Generic (PLEG): container finished" podID="968803dba3a1a993b95d207e5539865b" containerID="e7d75a5f216b2198ab0366399c52488e9cc2be9759581747a04bb8d28c0975c5" exitCode=0
Jul 22 01:27:50.784714 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.784321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"968803dba3a1a993b95d207e5539865b","Type":"ContainerDied","Data":"e7d75a5f216b2198ab0366399c52488e9cc2be9759581747a04bb8d28c0975c5"}
Jul 22 01:27:50.786885 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.786809    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pfnkz" event={"ID":"3c949326-9864-4f26-9a35-c256ed1653d7","Type":"ContainerStarted","Data":"152d455219961c840cd27e80e5b7530ab9ae97196b01d4c6a9496aa37640f6d6"}
Jul 22 01:27:50.788480 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.788455    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8npf4" event={"ID":"e93d8f30-2cec-4c2c-9698-7587aeda7457","Type":"ContainerStarted","Data":"4d5289da2d3accda07f3e718c6cfab89b519ec2f887dd50eee5b933fad66531e"}
Jul 22 01:27:50.790091 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.790063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" event={"ID":"1a131ae19b4796263370658bdbdc05dd","Type":"ContainerStarted","Data":"04c64604e57696451efad66d3238f619829a06d70dc9d2ac24dc7dfe5764f3cc"}
Jul 22 01:27:50.796855 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.796801    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-md9fz" podStartSLOduration=2.128220533 podStartE2EDuration="16.796788822s" totalImagesPullingTime="14.668568289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.796345112 +0000 UTC m=+17.626281923" watchObservedRunningTime="2026-07-22 01:27:50.796788822 +0000 UTC m=+17.626725636"
Jul 22 01:27:50.838390 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.838326    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rczm4" podStartSLOduration=2.171458569 podStartE2EDuration="16.838304214s" totalImagesPullingTime="14.666845645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.812892284 +0000 UTC m=+17.642829097" watchObservedRunningTime="2026-07-22 01:27:50.838304214 +0000 UTC m=+17.668241063"
Jul 22 01:27:50.877016 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.876943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-srdnp" podStartSLOduration=2.096877812 podStartE2EDuration="16.876919226s" totalImagesPullingTime="14.780041414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.860564111 +0000 UTC m=+17.690500923" watchObservedRunningTime="2026-07-22 01:27:50.876919226 +0000 UTC m=+17.706856042"
Jul 22 01:27:50.893208 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.893148    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pfnkz" podStartSLOduration=2.235722752 podStartE2EDuration="16.893105317s" totalImagesPullingTime="14.657382565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.878001745 +0000 UTC m=+17.707938560" watchObservedRunningTime="2026-07-22 01:27:50.893105317 +0000 UTC m=+17.723042129"
Jul 22 01:27:50.913014 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:50.912962    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-67.ec2.internal" podStartSLOduration=15.91294313 podStartE2EDuration="15.91294313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.912866467 +0000 UTC m=+17.742803293" watchObservedRunningTime="2026-07-22 01:27:50.91294313 +0000 UTC m=+17.742879942"
Jul 22 01:27:51.691089 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.691054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:51.691486 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:51.691222    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:51.795962 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.795930    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kjqnk" event={"ID":"81170063-939f-49b3-8b90-8a0c1d2d1cac","Type":"ContainerStarted","Data":"01e42d909cfb35a341e0cb53f47c6509520eeadeed8b149b863e2795e69bd03e"}
Jul 22 01:27:51.797097 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.797071    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:51.797399 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.797377    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rczm4"
Jul 22 01:27:51.811719 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.811669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kjqnk" podStartSLOduration=3.127984762 podStartE2EDuration="17.811652076s" totalImagesPullingTime="14.683667314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:51.811015602 +0000 UTC m=+18.640952413" watchObservedRunningTime="2026-07-22 01:27:51.811652076 +0000 UTC m=+18.641588888"
Jul 22 01:27:51.811887 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:51.811764    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8npf4" podStartSLOduration=3.059024745 podStartE2EDuration="17.811756229s" totalImagesPullingTime="14.752731484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:50.931899292 +0000 UTC m=+17.761836119" watchObservedRunningTime="2026-07-22 01:27:51.811756229 +0000 UTC m=+18.641693043"
Jul 22 01:27:52.003535 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.003507    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 01:27:52.632780 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.632020    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T01:27:52.00353239Z","UUID":"7762754c-10e6-4554-8b03-997366bf88c7","Handler":null,"Name":"","Endpoint":""}
Jul 22 01:27:52.634034 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.634006    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 01:27:52.634178 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.634058    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 01:27:52.690884 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.690848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:52.691056 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:52.691003    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:52.691527 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.691423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:52.692161 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:52.691539    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:52.801180 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.800434    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" event={"ID":"968803dba3a1a993b95d207e5539865b","Type":"ContainerStarted","Data":"8e4a9309f613222f619a2c80e8e9c244103af371358dc2cb6f46cb4dfed7012c"}
Jul 22 01:27:52.804121 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.804085    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr" event={"ID":"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c","Type":"ContainerStarted","Data":"6e74b211cb6678dc2fb0ae8dbc5cfd71484295363144d3b7f44c40d098072294"}
Jul 22 01:27:52.817143 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:52.817065    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-67.ec2.internal" podStartSLOduration=17.817045566 podStartE2EDuration="17.817045566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:52.816922727 +0000 UTC m=+19.646859539" watchObservedRunningTime="2026-07-22 01:27:52.817045566 +0000 UTC m=+19.646982359"
Jul 22 01:27:53.691620 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:53.691582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:53.692151 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:53.691709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:53.808571 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:53.808534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr" event={"ID":"76fbffd7-5a5b-433b-94ef-a9ae6fc2794c","Type":"ContainerStarted","Data":"e1618a9401ce8bfe168b1330bb429fd9dd8e7490e9988252a2b27304c9f13021"}
Jul 22 01:27:54.690323 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:54.690288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:54.690509 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:54.690403    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:54.690763 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:54.690737    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:54.690873 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:54.690850    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:55.690392 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:55.690349    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:55.691030 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:55.690469    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:56.690391 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:56.690350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:56.690918 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:56.690408    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:56.690918 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:56.690495    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:56.690918 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:56.690636    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:56.816373 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:56.816336    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="564d2f9d82259441c963af9c3a8e8ec7f57a6fbca4f502513eeecffb16836ae0" exitCode=0
Jul 22 01:27:56.816545 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:56.816389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"564d2f9d82259441c963af9c3a8e8ec7f57a6fbca4f502513eeecffb16836ae0"}
Jul 22 01:27:56.839660 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:56.839597    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kd2zr" podStartSLOduration=5.722429098 podStartE2EDuration="22.839577272s" totalImagesPullingTime="17.117148174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:27:53.828980378 +0000 UTC m=+20.658917191" watchObservedRunningTime="2026-07-22 01:27:56.839577272 +0000 UTC m=+23.669514087"
Jul 22 01:27:57.690638 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:57.690598    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:57.691114 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:57.690736    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:27:58.690252 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:58.690210    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:27:58.690458 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:58.690213    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:27:58.690458 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:58.690354    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:27:58.690458 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:58.690408    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:27:59.689993 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:27:59.689955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:27:59.690498 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:27:59.690067    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:00.690744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:00.690711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:00.691219 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:00.690826    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:00.691219 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:00.690885    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:00.691219 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:00.691016    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:01.690357 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:01.690320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:01.690577 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:01.690455    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:01.834475 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:01.834446    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"d894063b8e1a4fdfb031b93a4d522c5a46a4b75e85bea7557b96949a32f7e99c"}
Jul 22 01:28:02.690431 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.690205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:02.690576 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.690243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:02.690576 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:02.690443    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:02.690576 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:02.690542    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:02.839896 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.839866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"a0230467eba23010b91dcd0d4d4b6db6a13e06dcd401f45238760a0920c31292"}
Jul 22 01:28:02.840442 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.839950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"f3a74c8664d7fc9eb18aa83df369ce407dcb739d754767308699e332ba766260"}
Jul 22 01:28:02.840442 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.839989    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"24583ae583b5864961fa9fa19df8a79f26de5841d83aa09f708f906943f6eda7"}
Jul 22 01:28:02.840442 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.840019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"e3a94e586aa79505ee62aa039f4ff27791c56fb46c88dc44d91745630a4cacf9"}
Jul 22 01:28:02.840442 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.840045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"4429fa4ba31af3fcc5dd05ef235758c3472d065f18f20956e7908a23c74e5a5e"}
Jul 22 01:28:02.842019 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.841997    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="cf8ef676b3ca993bae75e5bc7c65eeb373984a36bb03bd50eeab14c2ff642d8d" exitCode=0
Jul 22 01:28:02.842148 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:02.842032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"cf8ef676b3ca993bae75e5bc7c65eeb373984a36bb03bd50eeab14c2ff642d8d"}
Jul 22 01:28:03.690934 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:03.690894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:03.691149 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:03.690995    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:04.690705 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:04.690673    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:04.691282 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:04.690676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:04.691282 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:04.690779    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:04.691282 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:04.690928    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:04.848298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:04.848213    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="b6ffc1ca6a7cf56fa739c591485a49836f98f99537c3fbcaf3bd08ba63246100" exitCode=0
Jul 22 01:28:04.848471 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:04.848312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"b6ffc1ca6a7cf56fa739c591485a49836f98f99537c3fbcaf3bd08ba63246100"}
Jul 22 01:28:04.851797 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:04.851730    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"125efb8d63d8b4278d512652ace0a84befaae696f7b9197815a76b745a0910ce"}
Jul 22 01:28:05.690040 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:05.690002    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:05.690257 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:05.690161    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:06.333960 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.333920    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:06.334439 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.334088    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 01:28:06.334439 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.334169    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret podName:8e870cc0-e8ba-4c77-bbd9-bd0abca000e5 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:38.334154211 +0000 UTC m=+65.164091000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret") pod "global-pull-secret-syncer-9znw5" (UID: "8e870cc0-e8ba-4c77-bbd9-bd0abca000e5") : object "kube-system"/"original-pull-secret" not registered
Jul 22 01:28:06.434518 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.434476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:06.434691 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.434635    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:28:06.434739 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.434697    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs podName:990ff928-53f5-4276-a484-7ca62515f310 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:38.434675693 +0000 UTC m=+65.264612482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs") pod "network-metrics-daemon-l2vqz" (UID: "990ff928-53f5-4276-a484-7ca62515f310") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 01:28:06.535374 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.535319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:06.535552 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.535532    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 01:28:06.535599 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.535559    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 01:28:06.535599 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.535574    2559 projected.go:196] Error preparing data for projected volume kube-api-access-kjgxf for pod openshift-network-diagnostics/network-check-target-mhqbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:28:06.535679 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.535640    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf podName:52d6009f-bc8c-4e0c-ac3f-80e033a0332b nodeName:}" failed. No retries permitted until 2026-07-22 01:28:38.535621908 +0000 UTC m=+65.365558702 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjgxf" (UniqueName: "kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf") pod "network-check-target-mhqbm" (UID: "52d6009f-bc8c-4e0c-ac3f-80e033a0332b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 01:28:06.690717 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.690690    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:06.690876 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.690820    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:06.690935 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.690911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:06.691044 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:06.691021    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:06.860690 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.860658    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" event={"ID":"5aeaefaa-8d8d-472d-b589-4c2e097ff562","Type":"ContainerStarted","Data":"c238e8a2444d030e354277e0cb2dab6dc5422f8d3bada4b9738395b4f9f077a5"}
Jul 22 01:28:06.861035 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.861009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:06.861186 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.861090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:06.879523 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.879496    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:06.889460 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:06.889410    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc" podStartSLOduration=6.435758627 podStartE2EDuration="32.889391844s" totalImagesPullingTime="26.453633217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-22 01:28:06.888863735 +0000 UTC m=+33.718800558" watchObservedRunningTime="2026-07-22 01:28:06.889391844 +0000 UTC m=+33.719328653"
Jul 22 01:28:07.690224 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:07.690025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:07.690716 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:07.690307    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:07.863401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:07.863375    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:07.880202 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:07.880156    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:08.690334 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:08.690299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:08.690334 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:08.690329    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:08.690822 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:08.690432    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:08.690822 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:08.690535    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:09.040110 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.040021    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9znw5"]
Jul 22 01:28:09.040302 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.040206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:09.040354 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:09.040315    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:09.042568 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.042540    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhqbm"]
Jul 22 01:28:09.042709 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.042638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:09.042793 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:09.042731    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:09.045240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.045203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2vqz"]
Jul 22 01:28:09.045383 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:09.045297    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:09.045441 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:09.045392    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:10.690595 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:10.690551    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:10.691067 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:10.690657    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:10.691067 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:10.690683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:10.691067 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:10.690678    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:10.691067 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:10.690766    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:10.691067 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:10.690898    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:10.873953 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:10.873918    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="9fa0cdb6237dc38ef277e6a5d7f22e948d5307e81a54b7dd75431571af954e58" exitCode=0
Jul 22 01:28:10.873953 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:10.873957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"9fa0cdb6237dc38ef277e6a5d7f22e948d5307e81a54b7dd75431571af954e58"}
Jul 22 01:28:11.879018 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:11.878980    2559 generic.go:356] "Generic (PLEG): container finished" podID="d63b10fd-d51f-453e-bd34-07c7550ab782" containerID="70a4cc50c5672eb1dc430b3d12b516b97a99dc192e3c7c1279cbc3a6bcd1e4b9" exitCode=0
Jul 22 01:28:11.879480 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:11.879034    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerDied","Data":"70a4cc50c5672eb1dc430b3d12b516b97a99dc192e3c7c1279cbc3a6bcd1e4b9"}
Jul 22 01:28:12.690393 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:12.690218    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:12.690597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:12.690217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:12.690597 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:12.690482    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:12.690597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:12.690244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:12.690597 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:12.690535    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:12.690836 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:12.690625    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:12.884652 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:12.884618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" event={"ID":"d63b10fd-d51f-453e-bd34-07c7550ab782","Type":"ContainerStarted","Data":"692f37c9231fc4ca08985c9648de17d9bc77af212c23f1ff32be531c3699932b"}
Jul 22 01:28:12.907687 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:12.907635    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bwnwf" podStartSLOduration=7.182945224 podStartE2EDuration="38.907617148s" totalImagesPullingTime="31.724671924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:12.9072066 +0000 UTC m=+39.737143422" watchObservedRunningTime="2026-07-22 01:28:12.907617148 +0000 UTC m=+39.737553958"
Jul 22 01:28:14.690679 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.690580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:14.690679 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.690611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:14.690679 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.690578    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:14.691208 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:14.690714    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mhqbm" podUID="52d6009f-bc8c-4e0c-ac3f-80e033a0332b"
Jul 22 01:28:14.691208 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:14.690758    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9znw5" podUID="8e870cc0-e8ba-4c77-bbd9-bd0abca000e5"
Jul 22 01:28:14.691208 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:14.690869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l2vqz" podUID="990ff928-53f5-4276-a484-7ca62515f310"
Jul 22 01:28:14.905772 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.905743    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-67.ec2.internal" event="NodeReady"
Jul 22 01:28:14.905953 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.905850    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 01:28:14.940724 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.940638    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:28:14.942724 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.942703    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:14.945084 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.945063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 01:28:14.945240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.945169    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 01:28:14.945240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.945175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 01:28:14.945240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.945205    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4rgl4\""
Jul 22 01:28:14.950635 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.950614    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 01:28:14.955925 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.955761    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"]
Jul 22 01:28:14.958234 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.958215    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4prq4"]
Jul 22 01:28:14.958340 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.958325    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"
Jul 22 01:28:14.959875 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.959856    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"]
Jul 22 01:28:14.959991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.959974    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:14.960416 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.960397    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g9b7c\""
Jul 22 01:28:14.960510 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.960397    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.960510 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.960405    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.961514 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.961497    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"]
Jul 22 01:28:14.961636 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.961621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:14.962060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.962041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjdcf\""
Jul 22 01:28:14.962305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.962276    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 01:28:14.962305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.962290    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 01:28:14.962981 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.962967    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rv2hx"]
Jul 22 01:28:14.963086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963074    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:14.963606 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963588    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 01:28:14.963730 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963590    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 01:28:14.963860 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963637    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vq7n5\""
Jul 22 01:28:14.963924 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963886    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.963993 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.963975    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.964476 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.964453    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"]
Jul 22 01:28:14.964575 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.964511    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:14.966163 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.966142    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 22 01:28:14.966665 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.966648    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"]
Jul 22 01:28:14.966801 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.966786    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:14.972069 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.971750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.972247 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.972103    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.972484 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.972418    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 22 01:28:14.973305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.972884    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.973305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.972976    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 01:28:14.973305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.973002    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.973305 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.973148    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.973540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.973326    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 01:28:14.975411 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.974477    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.975411 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.975320    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 22 01:28:14.977736 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.977631    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"]
Jul 22 01:28:14.979344 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.978903    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-kphhz\""
Jul 22 01:28:14.979344 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.978981    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pwbcb\""
Jul 22 01:28:14.979344 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.979059    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5mlpp\""
Jul 22 01:28:14.979556 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.979530    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:14.981810 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.981787    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 01:28:14.981955 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.981834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:28:14.982060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.981980    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"]
Jul 22 01:28:14.982060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.982004    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4prq4"]
Jul 22 01:28:14.982060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.981839    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 01:28:14.982060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.981898    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:14.982287 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.982236    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 01:28:14.982898 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.982638    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"]
Jul 22 01:28:14.982898 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.982736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wb7lj\""
Jul 22 01:28:14.983588 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.983568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"]
Jul 22 01:28:14.984362 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984343    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.984362 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 01:28:14.984586 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984570    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"]
Jul 22 01:28:14.984658 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984643    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pwf87\""
Jul 22 01:28:14.984712 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984699    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.984904 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.984888    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 01:28:14.985542 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.985522    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rv2hx"]
Jul 22 01:28:14.986704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.986679    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c5485bddb-2hssz"]
Jul 22 01:28:14.989143 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.989105    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hkwrg"]
Jul 22 01:28:14.990336 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.989291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.991931    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992053    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992171    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992374    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.991932    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mnkqw"]
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992707    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992801    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.992973    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 01:28:14.993240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.993101    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-46xr2\""
Jul 22 01:28:14.994440 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.994412    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"]
Jul 22 01:28:14.994663 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.994648    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.995240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.995218    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.995526 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.995509    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 01:28:14.995590 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.995571    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m5cb9\""
Jul 22 01:28:14.995810 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.995793    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:14.996293 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996274    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkwrg"]
Jul 22 01:28:14.996450 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996436    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"]
Jul 22 01:28:14.996565 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c5485bddb-2hssz"]
Jul 22 01:28:14.996633 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"]
Jul 22 01:28:14.996633 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mnkqw"]
Jul 22 01:28:14.996633 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"]
Jul 22 01:28:14.996633 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.996550    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"
Jul 22 01:28:14.997685 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.997665    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:14.998099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.998083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 01:28:14.998418 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.998397    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jf4lc\""
Jul 22 01:28:14.998497 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.998455    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.998547 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.998457    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 01:28:14.998976 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.998959    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 01:28:14.999540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.999274    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-txc87\""
Jul 22 01:28:14.999798 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:14.999615    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 01:28:15.003952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.003934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 01:28:15.100190 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-tmp-dir\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.100190 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-trusted-ca\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwm5z\" (UniqueName: \"kubernetes.io/projected/8a93aec7-dc61-449b-9176-dc5afc29324e-kube-api-access-mwm5z\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-config-volume\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20f2093a-0134-4aef-af55-54802185ad5e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a93aec7-dc61-449b-9176-dc5afc29324e-serving-cert\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-config\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzd72\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-service-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1acdcfd5-e001-49df-9493-7e123d67686d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4n9m\" (UniqueName: \"kubernetes.io/projected/40ad6d33-620d-429e-a413-62c9c9203393-kube-api-access-x4n9m\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42hz\" (UniqueName: \"kubernetes.io/projected/599e36cc-774f-4be9-ba42-fadaa561fc2f-kube-api-access-g42hz\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9ml\" (UniqueName: \"kubernetes.io/projected/c611cf6b-5999-42b1-abcb-2f1468d42685-kube-api-access-4n9ml\") pod \"network-check-source-7bc5b6bf85-lvms4\" (UID: \"c611cf6b-5999-42b1-abcb-2f1468d42685\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcrw\" (UniqueName: \"kubernetes.io/projected/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-kube-api-access-xzcrw\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad6d33-620d-429e-a413-62c9c9203393-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkqc\" (UniqueName: \"kubernetes.io/projected/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-kube-api-access-ggkqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.100980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.100976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-stats-auth\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skfc9\" (UniqueName: \"kubernetes.io/projected/c9092964-52a3-4a04-bf50-e0071a53b374-kube-api-access-skfc9\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101030    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxk9v\" (UniqueName: \"kubernetes.io/projected/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-kube-api-access-bxk9v\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d28\" (UniqueName: \"kubernetes.io/projected/1c867840-35a3-4ade-a085-de8894729e6e-kube-api-access-w8d28\") pod \"volume-data-source-validator-78cf4c6f6-z5lmj\" (UID: \"1c867840-35a3-4ade-a085-de8894729e6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-snapshots\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9092964-52a3-4a04-bf50-e0071a53b374-serving-cert\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-tmp\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101248    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkvtv\" (UniqueName: \"kubernetes.io/projected/20f2093a-0134-4aef-af55-54802185ad5e-kube-api-access-tkvtv\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599e36cc-774f-4be9-ba42-fadaa561fc2f-cert\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfcp\" (UniqueName: \"kubernetes.io/projected/f16a3a91-2813-47af-9187-51149962771e-kube-api-access-jjfcp\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101336    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-default-certificate\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.101434 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101379    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.101874 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.101874 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.101435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40ad6d33-620d-429e-a413-62c9c9203393-config\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.202465 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-trusted-ca\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.202465 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwm5z\" (UniqueName: \"kubernetes.io/projected/8a93aec7-dc61-449b-9176-dc5afc29324e-kube-api-access-mwm5z\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.202465 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202439    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-config-volume\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.202465 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202490    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202513    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20f2093a-0134-4aef-af55-54802185ad5e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a93aec7-dc61-449b-9176-dc5afc29324e-serving-cert\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-config\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzd72\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.202794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.202785    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-service-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.203291 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.202856    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:15.203291 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.202922    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.702902014 +0000 UTC m=+42.532838818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:15.203408 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-config-volume\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.203462 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-service-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.203514 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-trusted-ca\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.203514 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1acdcfd5-e001-49df-9493-7e123d67686d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.203606 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4n9m\" (UniqueName: \"kubernetes.io/projected/40ad6d33-620d-429e-a413-62c9c9203393-kube-api-access-x4n9m\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.203606 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42hz\" (UniqueName: \"kubernetes.io/projected/599e36cc-774f-4be9-ba42-fadaa561fc2f-kube-api-access-g42hz\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.203606 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.203751 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203609    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9ml\" (UniqueName: \"kubernetes.io/projected/c611cf6b-5999-42b1-abcb-2f1468d42685-kube-api-access-4n9ml\") pod \"network-check-source-7bc5b6bf85-lvms4\" (UID: \"c611cf6b-5999-42b1-abcb-2f1468d42685\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"
Jul 22 01:28:15.203751 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.203751 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcrw\" (UniqueName: \"kubernetes.io/projected/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-kube-api-access-xzcrw\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.203751 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c9092964-52a3-4a04-bf50-e0071a53b374-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad6d33-620d-429e-a413-62c9c9203393-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.203833    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkqc\" (UniqueName: \"kubernetes.io/projected/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-kube-api-access-ggkqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.203891    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.703875962 +0000 UTC m=+42.533812752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:15.203952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-stats-auth\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skfc9\" (UniqueName: \"kubernetes.io/projected/c9092964-52a3-4a04-bf50-e0071a53b374-kube-api-access-skfc9\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.203998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxk9v\" (UniqueName: \"kubernetes.io/projected/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-kube-api-access-bxk9v\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d28\" (UniqueName: \"kubernetes.io/projected/1c867840-35a3-4ade-a085-de8894729e6e-kube-api-access-w8d28\") pod \"volume-data-source-validator-78cf4c6f6-z5lmj\" (UID: \"1c867840-35a3-4ade-a085-de8894729e6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204106    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a93aec7-dc61-449b-9176-dc5afc29324e-config\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-snapshots\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9092964-52a3-4a04-bf50-e0071a53b374-serving-cert\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-tmp\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.204270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkvtv\" (UniqueName: \"kubernetes.io/projected/20f2093a-0134-4aef-af55-54802185ad5e-kube-api-access-tkvtv\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599e36cc-774f-4be9-ba42-fadaa561fc2f-cert\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20f2093a-0134-4aef-af55-54802185ad5e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfcp\" (UniqueName: \"kubernetes.io/projected/f16a3a91-2813-47af-9187-51149962771e-kube-api-access-jjfcp\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-default-certificate\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204398    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.204787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204566    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.204371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1acdcfd5-e001-49df-9493-7e123d67686d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.204934    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.204991    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls podName:f16a3a91-2813-47af-9187-51149962771e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.704976931 +0000 UTC m=+42.534913721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rz8lf" (UID: "f16a3a91-2813-47af-9187-51149962771e") : secret "samples-operator-tls" not found
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-snapshots\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.205146 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40ad6d33-620d-429e-a413-62c9c9203393-config\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.205632 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-tmp-dir\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.205632 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.205632 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.205632 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.205498    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:15.205632 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.205543    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.705528743 +0000 UTC m=+42.535465532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:15.205869 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-tmp-dir\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.205869 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.205848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/40ad6d33-620d-429e-a413-62c9c9203393-config\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.205966 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.205949    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.705935215 +0000 UTC m=+42.535872036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:15.206028 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.206018    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:15.206074 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.206031    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:15.206074 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.206068    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.70605481 +0000 UTC m=+42.535991616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:15.206196 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.206158    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:15.206196 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.206192    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:15.706181729 +0000 UTC m=+42.536118518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:15.206295 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.206275    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.206472 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.206445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9092964-52a3-4a04-bf50-e0071a53b374-tmp\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.208581 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.208556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.208731 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.208682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.208975 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.208950    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c9092964-52a3-4a04-bf50-e0071a53b374-serving-cert\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.209103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.209075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40ad6d33-620d-429e-a413-62c9c9203393-serving-cert\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.209103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.209097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-default-certificate\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.209295 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.209100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/599e36cc-774f-4be9-ba42-fadaa561fc2f-cert\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.209355 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.209335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.209682 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.209662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a93aec7-dc61-449b-9176-dc5afc29324e-serving-cert\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.210504 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.210487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-stats-auth\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.213973 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.213937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.214925 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.214345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwm5z\" (UniqueName: \"kubernetes.io/projected/8a93aec7-dc61-449b-9176-dc5afc29324e-kube-api-access-mwm5z\") pod \"console-operator-565b7b569d-mnkqw\" (UID: \"8a93aec7-dc61-449b-9176-dc5afc29324e\") " pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.217618 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.217322    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxk9v\" (UniqueName: \"kubernetes.io/projected/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-kube-api-access-bxk9v\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.219278 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.217709    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkqc\" (UniqueName: \"kubernetes.io/projected/cb065bf4-7e56-4ef0-bf99-93bd1ab260e8-kube-api-access-ggkqc\") pod \"kube-storage-version-migrator-operator-7658d9b749-xnsjm\" (UID: \"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.219278 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.217909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcrw\" (UniqueName: \"kubernetes.io/projected/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-kube-api-access-xzcrw\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.219278 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.218550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfcp\" (UniqueName: \"kubernetes.io/projected/f16a3a91-2813-47af-9187-51149962771e-kube-api-access-jjfcp\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.219278 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.218664    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzd72\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.219278 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.219057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9ml\" (UniqueName: \"kubernetes.io/projected/c611cf6b-5999-42b1-abcb-2f1468d42685-kube-api-access-4n9ml\") pod \"network-check-source-7bc5b6bf85-lvms4\" (UID: \"c611cf6b-5999-42b1-abcb-2f1468d42685\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"
Jul 22 01:28:15.219555 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.219290    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkvtv\" (UniqueName: \"kubernetes.io/projected/20f2093a-0134-4aef-af55-54802185ad5e-kube-api-access-tkvtv\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.219610 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.219570    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42hz\" (UniqueName: \"kubernetes.io/projected/599e36cc-774f-4be9-ba42-fadaa561fc2f-kube-api-access-g42hz\") pod \"ingress-canary-hkwrg\" (UID: \"599e36cc-774f-4be9-ba42-fadaa561fc2f\") " pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.219802 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.219780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d28\" (UniqueName: \"kubernetes.io/projected/1c867840-35a3-4ade-a085-de8894729e6e-kube-api-access-w8d28\") pod \"volume-data-source-validator-78cf4c6f6-z5lmj\" (UID: \"1c867840-35a3-4ade-a085-de8894729e6e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"
Jul 22 01:28:15.220059 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.220035    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skfc9\" (UniqueName: \"kubernetes.io/projected/c9092964-52a3-4a04-bf50-e0071a53b374-kube-api-access-skfc9\") pod \"insights-operator-555d9d7885-rv2hx\" (UID: \"c9092964-52a3-4a04-bf50-e0071a53b374\") " pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.220833 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.220810    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4n9m\" (UniqueName: \"kubernetes.io/projected/40ad6d33-620d-429e-a413-62c9c9203393-kube-api-access-x4n9m\") pod \"service-ca-operator-5bcbc94c78-gcbcm\" (UID: \"40ad6d33-620d-429e-a413-62c9c9203393\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.273693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.273654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"
Jul 22 01:28:15.293108 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.293071    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"
Jul 22 01:28:15.312187 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.312113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rv2hx"
Jul 22 01:28:15.331011 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.330893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"
Jul 22 01:28:15.343570 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.342599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hkwrg"
Jul 22 01:28:15.350388 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.350359    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:15.353935 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.353901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"
Jul 22 01:28:15.510366 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.509888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj"]
Jul 22 01:28:15.520598 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.518841    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm"]
Jul 22 01:28:15.521527 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.521489    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c867840_35a3_4ade_a085_de8894729e6e.slice/crio-a5fb621ca14bad88576a0470b379fc99de4beb670c70eb9670bc50ae350405b8 WatchSource:0}: Error finding container a5fb621ca14bad88576a0470b379fc99de4beb670c70eb9670bc50ae350405b8: Status 404 returned error can't find the container with id a5fb621ca14bad88576a0470b379fc99de4beb670c70eb9670bc50ae350405b8
Jul 22 01:28:15.522848 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.522819    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb065bf4_7e56_4ef0_bf99_93bd1ab260e8.slice/crio-f0e9f1a11c1eef284740d3d81a16875faab4e06de525b03daadf7250f62acda5 WatchSource:0}: Error finding container f0e9f1a11c1eef284740d3d81a16875faab4e06de525b03daadf7250f62acda5: Status 404 returned error can't find the container with id f0e9f1a11c1eef284740d3d81a16875faab4e06de525b03daadf7250f62acda5
Jul 22 01:28:15.547075 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.546643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rv2hx"]
Jul 22 01:28:15.549989 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.549951    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9092964_52a3_4a04_bf50_e0071a53b374.slice/crio-4896f6930728114608cea2daff72dd62ad5ba5ebe386db98d01cf15ba417c7ba WatchSource:0}: Error finding container 4896f6930728114608cea2daff72dd62ad5ba5ebe386db98d01cf15ba417c7ba: Status 404 returned error can't find the container with id 4896f6930728114608cea2daff72dd62ad5ba5ebe386db98d01cf15ba417c7ba
Jul 22 01:28:15.571610 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.571492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm"]
Jul 22 01:28:15.578252 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.578213    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mnkqw"]
Jul 22 01:28:15.578380 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.578343    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ad6d33_620d_429e_a413_62c9c9203393.slice/crio-14f47849a38ae83616219c525d5e4c80f10ac5f0ade43e7f582ed58a636075da WatchSource:0}: Error finding container 14f47849a38ae83616219c525d5e4c80f10ac5f0ade43e7f582ed58a636075da: Status 404 returned error can't find the container with id 14f47849a38ae83616219c525d5e4c80f10ac5f0ade43e7f582ed58a636075da
Jul 22 01:28:15.580683 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.580596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hkwrg"]
Jul 22 01:28:15.583552 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.583523    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a93aec7_dc61_449b_9176_dc5afc29324e.slice/crio-191c7eaea1d3f9ad18a16a5c5987f392312311028cf4d250876336168991a2c2 WatchSource:0}: Error finding container 191c7eaea1d3f9ad18a16a5c5987f392312311028cf4d250876336168991a2c2: Status 404 returned error can't find the container with id 191c7eaea1d3f9ad18a16a5c5987f392312311028cf4d250876336168991a2c2
Jul 22 01:28:15.584195 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.584172    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599e36cc_774f_4be9_ba42_fadaa561fc2f.slice/crio-5fcfc66dd6b77466f3cf84f50be0eb8e2efda204395b8d58609b5597a5870f80 WatchSource:0}: Error finding container 5fcfc66dd6b77466f3cf84f50be0eb8e2efda204395b8d58609b5597a5870f80: Status 404 returned error can't find the container with id 5fcfc66dd6b77466f3cf84f50be0eb8e2efda204395b8d58609b5597a5870f80
Jul 22 01:28:15.591364 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.591340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4"]
Jul 22 01:28:15.594524 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:15.594496    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc611cf6b_5999_42b1_abcb_2f1468d42685.slice/crio-597bf170e1be6ef1e3b60d5e80d5a8a0cca1bca93965d0d47699b8b7df84b8a4 WatchSource:0}: Error finding container 597bf170e1be6ef1e3b60d5e80d5a8a0cca1bca93965d0d47699b8b7df84b8a4: Status 404 returned error can't find the container with id 597bf170e1be6ef1e3b60d5e80d5a8a0cca1bca93965d0d47699b8b7df84b8a4
Jul 22 01:28:15.712920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.712829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:15.712920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.712879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.712920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.712900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.712980    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.712990    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.712989    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.713018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713041    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713025432 +0000 UTC m=+43.542962220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713082    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713062888 +0000 UTC m=+43.542999678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713085    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713105    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.71309843 +0000 UTC m=+43.543035218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713141    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713119545 +0000 UTC m=+43.543056334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.713193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.713244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.713280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713327    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713353    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713368    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:15.713616 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713378    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713362104 +0000 UTC m=+43.543298913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:15.714169 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713396    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713387501 +0000 UTC m=+43.543324291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:15.714169 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:15.713407    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls podName:f16a3a91-2813-47af-9187-51149962771e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:16.713401738 +0000 UTC m=+43.543338527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rz8lf" (UID: "f16a3a91-2813-47af-9187-51149962771e") : secret "samples-operator-tls" not found
Jul 22 01:28:15.892062 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.892021    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkwrg" event={"ID":"599e36cc-774f-4be9-ba42-fadaa561fc2f","Type":"ContainerStarted","Data":"5fcfc66dd6b77466f3cf84f50be0eb8e2efda204395b8d58609b5597a5870f80"}
Jul 22 01:28:15.893160 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.893114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rv2hx" event={"ID":"c9092964-52a3-4a04-bf50-e0071a53b374","Type":"ContainerStarted","Data":"4896f6930728114608cea2daff72dd62ad5ba5ebe386db98d01cf15ba417c7ba"}
Jul 22 01:28:15.894173 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.894151    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4" event={"ID":"c611cf6b-5999-42b1-abcb-2f1468d42685","Type":"ContainerStarted","Data":"597bf170e1be6ef1e3b60d5e80d5a8a0cca1bca93965d0d47699b8b7df84b8a4"}
Jul 22 01:28:15.895310 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.895291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" event={"ID":"8a93aec7-dc61-449b-9176-dc5afc29324e","Type":"ContainerStarted","Data":"191c7eaea1d3f9ad18a16a5c5987f392312311028cf4d250876336168991a2c2"}
Jul 22 01:28:15.896316 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.896298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm" event={"ID":"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8","Type":"ContainerStarted","Data":"f0e9f1a11c1eef284740d3d81a16875faab4e06de525b03daadf7250f62acda5"}
Jul 22 01:28:15.897332 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.897313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm" event={"ID":"40ad6d33-620d-429e-a413-62c9c9203393","Type":"ContainerStarted","Data":"14f47849a38ae83616219c525d5e4c80f10ac5f0ade43e7f582ed58a636075da"}
Jul 22 01:28:15.898339 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:15.898322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj" event={"ID":"1c867840-35a3-4ade-a085-de8894729e6e","Type":"ContainerStarted","Data":"a5fb621ca14bad88576a0470b379fc99de4beb670c70eb9670bc50ae350405b8"}
Jul 22 01:28:16.690366 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.690332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:16.690556 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.690538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:16.690837 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.690713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:16.693327 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.693304    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 01:28:16.694189 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.694059    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l47xs\""
Jul 22 01:28:16.694189 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.694068    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 01:28:16.694189 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.694076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vpdlh\""
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.723954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724017    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724270    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724274    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724296    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724330    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724311511 +0000 UTC m=+45.554248303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724365    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724346909 +0000 UTC m=+45.554283705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724433    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724466    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724455189 +0000 UTC m=+45.554391982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:16.724558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724668    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:16.724816 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724703    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724690806 +0000 UTC m=+45.554627597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:16.726086 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724728    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724714216 +0000 UTC m=+45.554651012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:16.726086 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724753    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:16.726086 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724786    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724774726 +0000 UTC m=+45.554711521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:16.726086 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724786    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 01:28:16.726086 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:16.724819    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls podName:f16a3a91-2813-47af-9187-51149962771e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:18.724810255 +0000 UTC m=+45.554747049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rz8lf" (UID: "f16a3a91-2813-47af-9187-51149962771e") : secret "samples-operator-tls" not found
Jul 22 01:28:17.910900 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:17.910804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj" event={"ID":"1c867840-35a3-4ade-a085-de8894729e6e","Type":"ContainerStarted","Data":"16a0667964debfe1816c416370192c966f1d8db793caf9f9daa943336c18de94"}
Jul 22 01:28:18.747874 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.747789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:18.747874 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.747859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:18.748044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.747909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:18.748044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.747939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:18.748044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.747968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:18.748044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.748019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:18.748201 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:18.748060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:18.748259 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748203    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:18.748311 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748263    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748246644 +0000 UTC m=+49.578183447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:18.748311 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748280    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 01:28:18.748418 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748290    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748270008 +0000 UTC m=+49.578206816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:18.748418 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748348    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls podName:f16a3a91-2813-47af-9187-51149962771e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748333296 +0000 UTC m=+49.578270091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rz8lf" (UID: "f16a3a91-2813-47af-9187-51149962771e") : secret "samples-operator-tls" not found
Jul 22 01:28:18.748418 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748358    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:18.748418 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748404    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748391725 +0000 UTC m=+49.578328533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:18.748418 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748410    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748445    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748434056 +0000 UTC m=+49.578370847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748478    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748491    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748504    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748529    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748515774 +0000 UTC m=+49.578452567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:18.748666 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:18.748547    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:22.748536569 +0000 UTC m=+49.578473358 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:19.079221 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:19.079121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rczm4_a9124ada-91a6-4a83-b3d5-1fd257417ef9/konnectivity-agent/0.log" limit=1024
Jul 22 01:28:19.158386 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:19.158344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rczm4_a9124ada-91a6-4a83-b3d5-1fd257417ef9/konnectivity-agent/0.log" limit=1024
Jul 22 01:28:22.784262 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.783974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rczm4_a9124ada-91a6-4a83-b3d5-1fd257417ef9/konnectivity-agent/0.log" limit=1024
Jul 22 01:28:22.789897 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.789869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:22.790050 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.789941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:22.790050 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.789990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:22.790050 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.790028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:22.790246 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.790071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:22.790246 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.790096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:22.790246 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.790143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:22.790385 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790283    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:22.790385 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790342    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790324586 +0000 UTC m=+57.620261392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790567    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790619    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790604221 +0000 UTC m=+57.620541024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790679    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790717    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls podName:f16a3a91-2813-47af-9187-51149962771e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.79070679 +0000 UTC m=+57.620643596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-rz8lf" (UID: "f16a3a91-2813-47af-9187-51149962771e") : secret "samples-operator-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790722    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790767    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790756459 +0000 UTC m=+57.620693249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790766    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790792    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:22.790803 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790799    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790788797 +0000 UTC m=+57.620725588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:22.791195 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790853    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790832569 +0000 UTC m=+57.620769381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:22.791195 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.790957    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:22.791195 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:22.791006    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:30.790992899 +0000 UTC m=+57.620929701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:22.926418 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.926376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rv2hx" event={"ID":"c9092964-52a3-4a04-bf50-e0071a53b374","Type":"ContainerStarted","Data":"42ba6c522f6dbbae1223195fcd7c4d8525fba45243bfd07fc9b4d20928a265db"}
Jul 22 01:28:22.928000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.927955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4" event={"ID":"c611cf6b-5999-42b1-abcb-2f1468d42685","Type":"ContainerStarted","Data":"f20f3810985cef2b18974ab52ff9309e52a09c5acc5519925aceab5da88a0d79"}
Jul 22 01:28:22.929921 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.929901    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/0.log"
Jul 22 01:28:22.930014 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.929941    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a93aec7-dc61-449b-9176-dc5afc29324e" containerID="5d7d1611de421a78a9b283d10ee04c1945289c7640aeb94dc06229e38c44c2ef" exitCode=255
Jul 22 01:28:22.930087 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.930009    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" event={"ID":"8a93aec7-dc61-449b-9176-dc5afc29324e","Type":"ContainerDied","Data":"5d7d1611de421a78a9b283d10ee04c1945289c7640aeb94dc06229e38c44c2ef"}
Jul 22 01:28:22.930225 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.930210    2559 scope.go:117] "RemoveContainer" containerID="5d7d1611de421a78a9b283d10ee04c1945289c7640aeb94dc06229e38c44c2ef"
Jul 22 01:28:22.932152 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.932086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm" event={"ID":"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8","Type":"ContainerStarted","Data":"2555d558f74d788d5b8808df1159f808bdd02fbe0c4faf37a059e17d34ca2259"}
Jul 22 01:28:22.934148 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.934104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm" event={"ID":"40ad6d33-620d-429e-a413-62c9c9203393","Type":"ContainerStarted","Data":"a1e5199dcb197677bc259aa651d53d298484ea9a8379fa61c9c2155a923452ea"}
Jul 22 01:28:22.935691 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.935667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hkwrg" event={"ID":"599e36cc-774f-4be9-ba42-fadaa561fc2f","Type":"ContainerStarted","Data":"315bb50168e0cf5d834d12c20e4b4d739f5bd36d841982ee6697e0c7db347aab"}
Jul 22 01:28:22.954159 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.948501    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-rv2hx" podStartSLOduration=23.251215244 podStartE2EDuration="29.948479255s" totalImagesPullingTime="6.697264011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:22.945559951 +0000 UTC m=+49.775496801" watchObservedRunningTime="2026-07-22 01:28:22.948479255 +0000 UTC m=+49.778416069"
Jul 22 01:28:22.954159 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.950732    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-z5lmj" podStartSLOduration=27.732496991 podStartE2EDuration="29.950712295s" totalImagesPullingTime="2.218215304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:18.92986879 +0000 UTC m=+45.759805600" watchObservedRunningTime="2026-07-22 01:28:22.950712295 +0000 UTC m=+49.780649107"
Jul 22 01:28:22.988931 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.988839    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm" podStartSLOduration=23.266131762 podStartE2EDuration="29.988815537s" totalImagesPullingTime="6.722683775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:22.987447009 +0000 UTC m=+49.817383820" watchObservedRunningTime="2026-07-22 01:28:22.988815537 +0000 UTC m=+49.818752351"
Jul 22 01:28:22.989151 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:22.988987    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-lvms4" podStartSLOduration=23.326977755 podStartE2EDuration="29.98897687s" totalImagesPullingTime="6.661999115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:22.963888457 +0000 UTC m=+49.793825269" watchObservedRunningTime="2026-07-22 01:28:22.98897687 +0000 UTC m=+49.818913681"
Jul 22 01:28:23.006792 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.006145    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm" podStartSLOduration=23.335772221 podStartE2EDuration="30.006107918s" totalImagesPullingTime="6.670335697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:23.004458312 +0000 UTC m=+49.834395147" watchObservedRunningTime="2026-07-22 01:28:23.006107918 +0000 UTC m=+49.836044729"
Jul 22 01:28:23.041235 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.041079    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hkwrg" podStartSLOduration=2.367413889 podStartE2EDuration="9.041062838s" totalImagesPullingTime="6.673648949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:23.040301461 +0000 UTC m=+49.870238294" watchObservedRunningTime="2026-07-22 01:28:23.041062838 +0000 UTC m=+49.870999649"
Jul 22 01:28:23.857123 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.857085    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g64jd"]
Jul 22 01:28:23.860291 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.860267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.864358 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.864338    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gdbrc\""
Jul 22 01:28:23.864733 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.864718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 01:28:23.865094 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.865024    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 01:28:23.875949 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.875923    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g64jd"]
Jul 22 01:28:23.901645 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.901602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-crio-socket\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.901834 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.901685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.901834 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.901717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.901834 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.901763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8txh\" (UniqueName: \"kubernetes.io/projected/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-api-access-v8txh\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.902006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.901878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-data-volume\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:23.941183 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.941151    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/1.log"
Jul 22 01:28:23.941680 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.941653    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/0.log"
Jul 22 01:28:23.941803 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.941698    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a93aec7-dc61-449b-9176-dc5afc29324e" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874" exitCode=255
Jul 22 01:28:23.941980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.941953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" event={"ID":"8a93aec7-dc61-449b-9176-dc5afc29324e","Type":"ContainerDied","Data":"4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"}
Jul 22 01:28:23.942057 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.942010    2559 scope.go:117] "RemoveContainer" containerID="5d7d1611de421a78a9b283d10ee04c1945289c7640aeb94dc06229e38c44c2ef"
Jul 22 01:28:23.942857 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:23.942830    2559 scope.go:117] "RemoveContainer" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"
Jul 22 01:28:23.943044 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:23.942999    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:24.002433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.002399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.002608 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.002471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8txh\" (UniqueName: \"kubernetes.io/projected/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-api-access-v8txh\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.002608 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.002532    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 01:28:24.002608 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.002606    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:24.502586759 +0000 UTC m=+51.332523551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : configmap "kube-rbac-proxy" not found
Jul 22 01:28:24.002871 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.002847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-data-volume\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.003850 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.003524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-data-volume\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.003850 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.003560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-crio-socket\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.003850 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.003751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-crio-socket\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.003850 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.003840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.004261 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.004240    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:24.004330 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.004312    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:24.50428688 +0000 UTC m=+51.334223684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:24.013306 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.013278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8txh\" (UniqueName: \"kubernetes.io/projected/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-api-access-v8txh\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.174951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.174862    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"]
Jul 22 01:28:24.177758 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.177741    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"
Jul 22 01:28:24.179903 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.179876    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 01:28:24.180044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.180024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wkw2z\""
Jul 22 01:28:24.180182 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.180169    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 01:28:24.187410 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.187387    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"]
Jul 22 01:28:24.206303 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.206265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6vrw\" (UniqueName: \"kubernetes.io/projected/0beeccbb-9c9b-4655-b91c-7de322352221-kube-api-access-n6vrw\") pod \"migrator-7cc9c7ffd7-hlmpp\" (UID: \"0beeccbb-9c9b-4655-b91c-7de322352221\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"
Jul 22 01:28:24.307832 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.307780    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6vrw\" (UniqueName: \"kubernetes.io/projected/0beeccbb-9c9b-4655-b91c-7de322352221-kube-api-access-n6vrw\") pod \"migrator-7cc9c7ffd7-hlmpp\" (UID: \"0beeccbb-9c9b-4655-b91c-7de322352221\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"
Jul 22 01:28:24.318571 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.318530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6vrw\" (UniqueName: \"kubernetes.io/projected/0beeccbb-9c9b-4655-b91c-7de322352221-kube-api-access-n6vrw\") pod \"migrator-7cc9c7ffd7-hlmpp\" (UID: \"0beeccbb-9c9b-4655-b91c-7de322352221\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"
Jul 22 01:28:24.487739 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.487656    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"
Jul 22 01:28:24.510144 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.510087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.510144 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.510140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:24.510409 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.510210    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 01:28:24.510409 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.510245    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:24.510409 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.510265    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:25.510250617 +0000 UTC m=+52.340187406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : configmap "kube-rbac-proxy" not found
Jul 22 01:28:24.510409 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.510299    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:25.510286126 +0000 UTC m=+52.340222915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:24.615186 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.615158    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp"]
Jul 22 01:28:24.618221 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:24.618190    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0beeccbb_9c9b_4655_b91c_7de322352221.slice/crio-31c8e33099fd68232dac63825cda59c57ed58febfc6a9a82e790f3ee3262f7c6 WatchSource:0}: Error finding container 31c8e33099fd68232dac63825cda59c57ed58febfc6a9a82e790f3ee3262f7c6: Status 404 returned error can't find the container with id 31c8e33099fd68232dac63825cda59c57ed58febfc6a9a82e790f3ee3262f7c6
Jul 22 01:28:24.945899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.945866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp" event={"ID":"0beeccbb-9c9b-4655-b91c-7de322352221","Type":"ContainerStarted","Data":"31c8e33099fd68232dac63825cda59c57ed58febfc6a9a82e790f3ee3262f7c6"}
Jul 22 01:28:24.947400 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.947379    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/1.log"
Jul 22 01:28:24.947699 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:24.947685    2559 scope.go:117] "RemoveContainer" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"
Jul 22 01:28:24.947866 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:24.947848    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:25.248244 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.248155    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfnkz_3c949326-9864-4f26-9a35-c256ed1653d7/dns-node-resolver/0.log"
Jul 22 01:28:25.351764 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.351726    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:25.351932 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.351832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:25.518402 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.518313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:25.518402 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.518360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:25.518606 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:25.518459    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 01:28:25.518606 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:25.518464    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:25.518606 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:25.518543    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:27.518509973 +0000 UTC m=+54.348446776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:25.518606 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:25.518566    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:27.518555344 +0000 UTC m=+54.348492147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : configmap "kube-rbac-proxy" not found
Jul 22 01:28:25.953375 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:25.953348    2559 scope.go:117] "RemoveContainer" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"
Jul 22 01:28:25.953760 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:25.953498    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:26.265304 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.265226    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-md9fz_dca8765b-c288-4e68-b70a-411adfad43ba/node-ca/0.log"
Jul 22 01:28:26.610099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.610064    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8phbd"]
Jul 22 01:28:26.613255 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.613233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.615568 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.615544    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 01:28:26.616468 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.616446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 01:28:26.616609 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.616474    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 01:28:26.616609 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.616486    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 01:28:26.616609 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.616524    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2j6zj\""
Jul 22 01:28:26.625612 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.625585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8phbd"]
Jul 22 01:28:26.648768 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.648738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkwrg_599e36cc-774f-4be9-ba42-fadaa561fc2f/serve-healthcheck-canary/0.log"
Jul 22 01:28:26.729955 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.729914    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5048ab07-8199-43f4-822b-438556058f67-signing-cabundle\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.729955 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.729952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5048ab07-8199-43f4-822b-438556058f67-signing-key\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.730264 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.729985    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfszl\" (UniqueName: \"kubernetes.io/projected/5048ab07-8199-43f4-822b-438556058f67-kube-api-access-sfszl\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.831499 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.831391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfszl\" (UniqueName: \"kubernetes.io/projected/5048ab07-8199-43f4-822b-438556058f67-kube-api-access-sfszl\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.831662 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.831627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5048ab07-8199-43f4-822b-438556058f67-signing-cabundle\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.831731 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.831661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5048ab07-8199-43f4-822b-438556058f67-signing-key\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.832355 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.832331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5048ab07-8199-43f4-822b-438556058f67-signing-cabundle\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.834270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.834239    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5048ab07-8199-43f4-822b-438556058f67-signing-key\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.840984 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.840954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfszl\" (UniqueName: \"kubernetes.io/projected/5048ab07-8199-43f4-822b-438556058f67-kube-api-access-sfszl\") pod \"service-ca-58598695f7-8phbd\" (UID: \"5048ab07-8199-43f4-822b-438556058f67\") " pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.923908 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.923860    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-8phbd"
Jul 22 01:28:26.957967 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.957929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp" event={"ID":"0beeccbb-9c9b-4655-b91c-7de322352221","Type":"ContainerStarted","Data":"3df5e4819cc72915936bab362b1a718c8c1802f3da24174947dbfa28d518803b"}
Jul 22 01:28:26.958491 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.957986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp" event={"ID":"0beeccbb-9c9b-4655-b91c-7de322352221","Type":"ContainerStarted","Data":"c4809c88e133a80f444f857ec86af502d41c5d4b4d16a6d999d22a9792d3c9e7"}
Jul 22 01:28:26.975310 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:26.975248    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-hlmpp" podStartSLOduration=1.1939749769999999 podStartE2EDuration="2.975223089s" totalImagesPullingTime="1.781248112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:26.974799216 +0000 UTC m=+53.804736027" watchObservedRunningTime="2026-07-22 01:28:26.975223089 +0000 UTC m=+53.805159901"
Jul 22 01:28:27.058231 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.058201    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-8phbd"]
Jul 22 01:28:27.061041 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:27.061016    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5048ab07_8199_43f4_822b_438556058f67.slice/crio-5156a1143493f171620e595cbe939cefb2df8a12574e536bd2ecf60870c81c3a WatchSource:0}: Error finding container 5156a1143493f171620e595cbe939cefb2df8a12574e536bd2ecf60870c81c3a: Status 404 returned error can't find the container with id 5156a1143493f171620e595cbe939cefb2df8a12574e536bd2ecf60870c81c3a
Jul 22 01:28:27.537782 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.537730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:27.537782 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.537786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:27.538029 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:27.537883    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 01:28:27.538029 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:27.537890    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:27.538029 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:27.537937    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:31.537924159 +0000 UTC m=+58.367860948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : configmap "kube-rbac-proxy" not found
Jul 22 01:28:27.538029 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:27.537951    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:31.537944089 +0000 UTC m=+58.367880877 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:27.963171 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.963116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-8phbd" event={"ID":"5048ab07-8199-43f4-822b-438556058f67","Type":"ContainerStarted","Data":"717846348d276a85fe3290784979fdd48148da8885704c85b8022b84733ec2dd"}
Jul 22 01:28:27.963565 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.963195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-8phbd" event={"ID":"5048ab07-8199-43f4-822b-438556058f67","Type":"ContainerStarted","Data":"5156a1143493f171620e595cbe939cefb2df8a12574e536bd2ecf60870c81c3a"}
Jul 22 01:28:27.981626 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:27.981577    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-8phbd" podStartSLOduration=1.98156102 podStartE2EDuration="1.98156102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:27.98046996 +0000 UTC m=+54.810406772" watchObservedRunningTime="2026-07-22 01:28:27.98156102 +0000 UTC m=+54.811497831"
Jul 22 01:28:30.872865 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.872819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.872888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.872934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.872960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.872991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.873048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873055    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873101    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873149    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dd8d8794-gtq6v: secret "image-registry-tls" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873181    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873186    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873107    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.87308672 +0000 UTC m=+73.703023508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : configmap references non-existent config key: service-ca.crt
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873256    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs podName:326680c8-a142-4a9f-8acf-d3e5aa48ae5c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.873235558 +0000 UTC m=+73.703172351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs") pod "router-default-c5485bddb-2hssz" (UID: "326680c8-a142-4a9f-8acf-d3e5aa48ae5c") : secret "router-metrics-certs-default" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873277    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls podName:20f2093a-0134-4aef-af55-54802185ad5e nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.8732665 +0000 UTC m=+73.703203291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-8p45n" (UID: "20f2093a-0134-4aef-af55-54802185ad5e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls podName:3cb60c39-808d-4a0e-8759-ca89872a662c nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.873298496 +0000 UTC m=+73.703235285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls") pod "image-registry-5dd8d8794-gtq6v" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c") : secret "image-registry-tls" not found
Jul 22 01:28:30.873380 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873320    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert podName:1acdcfd5-e001-49df-9493-7e123d67686d nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.87331312 +0000 UTC m=+73.703249909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qkv6z" (UID: "1acdcfd5-e001-49df-9493-7e123d67686d") : secret "networking-console-plugin-cert" not found
Jul 22 01:28:30.874147 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.873366    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:30.874147 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873451    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 01:28:30.874147 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:30.873486    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls podName:3745794e-a157-4e3d-9397-b1f3d1bd6cbe nodeName:}" failed. No retries permitted until 2026-07-22 01:28:46.873477139 +0000 UTC m=+73.703413942 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls") pod "dns-default-4prq4" (UID: "3745794e-a157-4e3d-9397-b1f3d1bd6cbe") : secret "dns-default-metrics-tls" not found
Jul 22 01:28:30.875808 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.875776    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f16a3a91-2813-47af-9187-51149962771e-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-rz8lf\" (UID: \"f16a3a91-2813-47af-9187-51149962771e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:30.918164 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:30.918108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"
Jul 22 01:28:31.073878 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:31.073851    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf"]
Jul 22 01:28:31.579952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:31.579860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:31.579952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:31.579902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:31.580189 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:31.579989    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 01:28:31.580189 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:31.580022    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:31.580189 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:31.580044    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:39.580029353 +0000 UTC m=+66.409966142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : configmap "kube-rbac-proxy" not found
Jul 22 01:28:31.580189 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:31.580079    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls podName:9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3 nodeName:}" failed. No retries permitted until 2026-07-22 01:28:39.580064116 +0000 UTC m=+66.410000905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g64jd" (UID: "9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3") : secret "insights-runtime-extractor-tls" not found
Jul 22 01:28:31.979537 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:31.979458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf" event={"ID":"f16a3a91-2813-47af-9187-51149962771e","Type":"ContainerStarted","Data":"06757388aed32f1cfd2f75b2c00d8844d349b818bba6dbbfa4ff2f4698d04055"}
Jul 22 01:28:33.988297 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:33.988251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf" event={"ID":"f16a3a91-2813-47af-9187-51149962771e","Type":"ContainerStarted","Data":"8e03d45ba9d4348d728c4d9ae4b7cafd2c85d70ab42d0f8dc2ff6def3c3aa3c4"}
Jul 22 01:28:33.988693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:33.988321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf" event={"ID":"f16a3a91-2813-47af-9187-51149962771e","Type":"ContainerStarted","Data":"f64edb5e8c8d7531019b15975516e8b1ce4f37048e24999d05d4165fef1f5537"}
Jul 22 01:28:34.004360 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:34.004312    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-rz8lf" podStartSLOduration=38.85648614 podStartE2EDuration="41.004294947s" totalImagesPullingTime="2.147808807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:34.004059271 +0000 UTC m=+60.833996092" watchObservedRunningTime="2026-07-22 01:28:34.004294947 +0000 UTC m=+60.834231760"
Jul 22 01:28:37.691357 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:37.691318    2559 scope.go:117] "RemoveContainer" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"
Jul 22 01:28:38.003472 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.003397    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:28:38.003831 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.003813    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/1.log"
Jul 22 01:28:38.003876 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.003850    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a93aec7-dc61-449b-9176-dc5afc29324e" containerID="7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62" exitCode=255
Jul 22 01:28:38.003946 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.003925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" event={"ID":"8a93aec7-dc61-449b-9176-dc5afc29324e","Type":"ContainerDied","Data":"7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62"}
Jul 22 01:28:38.003997 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.003987    2559 scope.go:117] "RemoveContainer" containerID="4e61a3f4d5a84c83deb9650175c3677fd01b6caa6a5d6752d6c9228bfd6ea874"
Jul 22 01:28:38.004364 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.004340    2559 scope.go:117] "RemoveContainer" containerID="7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62"
Jul 22 01:28:38.004543 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:38.004520    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:38.347800 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.347707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:38.350370 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.350346    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 01:28:38.360848 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.360817    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e870cc0-e8ba-4c77-bbd9-bd0abca000e5-original-pull-secret\") pod \"global-pull-secret-syncer-9znw5\" (UID: \"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5\") " pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:38.448884 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.448843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:38.451597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.451572    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 01:28:38.461573 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.461548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/990ff928-53f5-4276-a484-7ca62515f310-metrics-certs\") pod \"network-metrics-daemon-l2vqz\" (UID: \"990ff928-53f5-4276-a484-7ca62515f310\") " pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:38.549483 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.549446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:38.552144 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.552097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjgxf\" (UniqueName: \"kubernetes.io/projected/52d6009f-bc8c-4e0c-ac3f-80e033a0332b-kube-api-access-kjgxf\") pod \"network-check-target-mhqbm\" (UID: \"52d6009f-bc8c-4e0c-ac3f-80e033a0332b\") " pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:38.606584 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.606557    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9znw5"
Jul 22 01:28:38.613844 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.613818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l47xs\""
Jul 22 01:28:38.622660 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.622636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l2vqz"
Jul 22 01:28:38.625194 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.625178    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vpdlh\""
Jul 22 01:28:38.633726 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.633704    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:38.803328 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.803218    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9znw5"]
Jul 22 01:28:38.807927 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:38.807890    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e870cc0_e8ba_4c77_bbd9_bd0abca000e5.slice/crio-1ad2e22f36504f46406c2a2c9fc9f344a0386df731dbf792401bc0312b2aa8cb WatchSource:0}: Error finding container 1ad2e22f36504f46406c2a2c9fc9f344a0386df731dbf792401bc0312b2aa8cb: Status 404 returned error can't find the container with id 1ad2e22f36504f46406c2a2c9fc9f344a0386df731dbf792401bc0312b2aa8cb
Jul 22 01:28:38.840044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.840007    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l2vqz"]
Jul 22 01:28:38.843098 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:38.843060    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990ff928_53f5_4276_a484_7ca62515f310.slice/crio-d332a80bf8f3e4f00d7f020a0d3616436e3d8b849e893d5fc58bd4fe5e3c500b WatchSource:0}: Error finding container d332a80bf8f3e4f00d7f020a0d3616436e3d8b849e893d5fc58bd4fe5e3c500b: Status 404 returned error can't find the container with id d332a80bf8f3e4f00d7f020a0d3616436e3d8b849e893d5fc58bd4fe5e3c500b
Jul 22 01:28:38.860752 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:38.860690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mhqbm"]
Jul 22 01:28:38.863616 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:38.863574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d6009f_bc8c_4e0c_ac3f_80e033a0332b.slice/crio-06e7bcf241075c76f608d95cf7804708614080fdee06be8c9c647cec14c737d9 WatchSource:0}: Error finding container 06e7bcf241075c76f608d95cf7804708614080fdee06be8c9c647cec14c737d9: Status 404 returned error can't find the container with id 06e7bcf241075c76f608d95cf7804708614080fdee06be8c9c647cec14c737d9
Jul 22 01:28:39.008650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.008604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhqbm" event={"ID":"52d6009f-bc8c-4e0c-ac3f-80e033a0332b","Type":"ContainerStarted","Data":"d4c2d67a4e9ef96f9148013d495fdc8a0b9570b130375f90cb70e08fca89407f"}
Jul 22 01:28:39.008650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.008666    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mhqbm" event={"ID":"52d6009f-bc8c-4e0c-ac3f-80e033a0332b","Type":"ContainerStarted","Data":"06e7bcf241075c76f608d95cf7804708614080fdee06be8c9c647cec14c737d9"}
Jul 22 01:28:39.008889 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.008726    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:28:39.010077 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.010051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:28:39.011284 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.011261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9znw5" event={"ID":"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5","Type":"ContainerStarted","Data":"1ad2e22f36504f46406c2a2c9fc9f344a0386df731dbf792401bc0312b2aa8cb"}
Jul 22 01:28:39.012363 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.012340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2vqz" event={"ID":"990ff928-53f5-4276-a484-7ca62515f310","Type":"ContainerStarted","Data":"d332a80bf8f3e4f00d7f020a0d3616436e3d8b849e893d5fc58bd4fe5e3c500b"}
Jul 22 01:28:39.024813 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.024766    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mhqbm" podStartSLOduration=65.024752652 podStartE2EDuration="1m5.024752652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:39.024208856 +0000 UTC m=+65.854145668" watchObservedRunningTime="2026-07-22 01:28:39.024752652 +0000 UTC m=+65.854689456"
Jul 22 01:28:39.660403 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.660362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:39.660604 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.660411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:39.661010 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.660982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:39.663995 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.663963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g64jd\" (UID: \"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3\") " pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:39.779577 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.779544    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gdbrc\""
Jul 22 01:28:39.788480 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.788446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g64jd"
Jul 22 01:28:39.889357 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.889326    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jvcvc"
Jul 22 01:28:39.963840 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:39.963759    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g64jd"]
Jul 22 01:28:40.225561 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:40.225476    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e48aff0_ca3b_47fe_a22b_057b5dc3a5d3.slice/crio-32014c6b3813698bd82f3fe016fed2cf62ae1a0ba96a17047ffa02e21a187094 WatchSource:0}: Error finding container 32014c6b3813698bd82f3fe016fed2cf62ae1a0ba96a17047ffa02e21a187094: Status 404 returned error can't find the container with id 32014c6b3813698bd82f3fe016fed2cf62ae1a0ba96a17047ffa02e21a187094
Jul 22 01:28:41.021995 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:41.021957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g64jd" event={"ID":"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3","Type":"ContainerStarted","Data":"32014c6b3813698bd82f3fe016fed2cf62ae1a0ba96a17047ffa02e21a187094"}
Jul 22 01:28:41.024084 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:41.024051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2vqz" event={"ID":"990ff928-53f5-4276-a484-7ca62515f310","Type":"ContainerStarted","Data":"4c8aec117c8c3bd471c9c62f6cfaa1553e4f08584690d8c60931d3942e0edec7"}
Jul 22 01:28:41.024239 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:41.024107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l2vqz" event={"ID":"990ff928-53f5-4276-a484-7ca62515f310","Type":"ContainerStarted","Data":"9a4942d8f9ae4d01e6eaacc2e8ee27ba5b04e0163fcd287cb368cb133aab7fb2"}
Jul 22 01:28:41.041372 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:41.041318    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l2vqz" podStartSLOduration=65.310230735 podStartE2EDuration="1m7.041298789s" totalImagesPullingTime="1.731068054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:41.040345809 +0000 UTC m=+67.870282646" watchObservedRunningTime="2026-07-22 01:28:41.041298789 +0000 UTC m=+67.871235596"
Jul 22 01:28:45.351340 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:45.351304    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:45.351853 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:45.351764    2559 scope.go:117] "RemoveContainer" containerID="7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62"
Jul 22 01:28:45.351916 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:45.351891    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:28:45.351987 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:45.351958    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:46.046186 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.046156    2559 scope.go:117] "RemoveContainer" containerID="7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62"
Jul 22 01:28:46.046378 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:28:46.046312    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-mnkqw_openshift-console-operator(8a93aec7-dc61-449b-9176-dc5afc29324e)\"" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podUID="8a93aec7-dc61-449b-9176-dc5afc29324e"
Jul 22 01:28:46.935097 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:46.935097 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:46.935639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935117    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:46.935639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:46.935639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935193    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:46.935639 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:46.935926 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.935866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-service-ca-bundle\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:46.937991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.937951    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"image-registry-5dd8d8794-gtq6v\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") " pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:46.937991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.937975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3745794e-a157-4e3d-9397-b1f3d1bd6cbe-metrics-tls\") pod \"dns-default-4prq4\" (UID: \"3745794e-a157-4e3d-9397-b1f3d1bd6cbe\") " pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:46.938512 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.938488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20f2093a-0134-4aef-af55-54802185ad5e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-8p45n\" (UID: \"20f2093a-0134-4aef-af55-54802185ad5e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:46.938593 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.938551    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1acdcfd5-e001-49df-9493-7e123d67686d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qkv6z\" (UID: \"1acdcfd5-e001-49df-9493-7e123d67686d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:46.938683 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:46.938665    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/326680c8-a142-4a9f-8acf-d3e5aa48ae5c-metrics-certs\") pod \"router-default-c5485bddb-2hssz\" (UID: \"326680c8-a142-4a9f-8acf-d3e5aa48ae5c\") " pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:47.055197 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.055163    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4rgl4\""
Jul 22 01:28:47.063374 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.063342    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:47.086616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.086579    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjdcf\""
Jul 22 01:28:47.094838 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.094815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4prq4"
Jul 22 01:28:47.108206 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.108172    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5mlpp\""
Jul 22 01:28:47.115409 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.115381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"
Jul 22 01:28:47.127387 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.127360    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wb7lj\""
Jul 22 01:28:47.134737 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.134716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"
Jul 22 01:28:47.138367 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.138349    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-46xr2\""
Jul 22 01:28:47.146385 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.146357    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:47.530936 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.530903    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4prq4"]
Jul 22 01:28:47.682647 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:47.682605    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3745794e_a157_4e3d_9397_b1f3d1bd6cbe.slice/crio-db575e0a860dda3ad6df7164eb5336a74d4876c527fe74617e2d1b089df90ec8 WatchSource:0}: Error finding container db575e0a860dda3ad6df7164eb5336a74d4876c527fe74617e2d1b089df90ec8: Status 404 returned error can't find the container with id db575e0a860dda3ad6df7164eb5336a74d4876c527fe74617e2d1b089df90ec8
Jul 22 01:28:47.750597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.750569    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z"]
Jul 22 01:28:47.753937 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.753910    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c5485bddb-2hssz"]
Jul 22 01:28:47.755593 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:47.755561    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acdcfd5_e001_49df_9493_7e123d67686d.slice/crio-d0b4dfa5053173060a1c593efc64561fc7f66ce34845abe7437840f9d9a4fde2 WatchSource:0}: Error finding container d0b4dfa5053173060a1c593efc64561fc7f66ce34845abe7437840f9d9a4fde2: Status 404 returned error can't find the container with id d0b4dfa5053173060a1c593efc64561fc7f66ce34845abe7437840f9d9a4fde2
Jul 22 01:28:47.757190 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:47.757054    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326680c8_a142_4a9f_8acf_d3e5aa48ae5c.slice/crio-6411a872e2928ee192ecfd4dbb581590c61b2f334c54f90c0cb83a4ca14276cf WatchSource:0}: Error finding container 6411a872e2928ee192ecfd4dbb581590c61b2f334c54f90c0cb83a4ca14276cf: Status 404 returned error can't find the container with id 6411a872e2928ee192ecfd4dbb581590c61b2f334c54f90c0cb83a4ca14276cf
Jul 22 01:28:47.787500 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.787466    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n"]
Jul 22 01:28:47.790608 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:47.790507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:28:47.791370 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:47.791342    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f2093a_0134_4aef_af55_54802185ad5e.slice/crio-53e7f1557941529870edb3cc8d1a0b6071fab4e4d998be2032b253461e1d08b9 WatchSource:0}: Error finding container 53e7f1557941529870edb3cc8d1a0b6071fab4e4d998be2032b253461e1d08b9: Status 404 returned error can't find the container with id 53e7f1557941529870edb3cc8d1a0b6071fab4e4d998be2032b253461e1d08b9
Jul 22 01:28:47.793350 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:47.793317    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb60c39_808d_4a0e_8759_ca89872a662c.slice/crio-f5de1f6873acf6ec0ede62dc136bc6a59216643c5c68685aa48890e6d4296f5e WatchSource:0}: Error finding container f5de1f6873acf6ec0ede62dc136bc6a59216643c5c68685aa48890e6d4296f5e: Status 404 returned error can't find the container with id f5de1f6873acf6ec0ede62dc136bc6a59216643c5c68685aa48890e6d4296f5e
Jul 22 01:28:48.055093 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.055007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z" event={"ID":"1acdcfd5-e001-49df-9493-7e123d67686d","Type":"ContainerStarted","Data":"d0b4dfa5053173060a1c593efc64561fc7f66ce34845abe7437840f9d9a4fde2"}
Jul 22 01:28:48.056793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.056764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" event={"ID":"3cb60c39-808d-4a0e-8759-ca89872a662c","Type":"ContainerStarted","Data":"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"}
Jul 22 01:28:48.057041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.056807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" event={"ID":"3cb60c39-808d-4a0e-8759-ca89872a662c","Type":"ContainerStarted","Data":"f5de1f6873acf6ec0ede62dc136bc6a59216643c5c68685aa48890e6d4296f5e"}
Jul 22 01:28:48.057041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.056874    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:28:48.058461 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.058435    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9znw5" event={"ID":"8e870cc0-e8ba-4c77-bbd9-bd0abca000e5","Type":"ContainerStarted","Data":"440b36088f6ef67f3f17beb2b75edfc91e2b0e23a13c0537ee2f865a5480f55a"}
Jul 22 01:28:48.059604 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.059584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n" event={"ID":"20f2093a-0134-4aef-af55-54802185ad5e","Type":"ContainerStarted","Data":"53e7f1557941529870edb3cc8d1a0b6071fab4e4d998be2032b253461e1d08b9"}
Jul 22 01:28:48.060707 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.060680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4prq4" event={"ID":"3745794e-a157-4e3d-9397-b1f3d1bd6cbe","Type":"ContainerStarted","Data":"db575e0a860dda3ad6df7164eb5336a74d4876c527fe74617e2d1b089df90ec8"}
Jul 22 01:28:48.062499 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.062473    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c5485bddb-2hssz" event={"ID":"326680c8-a142-4a9f-8acf-d3e5aa48ae5c","Type":"ContainerStarted","Data":"27453515cd3bdc451c679a0c423dcefc7cce5d0ec47ce1da651d88e954eb3520"}
Jul 22 01:28:48.062620 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.062516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c5485bddb-2hssz" event={"ID":"326680c8-a142-4a9f-8acf-d3e5aa48ae5c","Type":"ContainerStarted","Data":"6411a872e2928ee192ecfd4dbb581590c61b2f334c54f90c0cb83a4ca14276cf"}
Jul 22 01:28:48.064155 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.064107    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g64jd" event={"ID":"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3","Type":"ContainerStarted","Data":"17025100bdfaa6e0b774a7f907a3df783c6047ee1e1cf5525fafbc77ca55893c"}
Jul 22 01:28:48.078279 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.078229    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" podStartSLOduration=57.078215266 podStartE2EDuration="57.078215266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:48.076290846 +0000 UTC m=+74.906227682" watchObservedRunningTime="2026-07-22 01:28:48.078215266 +0000 UTC m=+74.908152082"
Jul 22 01:28:48.091773 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.091717    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9znw5" podStartSLOduration=65.57649367 podStartE2EDuration="1m14.091702213s" totalImagesPullingTime="8.515208543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:48.091437201 +0000 UTC m=+74.921374013" watchObservedRunningTime="2026-07-22 01:28:48.091702213 +0000 UTC m=+74.921639024"
Jul 22 01:28:48.116884 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.116831    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c5485bddb-2hssz" podStartSLOduration=55.11681667 podStartE2EDuration="55.11681667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:48.115515269 +0000 UTC m=+74.945452128" watchObservedRunningTime="2026-07-22 01:28:48.11681667 +0000 UTC m=+74.946753480"
Jul 22 01:28:48.146854 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.146822    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:48.149674 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.149637    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:48.745299 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.744197    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"]
Jul 22 01:28:48.747347 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.747319    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"]
Jul 22 01:28:48.748440 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.748420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.750453 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.750412    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"]
Jul 22 01:28:48.751205 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.751181    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 01:28:48.751529 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.751510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.752057 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.752037    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 01:28:48.753423 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.753400    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 01:28:48.754032 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.754010    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 01:28:48.754269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.754250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5d7gz\""
Jul 22 01:28:48.754535 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.754516    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 22 01:28:48.756004 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.755977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-klusterlet-config\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.756103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756022    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5zsp\" (UniqueName: \"kubernetes.io/projected/d8020712-2df4-47c0-b402-c7c4a3b87e2e-kube-api-access-v5zsp\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.756103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756030    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"]
Jul 22 01:28:48.756103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756071    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmst6\" (UniqueName: \"kubernetes.io/projected/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-kube-api-access-jmst6\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.758540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-tmp\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.758540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.758540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.756161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8020712-2df4-47c0-b402-c7c4a3b87e2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.758540 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.757055    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"]
Jul 22 01:28:48.762963 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.762610    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"]
Jul 22 01:28:48.765335 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.765310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 01:28:48.765454 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.765362    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 01:28:48.765516 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.765311    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 01:28:48.770704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.770673    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 01:28:48.857210 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf7st\" (UniqueName: \"kubernetes.io/projected/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-kube-api-access-hf7st\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.857407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.857407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmst6\" (UniqueName: \"kubernetes.io/projected/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-kube-api-access-jmst6\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.857407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-tmp\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.857407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8020712-2df4-47c0-b402-c7c4a3b87e2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.857407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.857677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.857677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-klusterlet-config\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.857677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5zsp\" (UniqueName: \"kubernetes.io/projected/d8020712-2df4-47c0-b402-c7c4a3b87e2e-kube-api-access-v5zsp\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.857677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857514    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.857677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.857537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.858178 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.858153    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-tmp\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.861993 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.861941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8020712-2df4-47c0-b402-c7c4a3b87e2e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.864367 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.864340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-klusterlet-config\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.876626 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.876565    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmst6\" (UniqueName: \"kubernetes.io/projected/59079ca1-6fc1-43bc-9d6f-11ad088c66a0-kube-api-access-jmst6\") pod \"klusterlet-addon-workmgr-995bcb89d-9rmdz\" (UID: \"59079ca1-6fc1-43bc-9d6f-11ad088c66a0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:48.890665 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.890625    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5zsp\" (UniqueName: \"kubernetes.io/projected/d8020712-2df4-47c0-b402-c7c4a3b87e2e-kube-api-access-v5zsp\") pod \"managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl\" (UID: \"d8020712-2df4-47c0-b402-c7c4a3b87e2e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:48.958173 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.958345 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.958345 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.958345 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.958345 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf7st\" (UniqueName: \"kubernetes.io/projected/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-kube-api-access-hf7st\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.958589 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.958351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.960063 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.959920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.964892 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.964856    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.966071 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.966012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.968568 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.968510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf7st\" (UniqueName: \"kubernetes.io/projected/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-kube-api-access-hf7st\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.971195 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.971120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:48.978858 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:48.978774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/30208bb0-2a41-45a3-b0a3-0ef99b1c96bd-ca\") pod \"cluster-proxy-proxy-agent-7cbb44d8d9-45h6c\" (UID: \"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:49.070808 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.070717    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:49.072091 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.072067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:28:49.072812 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.072597    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c5485bddb-2hssz"
Jul 22 01:28:49.087947 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.087695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"
Jul 22 01:28:49.097439 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.096973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"
Jul 22 01:28:49.535911 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.535885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"]
Jul 22 01:28:49.540076 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:49.539965    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59079ca1_6fc1_43bc_9d6f_11ad088c66a0.slice/crio-79a305a67f47efb89f9e1f1de51fbc8ba4584a59a8078f9b9c9e3a85636b0b0c WatchSource:0}: Error finding container 79a305a67f47efb89f9e1f1de51fbc8ba4584a59a8078f9b9c9e3a85636b0b0c: Status 404 returned error can't find the container with id 79a305a67f47efb89f9e1f1de51fbc8ba4584a59a8078f9b9c9e3a85636b0b0c
Jul 22 01:28:49.769580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.769528    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl"]
Jul 22 01:28:49.772684 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:49.772640    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8020712_2df4_47c0_b402_c7c4a3b87e2e.slice/crio-bec6dfb176adbc07dcdd108c2b5ef0dc266b89e3fe29150414c48cb3d38807a9 WatchSource:0}: Error finding container bec6dfb176adbc07dcdd108c2b5ef0dc266b89e3fe29150414c48cb3d38807a9: Status 404 returned error can't find the container with id bec6dfb176adbc07dcdd108c2b5ef0dc266b89e3fe29150414c48cb3d38807a9
Jul 22 01:28:49.806678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:49.806475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c"]
Jul 22 01:28:49.810165 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:28:49.810111    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30208bb0_2a41_45a3_b0a3_0ef99b1c96bd.slice/crio-c9c40f565408f0746a1781fa63dcae8870e94fc84948e704dbd792a0c9b9e98d WatchSource:0}: Error finding container c9c40f565408f0746a1781fa63dcae8870e94fc84948e704dbd792a0c9b9e98d: Status 404 returned error can't find the container with id c9c40f565408f0746a1781fa63dcae8870e94fc84948e704dbd792a0c9b9e98d
Jul 22 01:28:50.076114 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:50.076032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl" event={"ID":"d8020712-2df4-47c0-b402-c7c4a3b87e2e","Type":"ContainerStarted","Data":"bec6dfb176adbc07dcdd108c2b5ef0dc266b89e3fe29150414c48cb3d38807a9"}
Jul 22 01:28:50.078263 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:50.078233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c" event={"ID":"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd","Type":"ContainerStarted","Data":"c9c40f565408f0746a1781fa63dcae8870e94fc84948e704dbd792a0c9b9e98d"}
Jul 22 01:28:50.080660 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:50.080590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z" event={"ID":"1acdcfd5-e001-49df-9493-7e123d67686d","Type":"ContainerStarted","Data":"c09de167fd7824ec88c20a8a083557cb9255fd7cce571b5d57c6cb292d119690"}
Jul 22 01:28:50.082403 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:50.082343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz" event={"ID":"59079ca1-6fc1-43bc-9d6f-11ad088c66a0","Type":"ContainerStarted","Data":"79a305a67f47efb89f9e1f1de51fbc8ba4584a59a8078f9b9c9e3a85636b0b0c"}
Jul 22 01:28:50.101400 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:50.101346    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qkv6z" podStartSLOduration=55.502055553 podStartE2EDuration="57.10132885s" totalImagesPullingTime="1.599273297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:50.100388489 +0000 UTC m=+76.930325300" watchObservedRunningTime="2026-07-22 01:28:50.10132885 +0000 UTC m=+76.931265660"
Jul 22 01:28:54.107954 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:54.107852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g64jd" event={"ID":"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3","Type":"ContainerStarted","Data":"3942d0b5fffcdfbff67865a9c4c8534b4720f1d482c3260fa7f76176ce10b10b"}
Jul 22 01:28:54.114741 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:54.111749    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n" event={"ID":"20f2093a-0134-4aef-af55-54802185ad5e","Type":"ContainerStarted","Data":"9618167c27197f797aa7f38329e35f1b4d673c98e7d137d3c376b27eff54b810"}
Jul 22 01:28:54.117154 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:54.115416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4prq4" event={"ID":"3745794e-a157-4e3d-9397-b1f3d1bd6cbe","Type":"ContainerStarted","Data":"31ad9d2a2fad7c77d658058da68689ac9cfb7714259867681328b6a78139f114"}
Jul 22 01:28:54.140602 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:54.139471    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-8p45n" podStartSLOduration=55.420633345 podStartE2EDuration="1m1.13945601s" totalImagesPullingTime="5.718822665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:28:54.139085802 +0000 UTC m=+80.969022614" watchObservedRunningTime="2026-07-22 01:28:54.13945601 +0000 UTC m=+80.969392857"
Jul 22 01:28:58.690964 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:28:58.690928    2559 scope.go:117] "RemoveContainer" containerID="7871ec7afab520144bb8939b10f5b2ab08c3901fcfa5ac7608073c2fa4e95e62"
Jul 22 01:29:00.148882 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.148779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4prq4" event={"ID":"3745794e-a157-4e3d-9397-b1f3d1bd6cbe","Type":"ContainerStarted","Data":"851c1f1c981c1a2d2b43882d00090aaae0e04f96e724d6e37027c638d638c034"}
Jul 22 01:29:00.149363 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.148888    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4prq4"
Jul 22 01:29:00.150477 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.150446    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl" event={"ID":"d8020712-2df4-47c0-b402-c7c4a3b87e2e","Type":"ContainerStarted","Data":"140902aa243a4383320127b3dafd9c3f4d0988a7acd98dc0f2390786f783dac4"}
Jul 22 01:29:00.152518 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.152494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g64jd" event={"ID":"9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3","Type":"ContainerStarted","Data":"1091c0ed0a9aac4f0a676d1c8cb21c2a88e5e237185847cc8509e31bee4d21a6"}
Jul 22 01:29:00.154560 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.154534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c" event={"ID":"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd","Type":"ContainerStarted","Data":"e55db43639437efe4fe2b0e95f7bbc65425fae7fae463915cc9adb07e532a5e1"}
Jul 22 01:29:00.154677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.154570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c" event={"ID":"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd","Type":"ContainerStarted","Data":"b12624f8abc3db770794bd2729748930094406138a3c41de9f9166a76333211d"}
Jul 22 01:29:00.154677 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.154585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c" event={"ID":"30208bb0-2a41-45a3-b0a3-0ef99b1c96bd","Type":"ContainerStarted","Data":"ee8714d9a11946316778cd23e8b88860e32102bb3c52862d7ba9ff976b280ebf"}
Jul 22 01:29:00.156247 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.156230    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:29:00.156332 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.156315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" event={"ID":"8a93aec7-dc61-449b-9176-dc5afc29324e","Type":"ContainerStarted","Data":"23eef58cd91489c6e0eb3e3b62d5a2fd263adf7c12acdeeac8fcbf7f4f9acf3f"}
Jul 22 01:29:00.156597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.156573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:29:00.157881 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.157854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz" event={"ID":"59079ca1-6fc1-43bc-9d6f-11ad088c66a0","Type":"ContainerStarted","Data":"c9feea1c75c2cb6790b43e4aac6bcb2a41a3dfa2160d080408db5ab767bff310"}
Jul 22 01:29:00.157977 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.157896    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:29:00.159234 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.159215    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz"
Jul 22 01:29:00.161575 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.161551    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw"
Jul 22 01:29:00.175748 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.175702    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4prq4" podStartSLOduration=40.373849993 podStartE2EDuration="46.17568888s" totalImagesPullingTime="5.801838887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.173944885 +0000 UTC m=+87.003881696" watchObservedRunningTime="2026-07-22 01:29:00.17568888 +0000 UTC m=+87.005625691"
Jul 22 01:29:00.192401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.192354    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86dd6b9f78-ff7bl" podStartSLOduration=2.317825007 podStartE2EDuration="12.19233844s" totalImagesPullingTime="9.874513433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.190467401 +0000 UTC m=+87.020404212" watchObservedRunningTime="2026-07-22 01:29:00.19233844 +0000 UTC m=+87.022275258"
Jul 22 01:29:00.211956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.211903    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cbb44d8d9-45h6c" podStartSLOduration=2.376349755 podStartE2EDuration="12.211888042s" totalImagesPullingTime="9.835538287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.20994766 +0000 UTC m=+87.039884470" watchObservedRunningTime="2026-07-22 01:29:00.211888042 +0000 UTC m=+87.041824844"
Jul 22 01:29:00.228984 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.228915    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g64jd" podStartSLOduration=18.027317706 podStartE2EDuration="37.228895006s" totalImagesPullingTime="19.2015773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 01:28:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.227708104 +0000 UTC m=+87.057644942" watchObservedRunningTime="2026-07-22 01:29:00.228895006 +0000 UTC m=+87.058831818"
Jul 22 01:29:00.255923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.255860    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-mnkqw" podStartSLOduration=60.591197506 podStartE2EDuration="1m7.255836603s" totalImagesPullingTime="6.664639097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.253400028 +0000 UTC m=+87.083336841" watchObservedRunningTime="2026-07-22 01:29:00.255836603 +0000 UTC m=+87.085773415"
Jul 22 01:29:00.276061 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:00.276002    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-995bcb89d-9rmdz" podStartSLOduration=2.141910732 podStartE2EDuration="12.27598361s" totalImagesPullingTime="10.134072878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:00.27528741 +0000 UTC m=+87.105224222" watchObservedRunningTime="2026-07-22 01:29:00.27598361 +0000 UTC m=+87.105920420"
Jul 22 01:29:04.166906 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:04.166875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4prq4"
Jul 22 01:29:07.067905 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:07.067867    2559 patch_prober.go:28] interesting pod/image-registry-5dd8d8794-gtq6v container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 01:29:07.068318 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:07.067925    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 01:29:08.578953 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.578908    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-htb9m"]
Jul 22 01:29:08.584140 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.584101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.586705 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.586679    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 01:29:08.586863 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.586808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 01:29:08.586925 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.586905    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 01:29:08.587351 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.587334    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fvrqr\""
Jul 22 01:29:08.587412 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.587335    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 01:29:08.656089 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-sys\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-textfile\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656537 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-wtmp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656537 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxnxp\" (UniqueName: \"kubernetes.io/projected/846298ec-f9bf-43b3-af1d-656b9492c81d-kube-api-access-gxnxp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656537 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-metrics-client-ca\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.656537 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.656470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-root\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.757968 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.757925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxnxp\" (UniqueName: \"kubernetes.io/projected/846298ec-f9bf-43b3-af1d-656b9492c81d-kube-api-access-gxnxp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.757968 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.757972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-metrics-client-ca\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-root\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-sys\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758157    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758205    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-root\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758529 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-textfile\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758529 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-wtmp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758529 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:29:08.758329    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 01:29:08.758529 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:29:08.758460    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls podName:846298ec-f9bf-43b3-af1d-656b9492c81d nodeName:}" failed. No retries permitted until 2026-07-22 01:29:09.25843981 +0000 UTC m=+96.088376602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls") pod "node-exporter-htb9m" (UID: "846298ec-f9bf-43b3-af1d-656b9492c81d") : secret "node-exporter-tls" not found
Jul 22 01:29:08.758744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758569    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-wtmp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-metrics-client-ca\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-textfile\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/846298ec-f9bf-43b3-af1d-656b9492c81d-sys\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.758954 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.758771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-accelerators-collector-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.761006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.760984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:08.766391 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:08.766364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxnxp\" (UniqueName: \"kubernetes.io/projected/846298ec-f9bf-43b3-af1d-656b9492c81d-kube-api-access-gxnxp\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:09.074725 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:09.074696    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:29:09.264157 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:09.264099    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:09.266666 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:09.266635    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/846298ec-f9bf-43b3-af1d-656b9492c81d-node-exporter-tls\") pod \"node-exporter-htb9m\" (UID: \"846298ec-f9bf-43b3-af1d-656b9492c81d\") " pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:09.496102 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:09.496064    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htb9m"
Jul 22 01:29:09.510290 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:29:09.510252    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846298ec_f9bf_43b3_af1d_656b9492c81d.slice/crio-f3c91a5e1435efd1b8d6305f519382a8bbe0dde8277ff5722310cac1020433c3 WatchSource:0}: Error finding container f3c91a5e1435efd1b8d6305f519382a8bbe0dde8277ff5722310cac1020433c3: Status 404 returned error can't find the container with id f3c91a5e1435efd1b8d6305f519382a8bbe0dde8277ff5722310cac1020433c3
Jul 22 01:29:10.019636 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:10.019598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mhqbm"
Jul 22 01:29:10.201731 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:10.201689    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htb9m" event={"ID":"846298ec-f9bf-43b3-af1d-656b9492c81d","Type":"ContainerStarted","Data":"f3c91a5e1435efd1b8d6305f519382a8bbe0dde8277ff5722310cac1020433c3"}
Jul 22 01:29:11.207309 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:11.207277    2559 generic.go:356] "Generic (PLEG): container finished" podID="846298ec-f9bf-43b3-af1d-656b9492c81d" containerID="c3ba606dc5de41720fe56dc7312b3c3cc2d1100a3f4e783f89947974b89b0974" exitCode=0
Jul 22 01:29:11.207705 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:11.207376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htb9m" event={"ID":"846298ec-f9bf-43b3-af1d-656b9492c81d","Type":"ContainerDied","Data":"c3ba606dc5de41720fe56dc7312b3c3cc2d1100a3f4e783f89947974b89b0974"}
Jul 22 01:29:12.213864 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:12.213827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htb9m" event={"ID":"846298ec-f9bf-43b3-af1d-656b9492c81d","Type":"ContainerStarted","Data":"f91d0a165a40ba5de6bda54f36201d1d5d3c3b4a4e12181775de5afe3a0c417e"}
Jul 22 01:29:12.214409 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:12.213892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htb9m" event={"ID":"846298ec-f9bf-43b3-af1d-656b9492c81d","Type":"ContainerStarted","Data":"fef2086693210f719c9bc8fa2b78ab1ceb6ca2c9bdf605d50b87040d419b937e"}
Jul 22 01:29:12.234490 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:12.234435    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-htb9m" podStartSLOduration=2.682420683 podStartE2EDuration="4.234420678s" totalImagesPullingTime="1.478582476s" totalInitContainerRuntime="73.417519ms" isStatefulPod=true podCreationTimestamp="2026-07-22 01:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:29:12.233120955 +0000 UTC m=+99.063057766" watchObservedRunningTime="2026-07-22 01:29:12.234420678 +0000 UTC m=+99.064357489"
Jul 22 01:29:15.402233 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:15.402188    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:29:38.317944 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.317907    2559 generic.go:356] "Generic (PLEG): container finished" podID="40ad6d33-620d-429e-a413-62c9c9203393" containerID="a1e5199dcb197677bc259aa651d53d298484ea9a8379fa61c9c2155a923452ea" exitCode=0
Jul 22 01:29:38.318445 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.317973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm" event={"ID":"40ad6d33-620d-429e-a413-62c9c9203393","Type":"ContainerDied","Data":"a1e5199dcb197677bc259aa651d53d298484ea9a8379fa61c9c2155a923452ea"}
Jul 22 01:29:38.318445 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.318345    2559 scope.go:117] "RemoveContainer" containerID="a1e5199dcb197677bc259aa651d53d298484ea9a8379fa61c9c2155a923452ea"
Jul 22 01:29:38.319759 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.319683    2559 generic.go:356] "Generic (PLEG): container finished" podID="cb065bf4-7e56-4ef0-bf99-93bd1ab260e8" containerID="2555d558f74d788d5b8808df1159f808bdd02fbe0c4faf37a059e17d34ca2259" exitCode=0
Jul 22 01:29:38.319759 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.319729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm" event={"ID":"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8","Type":"ContainerDied","Data":"2555d558f74d788d5b8808df1159f808bdd02fbe0c4faf37a059e17d34ca2259"}
Jul 22 01:29:38.320033 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:38.320016    2559 scope.go:117] "RemoveContainer" containerID="2555d558f74d788d5b8808df1159f808bdd02fbe0c4faf37a059e17d34ca2259"
Jul 22 01:29:39.325815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:39.325775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-gcbcm" event={"ID":"40ad6d33-620d-429e-a413-62c9c9203393","Type":"ContainerStarted","Data":"e9518177c2e3d93683dd41b8d675325e39be94dcdcce69e8e90e96cc17231a68"}
Jul 22 01:29:39.332321 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:39.332290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-xnsjm" event={"ID":"cb065bf4-7e56-4ef0-bf99-93bd1ab260e8","Type":"ContainerStarted","Data":"2ba1e455926b7138d5a49a4c37a393690c3d743e21db102b6b34ee501c34dbe8"}
Jul 22 01:29:40.423616 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.423559    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerName="registry" containerID="cri-o://e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d" gracePeriod=30
Jul 22 01:29:40.674240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.674179    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:29:40.743577 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743540    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.743577 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzd72\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.743818 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.743818 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743635    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.743818 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743753    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.743818 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.744009 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.744009 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.743893    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca\") pod \"3cb60c39-808d-4a0e-8759-ca89872a662c\" (UID: \"3cb60c39-808d-4a0e-8759-ca89872a662c\") "
Jul 22 01:29:40.744170 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.744108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:29:40.744756 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.744713    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:29:40.746430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.746400    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:29:40.746530 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.746492    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:29:40.746602 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.746568    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72" (OuterVolumeSpecName: "kube-api-access-xzd72") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "kube-api-access-xzd72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:29:40.746866 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.746816    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:29:40.746947 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.746875    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:29:40.752887 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.752852    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3cb60c39-808d-4a0e-8759-ca89872a662c" (UID: "3cb60c39-808d-4a0e-8759-ca89872a662c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 01:29:40.845054 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845017    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-installation-pull-secrets\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845054 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845049    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzd72\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-kube-api-access-xzd72\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845054 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845060    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-certificates\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845069    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-bound-sa-token\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845078    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3cb60c39-808d-4a0e-8759-ca89872a662c-registry-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845087    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3cb60c39-808d-4a0e-8759-ca89872a662c-image-registry-private-configuration\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845096    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3cb60c39-808d-4a0e-8759-ca89872a662c-ca-trust-extracted\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:40.845315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:40.845103    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3cb60c39-808d-4a0e-8759-ca89872a662c-trusted-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:29:41.341697 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.341663    2559 generic.go:356] "Generic (PLEG): container finished" podID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerID="e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d" exitCode=0
Jul 22 01:29:41.341894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.341708    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v"
Jul 22 01:29:41.341894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.341755    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" event={"ID":"3cb60c39-808d-4a0e-8759-ca89872a662c","Type":"ContainerDied","Data":"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"}
Jul 22 01:29:41.341894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.341807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dd8d8794-gtq6v" event={"ID":"3cb60c39-808d-4a0e-8759-ca89872a662c","Type":"ContainerDied","Data":"f5de1f6873acf6ec0ede62dc136bc6a59216643c5c68685aa48890e6d4296f5e"}
Jul 22 01:29:41.341894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.341827    2559 scope.go:117] "RemoveContainer" containerID="e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"
Jul 22 01:29:41.350991 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.350964    2559 scope.go:117] "RemoveContainer" containerID="e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"
Jul 22 01:29:41.351280 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:29:41.351258    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d\": container with ID starting with e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d not found: ID does not exist" containerID="e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"
Jul 22 01:29:41.351339 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.351290    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d"} err="failed to get container status \"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d\": rpc error: code = NotFound desc = could not find container \"e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d\": container with ID starting with e9edb6f01a252936c596f9dee8f29b72fdf5241f6701f998206c7cf843494d8d not found: ID does not exist"
Jul 22 01:29:41.363590 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.363565    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:29:41.367436 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.367414    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dd8d8794-gtq6v"]
Jul 22 01:29:41.695193 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:41.695160    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" path="/var/lib/kubelet/pods/3cb60c39-808d-4a0e-8759-ca89872a662c/volumes"
Jul 22 01:29:44.355590 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:44.355553    2559 generic.go:356] "Generic (PLEG): container finished" podID="c9092964-52a3-4a04-bf50-e0071a53b374" containerID="42ba6c522f6dbbae1223195fcd7c4d8525fba45243bfd07fc9b4d20928a265db" exitCode=0
Jul 22 01:29:44.355972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:44.355624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rv2hx" event={"ID":"c9092964-52a3-4a04-bf50-e0071a53b374","Type":"ContainerDied","Data":"42ba6c522f6dbbae1223195fcd7c4d8525fba45243bfd07fc9b4d20928a265db"}
Jul 22 01:29:44.355972 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:44.355965    2559 scope.go:117] "RemoveContainer" containerID="42ba6c522f6dbbae1223195fcd7c4d8525fba45243bfd07fc9b4d20928a265db"
Jul 22 01:29:45.360985 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:29:45.360951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rv2hx" event={"ID":"c9092964-52a3-4a04-bf50-e0071a53b374","Type":"ContainerStarted","Data":"2c813268db2878eab1fa9723b68746008cfbd49fb730c4fbc13f16ea611a3d99"}
Jul 22 01:32:33.570634 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:32:33.570603    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:32:33.575203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:32:33.575177    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:32:33.582356 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:32:33.582334    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 01:33:58.162821 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.162721    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"]
Jul 22 01:33:58.163313 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.163039    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerName="registry"
Jul 22 01:33:58.163313 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.163050    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerName="registry"
Jul 22 01:33:58.163313 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.163117    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cb60c39-808d-4a0e-8759-ca89872a662c" containerName="registry"
Jul 22 01:33:58.166108 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.166088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.169542 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.169520    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 01:33:58.169793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.169751    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 01:33:58.169793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.169769    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x7rff\""
Jul 22 01:33:58.169984 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.169792    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 01:33:58.169984 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.169794    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 01:33:58.183471 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.183441    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"]
Jul 22 01:33:58.277736 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.277695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.277736 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.277734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.277951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.277752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.277951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.277819    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.277951 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.277869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnq4q\" (UniqueName: \"kubernetes.io/projected/36bbf2eb-d9c1-4d10-a273-e120791773e3-kube-api-access-fnq4q\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378347 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378347 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378614 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378614 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378614 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378435    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnq4q\" (UniqueName: \"kubernetes.io/projected/36bbf2eb-d9c1-4d10-a273-e120791773e3-kube-api-access-fnq4q\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.378830 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.378802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-manifests\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.380954 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.380930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36bbf2eb-d9c1-4d10-a273-e120791773e3-tmp\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.381028 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.381006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.381094 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.381072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36bbf2eb-d9c1-4d10-a273-e120791773e3-webhook-cert\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.387502 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.387470    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnq4q\" (UniqueName: \"kubernetes.io/projected/36bbf2eb-d9c1-4d10-a273-e120791773e3-kube-api-access-fnq4q\") pod \"opendatahub-operator-controller-manager-9869b8c7c-7zjdd\" (UID: \"36bbf2eb-d9c1-4d10-a273-e120791773e3\") " pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.476978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.476878    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:33:58.624646 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.624609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"]
Jul 22 01:33:58.628213 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:33:58.628181    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bbf2eb_d9c1_4d10_a273_e120791773e3.slice/crio-6ca7183c8515153abf189e9085a738193b12a21c50b8c04833e3192d0c137ed8 WatchSource:0}: Error finding container 6ca7183c8515153abf189e9085a738193b12a21c50b8c04833e3192d0c137ed8: Status 404 returned error can't find the container with id 6ca7183c8515153abf189e9085a738193b12a21c50b8c04833e3192d0c137ed8
Jul 22 01:33:58.630092 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:58.630069    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 01:33:59.338579 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:33:59.338535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd" event={"ID":"36bbf2eb-d9c1-4d10-a273-e120791773e3","Type":"ContainerStarted","Data":"6ca7183c8515153abf189e9085a738193b12a21c50b8c04833e3192d0c137ed8"}
Jul 22 01:34:02.357005 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:02.356968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd" event={"ID":"36bbf2eb-d9c1-4d10-a273-e120791773e3","Type":"ContainerStarted","Data":"41e6d19cfbca0397940523e5ace17b025141fd2a595614dad53491f47dae091c"}
Jul 22 01:34:03.362751 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:03.362717    2559 generic.go:356] "Generic (PLEG): container finished" podID="36bbf2eb-d9c1-4d10-a273-e120791773e3" containerID="41e6d19cfbca0397940523e5ace17b025141fd2a595614dad53491f47dae091c" exitCode=0
Jul 22 01:34:03.363176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:03.362773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd" event={"ID":"36bbf2eb-d9c1-4d10-a273-e120791773e3","Type":"ContainerDied","Data":"41e6d19cfbca0397940523e5ace17b025141fd2a595614dad53491f47dae091c"}
Jul 22 01:34:04.368629 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:04.368588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd" event={"ID":"36bbf2eb-d9c1-4d10-a273-e120791773e3","Type":"ContainerStarted","Data":"61e5caa9882b6c81960b0c89603f563124699c56108eeae25955f47763a30d8c"}
Jul 22 01:34:04.369016 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:04.368726    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:34:04.394282 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:04.394228    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd" podStartSLOduration=2.003333032 podStartE2EDuration="6.394211944s" totalImagesPullingTime="3.386785428s" totalInitContainerRuntime="1.004093484s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:04.392967315 +0000 UTC m=+391.222904126" watchObservedRunningTime="2026-07-22 01:34:04.394211944 +0000 UTC m=+391.224148778"
Jul 22 01:34:15.376596 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:15.376560    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9869b8c7c-7zjdd"
Jul 22 01:34:28.373235 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.373198    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"]
Jul 22 01:34:28.375468 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.375449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.378222 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.378194    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8n4ps\""
Jul 22 01:34:28.378338 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.378325    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 01:34:28.389847 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.389820    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"]
Jul 22 01:34:28.392240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.392218    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"]
Jul 22 01:34:28.394658 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.394638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.397248 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.397230    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 01:34:28.397333 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.397274    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8t27q\""
Jul 22 01:34:28.406196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.406174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"]
Jul 22 01:34:28.441812 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.441779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbf4x\" (UniqueName: \"kubernetes.io/projected/8ee60e40-2de7-489b-a039-6600f2eea14b-kube-api-access-qbf4x\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.441982 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.441848    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxkj\" (UniqueName: \"kubernetes.io/projected/d99a3e81-2daf-4221-928a-58ef5e7b3954-kube-api-access-vjxkj\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.441982 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.441890    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.441982 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.441961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee60e40-2de7-489b-a039-6600f2eea14b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.542855 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.542815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbf4x\" (UniqueName: \"kubernetes.io/projected/8ee60e40-2de7-489b-a039-6600f2eea14b-kube-api-access-qbf4x\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.543047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.542872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxkj\" (UniqueName: \"kubernetes.io/projected/d99a3e81-2daf-4221-928a-58ef5e7b3954-kube-api-access-vjxkj\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.543047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.542910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.543047 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.542929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee60e40-2de7-489b-a039-6600f2eea14b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.543229 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:34:28.543065    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 22 01:34:28.543229 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:34:28.543146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert podName:d99a3e81-2daf-4221-928a-58ef5e7b3954 nodeName:}" failed. No retries permitted until 2026-07-22 01:34:29.043110864 +0000 UTC m=+415.873047658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert") pod "kserve-controller-manager-d6f4b65b8-4vgqv" (UID: "d99a3e81-2daf-4221-928a-58ef5e7b3954") : secret "kserve-webhook-server-cert" not found
Jul 22 01:34:28.545603 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.545568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ee60e40-2de7-489b-a039-6600f2eea14b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.554464 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.554434    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxkj\" (UniqueName: \"kubernetes.io/projected/d99a3e81-2daf-4221-928a-58ef5e7b3954-kube-api-access-vjxkj\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:28.555889 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.555865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbf4x\" (UniqueName: \"kubernetes.io/projected/8ee60e40-2de7-489b-a039-6600f2eea14b-kube-api-access-qbf4x\") pod \"llmisvc-controller-manager-777c6bd7d5-6w2n9\" (UID: \"8ee60e40-2de7-489b-a039-6600f2eea14b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.608148 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.608093    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"]
Jul 22 01:34:28.610777 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.610757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.613728 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.613711    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 01:34:28.613823 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.613733    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 01:34:28.626297 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.626239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"]
Jul 22 01:34:28.643793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.643764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.643956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.643838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tmp\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.643956 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.643866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlgw5\" (UniqueName: \"kubernetes.io/projected/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-kube-api-access-vlgw5\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.706898 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.706862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:28.744906 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.744867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tmp\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.744906 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.744911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlgw5\" (UniqueName: \"kubernetes.io/projected/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-kube-api-access-vlgw5\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.745115 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.745002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.745181 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:34:28.745145    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 22 01:34:28.745224 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:34:28.745218    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs podName:db1acbfc-90b4-4925-88d8-414e8f2cc0b9 nodeName:}" failed. No retries permitted until 2026-07-22 01:34:29.245198967 +0000 UTC m=+416.075135758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs") pod "kube-auth-proxy-5d7dbc5fd-n9zmf" (UID: "db1acbfc-90b4-4925-88d8-414e8f2cc0b9") : secret "kube-auth-proxy-tls" not found
Jul 22 01:34:28.747835 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.747792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tmp\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.758430 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.758397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlgw5\" (UniqueName: \"kubernetes.io/projected/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-kube-api-access-vlgw5\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:28.854086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:28.854056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"]
Jul 22 01:34:28.855848 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:34:28.855822    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ee60e40_2de7_489b_a039_6600f2eea14b.slice/crio-4f65410643660482d9cd655a6c38d321e3231b6941cfdf73b515b868a2aad2d7 WatchSource:0}: Error finding container 4f65410643660482d9cd655a6c38d321e3231b6941cfdf73b515b868a2aad2d7: Status 404 returned error can't find the container with id 4f65410643660482d9cd655a6c38d321e3231b6941cfdf73b515b868a2aad2d7
Jul 22 01:34:29.048195 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.048097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:29.050638 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.050618    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d99a3e81-2daf-4221-928a-58ef5e7b3954-cert\") pod \"kserve-controller-manager-d6f4b65b8-4vgqv\" (UID: \"d99a3e81-2daf-4221-928a-58ef5e7b3954\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:29.250187 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.250115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:29.252666 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.252646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db1acbfc-90b4-4925-88d8-414e8f2cc0b9-tls-certs\") pod \"kube-auth-proxy-5d7dbc5fd-n9zmf\" (UID: \"db1acbfc-90b4-4925-88d8-414e8f2cc0b9\") " pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:29.286625 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.286579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:29.423356 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.423332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"]
Jul 22 01:34:29.425104 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:34:29.425078    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99a3e81_2daf_4221_928a_58ef5e7b3954.slice/crio-967a554617bf7fe6767ab015b54418193db65ba7137f49d8799708bd56a22056 WatchSource:0}: Error finding container 967a554617bf7fe6767ab015b54418193db65ba7137f49d8799708bd56a22056: Status 404 returned error can't find the container with id 967a554617bf7fe6767ab015b54418193db65ba7137f49d8799708bd56a22056
Jul 22 01:34:29.473955 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.473916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv" event={"ID":"d99a3e81-2daf-4221-928a-58ef5e7b3954","Type":"ContainerStarted","Data":"967a554617bf7fe6767ab015b54418193db65ba7137f49d8799708bd56a22056"}
Jul 22 01:34:29.475103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.475080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9" event={"ID":"8ee60e40-2de7-489b-a039-6600f2eea14b","Type":"ContainerStarted","Data":"4f65410643660482d9cd655a6c38d321e3231b6941cfdf73b515b868a2aad2d7"}
Jul 22 01:34:29.521087 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.521062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"
Jul 22 01:34:29.673836 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:29.673762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf"]
Jul 22 01:34:29.676389 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:34:29.676364    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1acbfc_90b4_4925_88d8_414e8f2cc0b9.slice/crio-57497a6fca2630b1bf19124f659de9496b0f266f4cda09f636369fc5af193796 WatchSource:0}: Error finding container 57497a6fca2630b1bf19124f659de9496b0f266f4cda09f636369fc5af193796: Status 404 returned error can't find the container with id 57497a6fca2630b1bf19124f659de9496b0f266f4cda09f636369fc5af193796
Jul 22 01:34:30.483507 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.483464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf" event={"ID":"db1acbfc-90b4-4925-88d8-414e8f2cc0b9","Type":"ContainerStarted","Data":"57497a6fca2630b1bf19124f659de9496b0f266f4cda09f636369fc5af193796"}
Jul 22 01:34:30.639847 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.639771    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"]
Jul 22 01:34:30.642633 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.642607    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.646772 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.646740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 01:34:30.647109 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.647092    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wlw9w\""
Jul 22 01:34:30.647439 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.647106    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 01:34:30.647916 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.647896    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 01:34:30.648181 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.648163    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 01:34:30.672634 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.672593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"]
Jul 22 01:34:30.763978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.763894    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgf4\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-kube-api-access-5mgf4\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.763978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.763941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.763978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.763969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.764269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.764028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.764269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.764085    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f871e869-c3eb-47a4-9337-9455cd531db8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.764269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.764110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.764269 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.764236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864620 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864581    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f871e869-c3eb-47a4-9337-9455cd531db8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgf4\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-kube-api-access-5mgf4\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864740    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.864815 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.864756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.865424 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.865391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.867107 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.867078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.867238 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.867143    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.867374 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.867359    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f871e869-c3eb-47a4-9337-9455cd531db8-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.867509 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.867491    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f871e869-c3eb-47a4-9337-9455cd531db8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.877918 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.877893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgf4\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-kube-api-access-5mgf4\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.884399 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.884372    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f871e869-c3eb-47a4-9337-9455cd531db8-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bdpqp\" (UID: \"f871e869-c3eb-47a4-9337-9455cd531db8\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:30.956303 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:30.956263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:31.135943 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:31.135909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"]
Jul 22 01:34:31.139359 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:34:31.139326    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf871e869_c3eb_47a4_9337_9455cd531db8.slice/crio-09bf7d70259d41cf39a4174042df2665030047096830b8deef5f5826a703c717 WatchSource:0}: Error finding container 09bf7d70259d41cf39a4174042df2665030047096830b8deef5f5826a703c717: Status 404 returned error can't find the container with id 09bf7d70259d41cf39a4174042df2665030047096830b8deef5f5826a703c717
Jul 22 01:34:31.492211 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:31.492170    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp" event={"ID":"f871e869-c3eb-47a4-9337-9455cd531db8","Type":"ContainerStarted","Data":"09bf7d70259d41cf39a4174042df2665030047096830b8deef5f5826a703c717"}
Jul 22 01:34:34.488738 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:34.488718    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 01:34:34.526865 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:34.526819    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 01:34:34.526937 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:34.526898    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 22 01:34:35.514733 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.514698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv" event={"ID":"d99a3e81-2daf-4221-928a-58ef5e7b3954","Type":"ContainerStarted","Data":"2630c37a6c71175f07c6face605b85ebe53f21f3213720843d46369606ff7e3e"}
Jul 22 01:34:35.515230 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.514763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:34:35.516190 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.516165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf" event={"ID":"db1acbfc-90b4-4925-88d8-414e8f2cc0b9","Type":"ContainerStarted","Data":"f7a9ca2b4c59c8c498b1b1de2b12629f64675e2e325a10eb3ae6ab7c4a8bdd67"}
Jul 22 01:34:35.517627 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.517606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9" event={"ID":"8ee60e40-2de7-489b-a039-6600f2eea14b","Type":"ContainerStarted","Data":"bff8e604a9a8185e3e2f44ac9d3d313a23f81afc1941fd6b9bf25b4f37a2841e"}
Jul 22 01:34:35.517736 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.517653    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:34:35.519027 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.519006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp" event={"ID":"f871e869-c3eb-47a4-9337-9455cd531db8","Type":"ContainerStarted","Data":"3a4875a8fd1798592f02ce67c9d2448faac77578e872390cad2d771e588f65e9"}
Jul 22 01:34:35.519138 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.519065    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:34:35.520790 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.520763    2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bdpqp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 22 01:34:35.520898 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.520817    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp" podUID="f871e869-c3eb-47a4-9337-9455cd531db8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 01:34:35.540772 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.540728    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv" podStartSLOduration=2.483632282 podStartE2EDuration="7.540713926s" totalImagesPullingTime="5.057081644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:35.539734108 +0000 UTC m=+422.369670910" watchObservedRunningTime="2026-07-22 01:34:35.540713926 +0000 UTC m=+422.370650736"
Jul 22 01:34:35.567873 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.567824    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp" podStartSLOduration=2.1828983969999998 podStartE2EDuration="5.567809823s" totalImagesPullingTime="3.384911426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:35.566380774 +0000 UTC m=+422.396317606" watchObservedRunningTime="2026-07-22 01:34:35.567809823 +0000 UTC m=+422.397746633"
Jul 22 01:34:35.586141 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.586079    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d7dbc5fd-n9zmf" podStartSLOduration=2.780994591 podStartE2EDuration="7.586058439s" totalImagesPullingTime="4.805063848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:35.585357456 +0000 UTC m=+422.415294268" watchObservedRunningTime="2026-07-22 01:34:35.586058439 +0000 UTC m=+422.415995319"
Jul 22 01:34:35.607658 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:35.607614    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9" podStartSLOduration=1.981345196 podStartE2EDuration="7.607600421s" totalImagesPullingTime="5.626255225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:34:35.605856137 +0000 UTC m=+422.435792947" watchObservedRunningTime="2026-07-22 01:34:35.607600421 +0000 UTC m=+422.437537269"
Jul 22 01:34:36.524777 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:34:36.524749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bdpqp"
Jul 22 01:35:06.527074 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:35:06.527040    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6w2n9"
Jul 22 01:35:06.530110 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:35:06.530090    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-4vgqv"
Jul 22 01:36:02.259612 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.259573    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"]
Jul 22 01:36:02.261829 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.261812    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:02.265441 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.265413    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tvkhz\""
Jul 22 01:36:02.265654 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.265636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 01:36:02.266415 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.266400    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 01:36:02.281334 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.281306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"]
Jul 22 01:36:02.354344 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.354311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmr57\" (UniqueName: \"kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57\") pod \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" (UID: \"c450c8e7-f2d5-4ce6-9d5d-05b177353960\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:02.455162 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.455107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmr57\" (UniqueName: \"kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57\") pod \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" (UID: \"c450c8e7-f2d5-4ce6-9d5d-05b177353960\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:02.465750 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.465725    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmr57\" (UniqueName: \"kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57\") pod \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" (UID: \"c450c8e7-f2d5-4ce6-9d5d-05b177353960\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:02.572196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.572089    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:02.720282 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.720248    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"]
Jul 22 01:36:02.723334 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:36:02.723301    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc450c8e7_f2d5_4ce6_9d5d_05b177353960.slice/crio-c5a40c4ababe772817c54e34f7f711fcba3a6707fd58469dd104e50d7ba95b08 WatchSource:0}: Error finding container c5a40c4ababe772817c54e34f7f711fcba3a6707fd58469dd104e50d7ba95b08: Status 404 returned error can't find the container with id c5a40c4ababe772817c54e34f7f711fcba3a6707fd58469dd104e50d7ba95b08
Jul 22 01:36:02.898923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:02.898888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt" event={"ID":"c450c8e7-f2d5-4ce6-9d5d-05b177353960","Type":"ContainerStarted","Data":"c5a40c4ababe772817c54e34f7f711fcba3a6707fd58469dd104e50d7ba95b08"}
Jul 22 01:36:04.911256 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:04.911218    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt" event={"ID":"c450c8e7-f2d5-4ce6-9d5d-05b177353960","Type":"ContainerStarted","Data":"9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2"}
Jul 22 01:36:04.911738 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:04.911393    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:04.937149 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:04.937082    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt" podStartSLOduration=0.920473997 podStartE2EDuration="2.93706628s" totalImagesPullingTime="2.016592283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:04.935199408 +0000 UTC m=+511.765136219" watchObservedRunningTime="2026-07-22 01:36:04.93706628 +0000 UTC m=+511.767003161"
Jul 22 01:36:15.917912 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:15.917882    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.448044 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.448009    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"]
Jul 22 01:36:16.448247 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.448194    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" containerName="manager" containerID="cri-o://9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2" gracePeriod=2
Jul 22 01:36:16.456889 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.456858    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"]
Jul 22 01:36:16.487714 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.487673    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"]
Jul 22 01:36:16.488175 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.488112    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" containerName="manager"
Jul 22 01:36:16.488326 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.488180    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" containerName="manager"
Jul 22 01:36:16.488326 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.488292    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" containerName="manager"
Jul 22 01:36:16.490262 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.490242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:16.492569 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:36:16.492533    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" is forbidden: User \"system:node:ip-10-0-135-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-67.ec2.internal' and this object" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.508341 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.508311    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"]
Jul 22 01:36:16.577636 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.577595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntvb\" (UniqueName: \"kubernetes.io/projected/7b387f07-b299-4ab6-ab17-4b290f33bd00-kube-api-access-nntvb\") pod \"limitador-operator-controller-manager-859d7b78bd-vj7bj\" (UID: \"7b387f07-b299-4ab6-ab17-4b290f33bd00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:16.678891 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.678856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nntvb\" (UniqueName: \"kubernetes.io/projected/7b387f07-b299-4ab6-ab17-4b290f33bd00-kube-api-access-nntvb\") pod \"limitador-operator-controller-manager-859d7b78bd-vj7bj\" (UID: \"7b387f07-b299-4ab6-ab17-4b290f33bd00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:16.697908 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.697882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.700634 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:36:16.700574    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" is forbidden: User \"system:node:ip-10-0-135-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-67.ec2.internal' and this object" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.703683 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.703658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntvb\" (UniqueName: \"kubernetes.io/projected/7b387f07-b299-4ab6-ab17-4b290f33bd00-kube-api-access-nntvb\") pod \"limitador-operator-controller-manager-859d7b78bd-vj7bj\" (UID: \"7b387f07-b299-4ab6-ab17-4b290f33bd00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:16.779769 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.779730    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmr57\" (UniqueName: \"kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57\") pod \"c450c8e7-f2d5-4ce6-9d5d-05b177353960\" (UID: \"c450c8e7-f2d5-4ce6-9d5d-05b177353960\") "
Jul 22 01:36:16.782098 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.782071    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57" (OuterVolumeSpecName: "kube-api-access-tmr57") pod "c450c8e7-f2d5-4ce6-9d5d-05b177353960" (UID: "c450c8e7-f2d5-4ce6-9d5d-05b177353960"). InnerVolumeSpecName "kube-api-access-tmr57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:36:16.836402 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.836365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:16.881204 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.881176    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmr57\" (UniqueName: \"kubernetes.io/projected/c450c8e7-f2d5-4ce6-9d5d-05b177353960-kube-api-access-tmr57\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:36:16.966159 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.966060    2559 generic.go:356] "Generic (PLEG): container finished" podID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" containerID="9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2" exitCode=0
Jul 22 01:36:16.966159 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.966109    2559 scope.go:117] "RemoveContainer" containerID="9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2"
Jul 22 01:36:16.966159 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.966117    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.968853 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:36:16.968821    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" is forbidden: User \"system:node:ip-10-0-135-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-67.ec2.internal' and this object" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.975981 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.975961    2559 scope.go:117] "RemoveContainer" containerID="9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2"
Jul 22 01:36:16.976324 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:36:16.976306    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2\": container with ID starting with 9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2 not found: ID does not exist" containerID="9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2"
Jul 22 01:36:16.976371 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.976337    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2"} err="failed to get container status \"9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2\": rpc error: code = NotFound desc = could not find container \"9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2\": container with ID starting with 9e5eafdd89b3cfacca710ab78cc30e409dd7cddd983d35a97aff2381710020c2 not found: ID does not exist"
Jul 22 01:36:16.977269 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:36:16.977241    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6b5xt\" is forbidden: User \"system:node:ip-10-0-135-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-67.ec2.internal' and this object" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6b5xt"
Jul 22 01:36:16.991382 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:16.991349    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"]
Jul 22 01:36:16.994405 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:36:16.994371    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b387f07_b299_4ab6_ab17_4b290f33bd00.slice/crio-6debea370e3fe157e373695be8212b7688fcb15ecfef97abf0c932ab135b2e8a WatchSource:0}: Error finding container 6debea370e3fe157e373695be8212b7688fcb15ecfef97abf0c932ab135b2e8a: Status 404 returned error can't find the container with id 6debea370e3fe157e373695be8212b7688fcb15ecfef97abf0c932ab135b2e8a
Jul 22 01:36:17.695703 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:17.695669    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c450c8e7-f2d5-4ce6-9d5d-05b177353960" path="/var/lib/kubelet/pods/c450c8e7-f2d5-4ce6-9d5d-05b177353960/volumes"
Jul 22 01:36:17.973303 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:17.973214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj" event={"ID":"7b387f07-b299-4ab6-ab17-4b290f33bd00","Type":"ContainerStarted","Data":"771d68518dd2f995d61288e695cdb99574bb5355cb9bd1b52f5e2312267f60f5"}
Jul 22 01:36:17.973303 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:17.973266    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj" event={"ID":"7b387f07-b299-4ab6-ab17-4b290f33bd00","Type":"ContainerStarted","Data":"6debea370e3fe157e373695be8212b7688fcb15ecfef97abf0c932ab135b2e8a"}
Jul 22 01:36:17.973693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:17.973327    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:36:18.011641 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:18.011574    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj" podStartSLOduration=2.011553581 podStartE2EDuration="2.011553581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:36:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:36:18.010749927 +0000 UTC m=+524.840686773" watchObservedRunningTime="2026-07-22 01:36:18.011553581 +0000 UTC m=+524.841490392"
Jul 22 01:36:28.980966 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:36:28.980875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vj7bj"
Jul 22 01:37:29.807261 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.807196    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:29.811121 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.811096    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:29.817644 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.817466    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 01:37:29.817644 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.817567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 01:37:29.817866 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.817808    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gjqk6\""
Jul 22 01:37:29.841214 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.841179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:29.906408 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.906374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc9r\" (UniqueName: \"kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:29.906621 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:29.906505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.007392 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.007356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.007563 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.007406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc9r\" (UniqueName: \"kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.007563 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:37:30.007525    2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 22 01:37:30.007643 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:37:30.007592    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert podName:ba182a3b-361d-4252-b16a-d616b3624be3 nodeName:}" failed. No retries permitted until 2026-07-22 01:37:30.507574602 +0000 UTC m=+597.337511391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert") pod "maas-controller-dbcb6496b-ntgwj" (UID: "ba182a3b-361d-4252-b16a-d616b3624be3") : secret "maas-controller-webhook-cert" not found
Jul 22 01:37:30.020828 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.020802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc9r\" (UniqueName: \"kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.025939 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.025913    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:37:30.029357 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.029339    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.041952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.041924    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:37:30.108412 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.108384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.108562 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.108444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vlwx\" (UniqueName: \"kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.208986 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.208956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.209195 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.209015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vlwx\" (UniqueName: \"kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.211894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.211871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.218240 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.218215    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vlwx\" (UniqueName: \"kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx\") pod \"maas-controller-6887b55f68-cwwpg\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") " pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.341207 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.341169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:30.481674 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.481640    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:37:30.485774 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:37:30.485746    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901362e0_9fbd_407f_a313_a2a97104c7bc.slice/crio-7a4686cf5a3e3c4dd085f7fbcd99d360f752dbd2709bda5aac0ac2ad778ff6ce WatchSource:0}: Error finding container 7a4686cf5a3e3c4dd085f7fbcd99d360f752dbd2709bda5aac0ac2ad778ff6ce: Status 404 returned error can't find the container with id 7a4686cf5a3e3c4dd085f7fbcd99d360f752dbd2709bda5aac0ac2ad778ff6ce
Jul 22 01:37:30.512326 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.512295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.514839 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.514806    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") pod \"maas-controller-dbcb6496b-ntgwj\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") " pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.723295 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.723200    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:30.867270 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:30.867243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:30.868893 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:37:30.868868    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba182a3b_361d_4252_b16a_d616b3624be3.slice/crio-2b98cdee8795c9ede981bcce2812e2c2fd7f32a5e604e623d3e6edf75d4540c7 WatchSource:0}: Error finding container 2b98cdee8795c9ede981bcce2812e2c2fd7f32a5e604e623d3e6edf75d4540c7: Status 404 returned error can't find the container with id 2b98cdee8795c9ede981bcce2812e2c2fd7f32a5e604e623d3e6edf75d4540c7
Jul 22 01:37:31.299952 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:31.299911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-cwwpg" event={"ID":"901362e0-9fbd-407f-a313-a2a97104c7bc","Type":"ContainerStarted","Data":"7a4686cf5a3e3c4dd085f7fbcd99d360f752dbd2709bda5aac0ac2ad778ff6ce"}
Jul 22 01:37:31.302162 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:31.302085    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" event={"ID":"ba182a3b-361d-4252-b16a-d616b3624be3","Type":"ContainerStarted","Data":"2b98cdee8795c9ede981bcce2812e2c2fd7f32a5e604e623d3e6edf75d4540c7"}
Jul 22 01:37:33.312765 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.312668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-cwwpg" event={"ID":"901362e0-9fbd-407f-a313-a2a97104c7bc","Type":"ContainerStarted","Data":"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"}
Jul 22 01:37:33.313207 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.312785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:33.314154 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.314111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" event={"ID":"ba182a3b-361d-4252-b16a-d616b3624be3","Type":"ContainerStarted","Data":"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"}
Jul 22 01:37:33.314263 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.314221    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:33.341916 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.341867    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6887b55f68-cwwpg" podStartSLOduration=0.78304701 podStartE2EDuration="3.341852779s" totalImagesPullingTime="2.558805769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:37:33.339979883 +0000 UTC m=+600.169916695" watchObservedRunningTime="2026-07-22 01:37:33.341852779 +0000 UTC m=+600.171789590"
Jul 22 01:37:33.364859 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.364810    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" podStartSLOduration=2.183118236 podStartE2EDuration="4.364796105s" totalImagesPullingTime="2.181677869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:37:33.364684068 +0000 UTC m=+600.194620879" watchObservedRunningTime="2026-07-22 01:37:33.364796105 +0000 UTC m=+600.194732917"
Jul 22 01:37:33.601140 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.601037    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:37:33.603476 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:33.603455    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:37:44.320309 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.320275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:37:44.320813 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.320356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:44.392535 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.392499    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:44.392742 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.392696    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" podUID="ba182a3b-361d-4252-b16a-d616b3624be3" containerName="manager" containerID="cri-o://321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36" gracePeriod=30
Jul 22 01:37:44.644648 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.644615    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:44.838694 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.838657    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sc9r\" (UniqueName: \"kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r\") pod \"ba182a3b-361d-4252-b16a-d616b3624be3\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") "
Jul 22 01:37:44.838895 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.838746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") pod \"ba182a3b-361d-4252-b16a-d616b3624be3\" (UID: \"ba182a3b-361d-4252-b16a-d616b3624be3\") "
Jul 22 01:37:44.841102 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.841067    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ba182a3b-361d-4252-b16a-d616b3624be3" (UID: "ba182a3b-361d-4252-b16a-d616b3624be3"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:37:44.841102 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.841081    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r" (OuterVolumeSpecName: "kube-api-access-9sc9r") pod "ba182a3b-361d-4252-b16a-d616b3624be3" (UID: "ba182a3b-361d-4252-b16a-d616b3624be3"). InnerVolumeSpecName "kube-api-access-9sc9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:37:44.940497 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.940411    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba182a3b-361d-4252-b16a-d616b3624be3-webhook-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:37:44.940497 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:44.940441    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sc9r\" (UniqueName: \"kubernetes.io/projected/ba182a3b-361d-4252-b16a-d616b3624be3-kube-api-access-9sc9r\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:37:45.369395 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.369361    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba182a3b-361d-4252-b16a-d616b3624be3" containerID="321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36" exitCode=0
Jul 22 01:37:45.369897 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.369406    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcb6496b-ntgwj"
Jul 22 01:37:45.369897 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.369444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" event={"ID":"ba182a3b-361d-4252-b16a-d616b3624be3","Type":"ContainerDied","Data":"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"}
Jul 22 01:37:45.369897 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.369490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcb6496b-ntgwj" event={"ID":"ba182a3b-361d-4252-b16a-d616b3624be3","Type":"ContainerDied","Data":"2b98cdee8795c9ede981bcce2812e2c2fd7f32a5e604e623d3e6edf75d4540c7"}
Jul 22 01:37:45.369897 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.369510    2559 scope.go:117] "RemoveContainer" containerID="321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"
Jul 22 01:37:45.378549 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.378533    2559 scope.go:117] "RemoveContainer" containerID="321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"
Jul 22 01:37:45.378811 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:37:45.378790    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36\": container with ID starting with 321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36 not found: ID does not exist" containerID="321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"
Jul 22 01:37:45.378920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.378817    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36"} err="failed to get container status \"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36\": rpc error: code = NotFound desc = could not find container \"321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36\": container with ID starting with 321c4891c647c8bc35b1cd522b07d6de645e281f41ce33e6e27c4928d21b1f36 not found: ID does not exist"
Jul 22 01:37:45.391722 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.391694    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:45.396858 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.396835    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dbcb6496b-ntgwj"]
Jul 22 01:37:45.696729 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:37:45.696649    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba182a3b-361d-4252-b16a-d616b3624be3" path="/var/lib/kubelet/pods/ba182a3b-361d-4252-b16a-d616b3624be3/volumes"
Jul 22 01:38:05.933122 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.933088    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"]
Jul 22 01:38:05.933519 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.933431    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba182a3b-361d-4252-b16a-d616b3624be3" containerName="manager"
Jul 22 01:38:05.933519 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.933443    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba182a3b-361d-4252-b16a-d616b3624be3" containerName="manager"
Jul 22 01:38:05.933519 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.933514    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba182a3b-361d-4252-b16a-d616b3624be3" containerName="manager"
Jul 22 01:38:05.936452 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.936435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:05.939299 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.939270    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 01:38:05.939812 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.939795    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vvnxr\""
Jul 22 01:38:05.939904 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.939833    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 01:38:05.940239 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.940225    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 01:38:05.950899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:05.950875    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"]
Jul 22 01:38:06.023712 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.023676    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7x7s\" (UniqueName: \"kubernetes.io/projected/f9eeca5e-90d8-46f2-936e-f40982494b93-kube-api-access-b7x7s\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.023899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.023724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.023899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.023841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9eeca5e-90d8-46f2-936e-f40982494b93-openshift-service-ca\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.125311 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.125278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9eeca5e-90d8-46f2-936e-f40982494b93-openshift-service-ca\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.125536 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.125327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7x7s\" (UniqueName: \"kubernetes.io/projected/f9eeca5e-90d8-46f2-936e-f40982494b93-kube-api-access-b7x7s\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.125536 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.125349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.125536 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:38:06.125464    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 22 01:38:06.125536 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:38:06.125540    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls podName:f9eeca5e-90d8-46f2-936e-f40982494b93 nodeName:}" failed. No retries permitted until 2026-07-22 01:38:06.625524917 +0000 UTC m=+633.455461706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls") pod "maas-api-7c4b85df8d-xh7qn" (UID: "f9eeca5e-90d8-46f2-936e-f40982494b93") : secret "maas-api-serving-cert" not found
Jul 22 01:38:06.126038 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.126014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9eeca5e-90d8-46f2-936e-f40982494b93-openshift-service-ca\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.142323 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.142294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7x7s\" (UniqueName: \"kubernetes.io/projected/f9eeca5e-90d8-46f2-936e-f40982494b93-kube-api-access-b7x7s\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.599871 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.599839    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97ws4"]
Jul 22 01:38:06.607937 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.607912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.611016 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.610989    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 01:38:06.611296 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.611279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tvqr4\""
Jul 22 01:38:06.620179 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.620154    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97ws4"]
Jul 22 01:38:06.631554 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.631515    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.634245 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.634172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9eeca5e-90d8-46f2-936e-f40982494b93-maas-api-tls\") pod \"maas-api-7c4b85df8d-xh7qn\" (UID: \"f9eeca5e-90d8-46f2-936e-f40982494b93\") " pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.732091 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.732055    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg47v\" (UniqueName: \"kubernetes.io/projected/a53113d4-14b1-4127-8459-236b5ab9c317-kube-api-access-zg47v\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.732266 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.732154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a53113d4-14b1-4127-8459-236b5ab9c317-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.833180 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.833123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg47v\" (UniqueName: \"kubernetes.io/projected/a53113d4-14b1-4127-8459-236b5ab9c317-kube-api-access-zg47v\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.833372 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.833214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a53113d4-14b1-4127-8459-236b5ab9c317-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.833981 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.833960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a53113d4-14b1-4127-8459-236b5ab9c317-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.845424 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.845399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg47v\" (UniqueName: \"kubernetes.io/projected/a53113d4-14b1-4127-8459-236b5ab9c317-kube-api-access-zg47v\") pod \"payload-pre-processing-7677b774bb-97ws4\" (UID: \"a53113d4-14b1-4127-8459-236b5ab9c317\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.847225 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.847196    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:06.919317 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.919277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:06.997854 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:06.997797    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"]
Jul 22 01:38:07.000346 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:38:07.000317    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9eeca5e_90d8_46f2_936e_f40982494b93.slice/crio-eda766b08b979290eff23f9ead6b571a3bc3d075f5f08d3ae21afb7c66c53715 WatchSource:0}: Error finding container eda766b08b979290eff23f9ead6b571a3bc3d075f5f08d3ae21afb7c66c53715: Status 404 returned error can't find the container with id eda766b08b979290eff23f9ead6b571a3bc3d075f5f08d3ae21afb7c66c53715
Jul 22 01:38:07.077121 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:07.077061    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-97ws4"]
Jul 22 01:38:07.079785 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:38:07.079756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53113d4_14b1_4127_8459_236b5ab9c317.slice/crio-a308943423c762ffa45728128d2ae0217b2cbe95a387142971a3897f4da7ac94 WatchSource:0}: Error finding container a308943423c762ffa45728128d2ae0217b2cbe95a387142971a3897f4da7ac94: Status 404 returned error can't find the container with id a308943423c762ffa45728128d2ae0217b2cbe95a387142971a3897f4da7ac94
Jul 22 01:38:07.480694 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:07.480651    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn" event={"ID":"f9eeca5e-90d8-46f2-936e-f40982494b93","Type":"ContainerStarted","Data":"eda766b08b979290eff23f9ead6b571a3bc3d075f5f08d3ae21afb7c66c53715"}
Jul 22 01:38:07.481822 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:07.481798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4" event={"ID":"a53113d4-14b1-4127-8459-236b5ab9c317","Type":"ContainerStarted","Data":"a308943423c762ffa45728128d2ae0217b2cbe95a387142971a3897f4da7ac94"}
Jul 22 01:38:10.497374 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.497315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4" event={"ID":"a53113d4-14b1-4127-8459-236b5ab9c317","Type":"ContainerStarted","Data":"dfe88094bcf619322040d417c433909fef78733367218f20209129250b3b88c0"}
Jul 22 01:38:10.497899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.497394    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:10.498722 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.498699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn" event={"ID":"f9eeca5e-90d8-46f2-936e-f40982494b93","Type":"ContainerStarted","Data":"95106afc2257b59ccf02aedb91e231a3be1eaab74d167faac45bf3aee471de33"}
Jul 22 01:38:10.498794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.498747    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:10.528644 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.528590    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4" podStartSLOduration=1.9883848880000001 podStartE2EDuration="4.528573153s" totalImagesPullingTime="2.540188265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:38:10.522891337 +0000 UTC m=+637.352828147" watchObservedRunningTime="2026-07-22 01:38:10.528573153 +0000 UTC m=+637.358509966"
Jul 22 01:38:10.558782 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:10.558731    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn" podStartSLOduration=2.9895572440000002 podStartE2EDuration="5.558715012s" totalImagesPullingTime="2.569157768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:38:10.558638653 +0000 UTC m=+637.388575465" watchObservedRunningTime="2026-07-22 01:38:10.558715012 +0000 UTC m=+637.388651822"
Jul 22 01:38:16.509052 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:16.509022    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c4b85df8d-xh7qn"
Jul 22 01:38:21.506310 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:21.506280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-97ws4"
Jul 22 01:38:37.063433 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.063401    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"]
Jul 22 01:38:37.068315 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.068291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.078412 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.078391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sk8d9\""
Jul 22 01:38:37.078527 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.078493    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 01:38:37.080123 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.080107    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 01:38:37.082057 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.082039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 01:38:37.092444 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.092422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"]
Jul 22 01:38:37.206484 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.206678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e62ca32-415a-41d8-9076-5650aeae8e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.206678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dw6d\" (UniqueName: \"kubernetes.io/projected/0e62ca32-415a-41d8-9076-5650aeae8e75-kube-api-access-6dw6d\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.206678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206599    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.206678 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.206890 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.206727    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307514 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307514 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307785 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307785 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e62ca32-415a-41d8-9076-5650aeae8e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307785 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307613    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dw6d\" (UniqueName: \"kubernetes.io/projected/0e62ca32-415a-41d8-9076-5650aeae8e75-kube-api-access-6dw6d\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.307785 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.308016 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.307996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.308058 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.308029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.308093 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.308058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.309881 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.309863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e62ca32-415a-41d8-9076-5650aeae8e75-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.310259 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.310241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e62ca32-415a-41d8-9076-5650aeae8e75-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.321480 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.321423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dw6d\" (UniqueName: \"kubernetes.io/projected/0e62ca32-415a-41d8-9076-5650aeae8e75-kube-api-access-6dw6d\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vgmhk\" (UID: \"0e62ca32-415a-41d8-9076-5650aeae8e75\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.378809 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.378778    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:37.524944 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.524919    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"]
Jul 22 01:38:37.527412 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:38:37.527383    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e62ca32_415a_41d8_9076_5650aeae8e75.slice/crio-658a4660122d64f8636eee6a90c8a5c48f7b67aa2c9e9aa86224db70f95f22cf WatchSource:0}: Error finding container 658a4660122d64f8636eee6a90c8a5c48f7b67aa2c9e9aa86224db70f95f22cf: Status 404 returned error can't find the container with id 658a4660122d64f8636eee6a90c8a5c48f7b67aa2c9e9aa86224db70f95f22cf
Jul 22 01:38:37.625895 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:37.625851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk" event={"ID":"0e62ca32-415a-41d8-9076-5650aeae8e75","Type":"ContainerStarted","Data":"658a4660122d64f8636eee6a90c8a5c48f7b67aa2c9e9aa86224db70f95f22cf"}
Jul 22 01:38:39.640539 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:39.640504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk" event={"ID":"0e62ca32-415a-41d8-9076-5650aeae8e75","Type":"ContainerStarted","Data":"6c78ffe3680007440da8339c8b2023c66a07dda0a349f375be34ae8eed7329f1"}
Jul 22 01:38:39.670624 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:39.670564    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk" podStartSLOduration=1.625917341 podStartE2EDuration="2.670543224s" totalImagesPullingTime="1.044625883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:38:39.670424386 +0000 UTC m=+666.500361199" watchObservedRunningTime="2026-07-22 01:38:39.670543224 +0000 UTC m=+666.500480037"
Jul 22 01:38:47.379307 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:47.379272    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:47.379790 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:47.379363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:47.391789 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:47.391762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:38:47.696484 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:38:47.696404    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vgmhk"
Jul 22 01:39:05.421841 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.421810    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"]
Jul 22 01:39:05.425241 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.425221    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.429051 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.429030    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 01:39:05.437802 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.437779    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"]
Jul 22 01:39:05.552500 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.552680 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.552680 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9007b486-781b-4f0f-ac56-9d0f6d856141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.552680 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552608    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.552680 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552654    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.552821 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.552688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxbsv\" (UniqueName: \"kubernetes.io/projected/9007b486-781b-4f0f-ac56-9d0f6d856141-kube-api-access-dxbsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.653715 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.653681    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxbsv\" (UniqueName: \"kubernetes.io/projected/9007b486-781b-4f0f-ac56-9d0f6d856141-kube-api-access-dxbsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.653899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.653729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.653899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.653764    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.653899 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.653790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9007b486-781b-4f0f-ac56-9d0f6d856141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.655000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.653817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.655000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.654313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.655000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.654589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.655000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.654777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.655000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.654886    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.661207 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.657621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9007b486-781b-4f0f-ac56-9d0f6d856141-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.662188 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.662163    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9007b486-781b-4f0f-ac56-9d0f6d856141-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.664913 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.664892    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxbsv\" (UniqueName: \"kubernetes.io/projected/9007b486-781b-4f0f-ac56-9d0f6d856141-kube-api-access-dxbsv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-6cvx4\" (UID: \"9007b486-781b-4f0f-ac56-9d0f6d856141\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.735792 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.735707    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:05.881890 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.881855    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"]
Jul 22 01:39:05.885318 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:39:05.885283    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9007b486_781b_4f0f_ac56_9d0f6d856141.slice/crio-60e2f4037e4b81188976a6a289bf3f7b77033059232d84242e5bb83581050c9b WatchSource:0}: Error finding container 60e2f4037e4b81188976a6a289bf3f7b77033059232d84242e5bb83581050c9b: Status 404 returned error can't find the container with id 60e2f4037e4b81188976a6a289bf3f7b77033059232d84242e5bb83581050c9b
Jul 22 01:39:05.886724 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:05.886704    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 01:39:06.766605 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:06.766569    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4" event={"ID":"9007b486-781b-4f0f-ac56-9d0f6d856141","Type":"ContainerStarted","Data":"61bc14b1724a3561967a4841f590a4bef651c210445007940d3d4e3314681a07"}
Jul 22 01:39:06.767099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:06.766618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4" event={"ID":"9007b486-781b-4f0f-ac56-9d0f6d856141","Type":"ContainerStarted","Data":"60e2f4037e4b81188976a6a289bf3f7b77033059232d84242e5bb83581050c9b"}
Jul 22 01:39:06.789395 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:06.789344    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4" podStartSLOduration=1.608348791 podStartE2EDuration="1.789328317s" totalImagesPullingTime="180.979526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:39:06.787863101 +0000 UTC m=+693.617799932" watchObservedRunningTime="2026-07-22 01:39:06.789328317 +0000 UTC m=+693.619265128"
Jul 22 01:39:13.128421 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.128376    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"]
Jul 22 01:39:13.134301 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.134272    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.136831 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.136807    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 01:39:13.143046 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.143024    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"]
Jul 22 01:39:13.216825 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.217006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.217006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216888    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.217006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trj74\" (UniqueName: \"kubernetes.io/projected/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-kube-api-access-trj74\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.217006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.217006 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.216980    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.317995 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.317944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trj74\" (UniqueName: \"kubernetes.io/projected/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-kube-api-access-trj74\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318212 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318213    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318599 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318668 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.318668 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.318633    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.320544 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.320512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.320667 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.320647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.328055 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.328029    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trj74\" (UniqueName: \"kubernetes.io/projected/eba39b63-d903-41a6-8a7b-fd6f3ef121ae-kube-api-access-trj74\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl\" (UID: \"eba39b63-d903-41a6-8a7b-fd6f3ef121ae\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.445521 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.445429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:13.591485 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.591461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"]
Jul 22 01:39:13.593677 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:39:13.593645    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeba39b63_d903_41a6_8a7b_fd6f3ef121ae.slice/crio-68beaa7394d6f709b219532b743c69077bee1d8c4211d8a8aacc7be9e3e9f56f WatchSource:0}: Error finding container 68beaa7394d6f709b219532b743c69077bee1d8c4211d8a8aacc7be9e3e9f56f: Status 404 returned error can't find the container with id 68beaa7394d6f709b219532b743c69077bee1d8c4211d8a8aacc7be9e3e9f56f
Jul 22 01:39:13.801729 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:13.801686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl" event={"ID":"eba39b63-d903-41a6-8a7b-fd6f3ef121ae","Type":"ContainerStarted","Data":"68beaa7394d6f709b219532b743c69077bee1d8c4211d8a8aacc7be9e3e9f56f"}
Jul 22 01:39:14.808343 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:14.808307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl" event={"ID":"eba39b63-d903-41a6-8a7b-fd6f3ef121ae","Type":"ContainerStarted","Data":"a0f2faea1a002bf06be07f695a1dc9c06f771d3a840b1595eae15480bf5e7a2e"}
Jul 22 01:39:14.827862 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:14.827789    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl" podStartSLOduration=1.659296216 podStartE2EDuration="1.82777202s" totalImagesPullingTime="168.475804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:39:14.825746056 +0000 UTC m=+701.655682889" watchObservedRunningTime="2026-07-22 01:39:14.82777202 +0000 UTC m=+701.657708831"
Jul 22 01:39:15.736595 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:15.736554    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:15.736797 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:15.736621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:15.749522 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:15.749495    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:15.824575 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:15.824542    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-6cvx4"
Jul 22 01:39:23.446165 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:23.446110    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:23.446708 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:23.446188    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:23.458744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:23.458715    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:39:23.862277 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:39:23.862251    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl"
Jul 22 01:40:38.254196 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.254155    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:40:38.254715 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.254419    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6887b55f68-cwwpg" podUID="901362e0-9fbd-407f-a313-a2a97104c7bc" containerName="manager" containerID="cri-o://fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829" gracePeriod=30
Jul 22 01:40:38.510197 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.510122    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:40:38.592626 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.592595    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vlwx\" (UniqueName: \"kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx\") pod \"901362e0-9fbd-407f-a313-a2a97104c7bc\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") "
Jul 22 01:40:38.592626 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.592630    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert\") pod \"901362e0-9fbd-407f-a313-a2a97104c7bc\" (UID: \"901362e0-9fbd-407f-a313-a2a97104c7bc\") "
Jul 22 01:40:38.594744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.594709    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx" (OuterVolumeSpecName: "kube-api-access-8vlwx") pod "901362e0-9fbd-407f-a313-a2a97104c7bc" (UID: "901362e0-9fbd-407f-a313-a2a97104c7bc"). InnerVolumeSpecName "kube-api-access-8vlwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:40:38.594744 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.594715    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "901362e0-9fbd-407f-a313-a2a97104c7bc" (UID: "901362e0-9fbd-407f-a313-a2a97104c7bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:40:38.694147 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.694108    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vlwx\" (UniqueName: \"kubernetes.io/projected/901362e0-9fbd-407f-a313-a2a97104c7bc-kube-api-access-8vlwx\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:40:38.694311 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:38.694160    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/901362e0-9fbd-407f-a313-a2a97104c7bc-webhook-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:40:39.212910 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.212870    2559 generic.go:356] "Generic (PLEG): container finished" podID="901362e0-9fbd-407f-a313-a2a97104c7bc" containerID="fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829" exitCode=0
Jul 22 01:40:39.213086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.212924    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-cwwpg"
Jul 22 01:40:39.213086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.212957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-cwwpg" event={"ID":"901362e0-9fbd-407f-a313-a2a97104c7bc","Type":"ContainerDied","Data":"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"}
Jul 22 01:40:39.213086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.213031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-cwwpg" event={"ID":"901362e0-9fbd-407f-a313-a2a97104c7bc","Type":"ContainerDied","Data":"7a4686cf5a3e3c4dd085f7fbcd99d360f752dbd2709bda5aac0ac2ad778ff6ce"}
Jul 22 01:40:39.213086 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.213054    2559 scope.go:117] "RemoveContainer" containerID="fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"
Jul 22 01:40:39.223264 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.223249    2559 scope.go:117] "RemoveContainer" containerID="fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"
Jul 22 01:40:39.223511 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:40:39.223491    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829\": container with ID starting with fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829 not found: ID does not exist" containerID="fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"
Jul 22 01:40:39.223551 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.223519    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829"} err="failed to get container status \"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829\": rpc error: code = NotFound desc = could not find container \"fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829\": container with ID starting with fd42384e7151d34b1226bf50bde83284a4bae0d702d0e03450ac382996735829 not found: ID does not exist"
Jul 22 01:40:39.258636 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.258601    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:40:39.273698 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.273674    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6887b55f68-cwwpg"]
Jul 22 01:40:39.696496 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:40:39.696462    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="901362e0-9fbd-407f-a313-a2a97104c7bc" path="/var/lib/kubelet/pods/901362e0-9fbd-407f-a313-a2a97104c7bc/volumes"
Jul 22 01:41:40.144693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.144658    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:40.145099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.145029    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="901362e0-9fbd-407f-a313-a2a97104c7bc" containerName="manager"
Jul 22 01:41:40.145099 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.145040    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="901362e0-9fbd-407f-a313-a2a97104c7bc" containerName="manager"
Jul 22 01:41:40.145195 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.145100    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="901362e0-9fbd-407f-a313-a2a97104c7bc" containerName="manager"
Jul 22 01:41:40.149383 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.149368    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.152460 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.152434    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 01:41:40.152597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.152462    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gjqk6\""
Jul 22 01:41:40.152597 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.152445    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 01:41:40.157098 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.156647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:40.243713 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.243680    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r88rp\" (UniqueName: \"kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.243713 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.243719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.344506 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.344472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r88rp\" (UniqueName: \"kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.344506 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.344514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.347023 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.346994    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.354760 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.354733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r88rp\" (UniqueName: \"kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp\") pod \"maas-controller-6887b55f68-b2g75\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") " pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.462038 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.461940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:40.601906 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:40.601885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:40.603960 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:41:40.603931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4830af_23bf_43a6_945d_1846861687cd.slice/crio-51bd6f77e9d5d78b4e14d916b2119115e039bc6bedb9259a93952da7cbac43a4 WatchSource:0}: Error finding container 51bd6f77e9d5d78b4e14d916b2119115e039bc6bedb9259a93952da7cbac43a4: Status 404 returned error can't find the container with id 51bd6f77e9d5d78b4e14d916b2119115e039bc6bedb9259a93952da7cbac43a4
Jul 22 01:41:41.502819 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:41.502781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-b2g75" event={"ID":"db4830af-23bf-43a6-945d-1846861687cd","Type":"ContainerStarted","Data":"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"}
Jul 22 01:41:41.503229 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:41.502857    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:41.503229 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:41.502887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-b2g75" event={"ID":"db4830af-23bf-43a6-945d-1846861687cd","Type":"ContainerStarted","Data":"51bd6f77e9d5d78b4e14d916b2119115e039bc6bedb9259a93952da7cbac43a4"}
Jul 22 01:41:41.521452 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:41.521402    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6887b55f68-b2g75" podStartSLOduration=1.036535141 podStartE2EDuration="1.521384753s" totalImagesPullingTime="484.849612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:41:41.520634897 +0000 UTC m=+848.350571708" watchObservedRunningTime="2026-07-22 01:41:41.521384753 +0000 UTC m=+848.351321560"
Jul 22 01:41:52.510387 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:52.510351    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:57.285955 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.285918    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:57.286381 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.286110    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6887b55f68-b2g75" podUID="db4830af-23bf-43a6-945d-1846861687cd" containerName="manager" containerID="cri-o://29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6" gracePeriod=30
Jul 22 01:41:57.539719 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.539654    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:57.586316 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.586283    2559 generic.go:356] "Generic (PLEG): container finished" podID="db4830af-23bf-43a6-945d-1846861687cd" containerID="29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6" exitCode=0
Jul 22 01:41:57.586478 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.586345    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-b2g75"
Jul 22 01:41:57.586478 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.586352    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-b2g75" event={"ID":"db4830af-23bf-43a6-945d-1846861687cd","Type":"ContainerDied","Data":"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"}
Jul 22 01:41:57.586478 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.586460    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-b2g75" event={"ID":"db4830af-23bf-43a6-945d-1846861687cd","Type":"ContainerDied","Data":"51bd6f77e9d5d78b4e14d916b2119115e039bc6bedb9259a93952da7cbac43a4"}
Jul 22 01:41:57.586600 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.586492    2559 scope.go:117] "RemoveContainer" containerID="29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"
Jul 22 01:41:57.595066 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.595045    2559 scope.go:117] "RemoveContainer" containerID="29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"
Jul 22 01:41:57.595397 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:41:57.595375    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6\": container with ID starting with 29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6 not found: ID does not exist" containerID="29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"
Jul 22 01:41:57.595476 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.595409    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6"} err="failed to get container status \"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6\": rpc error: code = NotFound desc = could not find container \"29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6\": container with ID starting with 29a967f3f59a15fada7c54196cb469f7bb78632fcfca90f9c26bd95b0366a2f6 not found: ID does not exist"
Jul 22 01:41:57.597780 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.597757    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r88rp\" (UniqueName: \"kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp\") pod \"db4830af-23bf-43a6-945d-1846861687cd\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") "
Jul 22 01:41:57.597876 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.597806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert\") pod \"db4830af-23bf-43a6-945d-1846861687cd\" (UID: \"db4830af-23bf-43a6-945d-1846861687cd\") "
Jul 22 01:41:57.599943 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.599918    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "db4830af-23bf-43a6-945d-1846861687cd" (UID: "db4830af-23bf-43a6-945d-1846861687cd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:41:57.600038 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.599916    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp" (OuterVolumeSpecName: "kube-api-access-r88rp") pod "db4830af-23bf-43a6-945d-1846861687cd" (UID: "db4830af-23bf-43a6-945d-1846861687cd"). InnerVolumeSpecName "kube-api-access-r88rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:41:57.699194 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.699164    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r88rp\" (UniqueName: \"kubernetes.io/projected/db4830af-23bf-43a6-945d-1846861687cd-kube-api-access-r88rp\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:41:57.699194 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.699195    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db4830af-23bf-43a6-945d-1846861687cd-webhook-cert\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:41:57.909794 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.909763    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:57.915661 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:57.915637    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6887b55f68-b2g75"]
Jul 22 01:41:58.805386 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.805350    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6887b55f68-z9tpx"]
Jul 22 01:41:58.805923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.805902    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db4830af-23bf-43a6-945d-1846861687cd" containerName="manager"
Jul 22 01:41:58.805997 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.805927    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="db4830af-23bf-43a6-945d-1846861687cd" containerName="manager"
Jul 22 01:41:58.806070 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.806057    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="db4830af-23bf-43a6-945d-1846861687cd" containerName="manager"
Jul 22 01:41:58.809088 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.809066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:58.812206 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.812188    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 01:41:58.812317 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.812285    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gjqk6\""
Jul 22 01:41:58.813167 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.813149    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 01:41:58.825000 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.824974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-z9tpx"]
Jul 22 01:41:58.910066 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.910023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-webhook-cert\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:58.910298 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:58.910082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98pz9\" (UniqueName: \"kubernetes.io/projected/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-kube-api-access-98pz9\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.011515 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.011477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-webhook-cert\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.011693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.011531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98pz9\" (UniqueName: \"kubernetes.io/projected/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-kube-api-access-98pz9\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.014068 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.014033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-webhook-cert\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.022634 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.022604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98pz9\" (UniqueName: \"kubernetes.io/projected/ee82f2e6-1c69-44b7-82a3-1dc791d1a9be-kube-api-access-98pz9\") pod \"maas-controller-6887b55f68-z9tpx\" (UID: \"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be\") " pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.119043 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.119005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:41:59.268941 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.268917    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6887b55f68-z9tpx"]
Jul 22 01:41:59.270965 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:41:59.270931    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee82f2e6_1c69_44b7_82a3_1dc791d1a9be.slice/crio-cb2f4b3793e51d65e2441f5bfbb9e3e3393a444ba0105e5d2a8f18d8de6cb33d WatchSource:0}: Error finding container cb2f4b3793e51d65e2441f5bfbb9e3e3393a444ba0105e5d2a8f18d8de6cb33d: Status 404 returned error can't find the container with id cb2f4b3793e51d65e2441f5bfbb9e3e3393a444ba0105e5d2a8f18d8de6cb33d
Jul 22 01:41:59.597542 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.597445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-z9tpx" event={"ID":"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be","Type":"ContainerStarted","Data":"cb2f4b3793e51d65e2441f5bfbb9e3e3393a444ba0105e5d2a8f18d8de6cb33d"}
Jul 22 01:41:59.696040 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:41:59.696008    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db4830af-23bf-43a6-945d-1846861687cd" path="/var/lib/kubelet/pods/db4830af-23bf-43a6-945d-1846861687cd/volumes"
Jul 22 01:42:00.603684 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:00.603656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6887b55f68-z9tpx" event={"ID":"ee82f2e6-1c69-44b7-82a3-1dc791d1a9be","Type":"ContainerStarted","Data":"929c46a31302da7a67e3652f7de81ae881f25d973e835cf7ab14e29d65f895f6"}
Jul 22 01:42:00.604052 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:00.603788    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:42:00.621925 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:00.621878    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6887b55f68-z9tpx" podStartSLOduration=1.782269592 podStartE2EDuration="2.621861904s" totalImagesPullingTime="839.592312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:42:00.620202449 +0000 UTC m=+867.450139283" watchObservedRunningTime="2026-07-22 01:42:00.621861904 +0000 UTC m=+867.451798714"
Jul 22 01:42:11.611923 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:11.611889    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6887b55f68-z9tpx"
Jul 22 01:42:33.631217 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:33.631121    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:42:33.631685 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:42:33.631267    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:47:33.659666 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:47:33.659632    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:47:33.661213 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:47:33.661194    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:52:33.687527 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:52:33.687496    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:52:33.689655 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:52:33.689635    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:54:48.124980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.124896    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:54:48.128704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.128683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.131109 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.131084    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1afc4013-serving-cert\""
Jul 22 01:54:48.137074 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.137051    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:54:48.223103 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.223061    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.223308 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.223141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdb9g\" (UniqueName: \"kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.223308 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.223205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.324207 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.324160    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.324418 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.324220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdb9g\" (UniqueName: \"kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.324418 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.324289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.324918 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.324890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.326850 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.326831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.335277 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.335253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdb9g\" (UniqueName: \"kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g\") pod \"maas-api-e2e-ait-1afc4013-57868844cd-h6mk5\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.441280 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.441193    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:48.581634 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.581609    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:54:48.583792 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:54:48.583764    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6faffa4_6aad_4edc_bbcf_627e22099cfa.slice/crio-bc0468fc4ca44690a3b0c76aaa260450cf1087d6831748b203b65d71199e6a5b WatchSource:0}: Error finding container bc0468fc4ca44690a3b0c76aaa260450cf1087d6831748b203b65d71199e6a5b: Status 404 returned error can't find the container with id bc0468fc4ca44690a3b0c76aaa260450cf1087d6831748b203b65d71199e6a5b
Jul 22 01:54:48.585201 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:48.585182    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 01:54:49.259740 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:49.259704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" event={"ID":"b6faffa4-6aad-4edc-bbcf-627e22099cfa","Type":"ContainerStarted","Data":"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"}
Jul 22 01:54:49.260245 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:49.259759    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" event={"ID":"b6faffa4-6aad-4edc-bbcf-627e22099cfa","Type":"ContainerStarted","Data":"bc0468fc4ca44690a3b0c76aaa260450cf1087d6831748b203b65d71199e6a5b"}
Jul 22 01:54:49.260245 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:49.259806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:55.271293 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:55.271258    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:54:55.293607 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:54:55.293557    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" podStartSLOduration=6.7519725919999996 podStartE2EDuration="7.293541969s" totalImagesPullingTime="541.569377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:54:49.294743623 +0000 UTC m=+1636.124680453" watchObservedRunningTime="2026-07-22 01:54:55.293541969 +0000 UTC m=+1642.123478780"
Jul 22 01:55:24.376768 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.376728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:55:24.377327 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.377007    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" podUID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" containerName="maas-api" containerID="cri-o://1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015" gracePeriod=30
Jul 22 01:55:24.627345 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.627279    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:55:24.667875 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.667836    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls\") pod \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") "
Jul 22 01:55:24.668041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.667893    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdb9g\" (UniqueName: \"kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g\") pod \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") "
Jul 22 01:55:24.668041 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.667999    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca\") pod \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\" (UID: \"b6faffa4-6aad-4edc-bbcf-627e22099cfa\") "
Jul 22 01:55:24.668411 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.668377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6faffa4-6aad-4edc-bbcf-627e22099cfa" (UID: "b6faffa4-6aad-4edc-bbcf-627e22099cfa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:55:24.670326 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.670295    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6faffa4-6aad-4edc-bbcf-627e22099cfa" (UID: "b6faffa4-6aad-4edc-bbcf-627e22099cfa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:55:24.670425 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.670341    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g" (OuterVolumeSpecName: "kube-api-access-tdb9g") pod "b6faffa4-6aad-4edc-bbcf-627e22099cfa" (UID: "b6faffa4-6aad-4edc-bbcf-627e22099cfa"). InnerVolumeSpecName "kube-api-access-tdb9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:55:24.769504 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.769465    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6faffa4-6aad-4edc-bbcf-627e22099cfa-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:55:24.769504 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.769497    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdb9g\" (UniqueName: \"kubernetes.io/projected/b6faffa4-6aad-4edc-bbcf-627e22099cfa-kube-api-access-tdb9g\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:55:24.769504 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:24.769512    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6faffa4-6aad-4edc-bbcf-627e22099cfa-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:55:25.433176 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.433143    2559 generic.go:356] "Generic (PLEG): container finished" podID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" containerID="1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015" exitCode=0
Jul 22 01:55:25.433564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.433187    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"
Jul 22 01:55:25.433564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.433208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" event={"ID":"b6faffa4-6aad-4edc-bbcf-627e22099cfa","Type":"ContainerDied","Data":"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"}
Jul 22 01:55:25.433564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.433252    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5" event={"ID":"b6faffa4-6aad-4edc-bbcf-627e22099cfa","Type":"ContainerDied","Data":"bc0468fc4ca44690a3b0c76aaa260450cf1087d6831748b203b65d71199e6a5b"}
Jul 22 01:55:25.433564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.433272    2559 scope.go:117] "RemoveContainer" containerID="1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"
Jul 22 01:55:25.442960 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.442938    2559 scope.go:117] "RemoveContainer" containerID="1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"
Jul 22 01:55:25.443283 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:55:25.443265    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015\": container with ID starting with 1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015 not found: ID does not exist" containerID="1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"
Jul 22 01:55:25.443359 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.443300    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015"} err="failed to get container status \"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015\": rpc error: code = NotFound desc = could not find container \"1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015\": container with ID starting with 1c392df46d811b99438b44cd6ad9f9fea89adef35fd7dafcb7cae9ef491e2015 not found: ID does not exist"
Jul 22 01:55:25.455087 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.455055    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:55:25.461711 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.461684    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1afc4013-57868844cd-h6mk5"]
Jul 22 01:55:25.696998 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:25.696920    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" path="/var/lib/kubelet/pods/b6faffa4-6aad-4edc-bbcf-627e22099cfa/volumes"
Jul 22 01:55:35.875458 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.875421    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:55:35.875894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.875806    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" containerName="maas-api"
Jul 22 01:55:35.875894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.875816    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" containerName="maas-api"
Jul 22 01:55:35.875894 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.875888    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6faffa4-6aad-4edc-bbcf-627e22099cfa" containerName="maas-api"
Jul 22 01:55:35.879993 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.879974    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:35.883358 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.883337    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fffbfad3-serving-cert\""
Jul 22 01:55:35.892468 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.892442    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:55:35.983171 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.983108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbg6r\" (UniqueName: \"kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:35.983356 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.983239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:35.983356 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:35.983302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.084379 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.084335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbg6r\" (UniqueName: \"kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.084564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.084425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.084564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.084460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.084687 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:55:36.084586    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-serving-cert: secret "maas-api-e2e-migrate-fffbfad3-serving-cert" not found
Jul 22 01:55:36.084687 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:55:36.084652    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls podName:7971cc18-6394-4397-bead-16d69a766ba0 nodeName:}" failed. No retries permitted until 2026-07-22 01:55:36.584631274 +0000 UTC m=+1683.414568066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls") pod "maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" (UID: "7971cc18-6394-4397-bead-16d69a766ba0") : secret "maas-api-e2e-migrate-fffbfad3-serving-cert" not found
Jul 22 01:55:36.085109 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.085083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.092868 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.092841    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbg6r\" (UniqueName: \"kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.589372 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.589332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.591919 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.591894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") pod \"maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.792578 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.792543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:36.937908 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:36.937880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:55:36.940078 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:55:36.940051    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7971cc18_6394_4397_bead_16d69a766ba0.slice/crio-07d3e3413b444816d1e12aad74f9804afbc79501c1c3f83f1175613e28e4fcf7 WatchSource:0}: Error finding container 07d3e3413b444816d1e12aad74f9804afbc79501c1c3f83f1175613e28e4fcf7: Status 404 returned error can't find the container with id 07d3e3413b444816d1e12aad74f9804afbc79501c1c3f83f1175613e28e4fcf7
Jul 22 01:55:37.493340 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:37.493299    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" event={"ID":"7971cc18-6394-4397-bead-16d69a766ba0","Type":"ContainerStarted","Data":"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"}
Jul 22 01:55:37.493526 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:37.493362    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" event={"ID":"7971cc18-6394-4397-bead-16d69a766ba0","Type":"ContainerStarted","Data":"07d3e3413b444816d1e12aad74f9804afbc79501c1c3f83f1175613e28e4fcf7"}
Jul 22 01:55:37.493526 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:37.493406    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:55:37.510446 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:37.510390    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" podStartSLOduration=2.178154932 podStartE2EDuration="2.510375883s" totalImagesPullingTime="332.220951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:55:37.509586073 +0000 UTC m=+1684.339522884" watchObservedRunningTime="2026-07-22 01:55:37.510375883 +0000 UTC m=+1684.340312694"
Jul 22 01:55:43.504112 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:55:43.504082    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:56:11.329403 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.329368    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:56:11.329868 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.329564    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" podUID="7971cc18-6394-4397-bead-16d69a766ba0" containerName="maas-api" containerID="cri-o://5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b" gracePeriod=30
Jul 22 01:56:11.591325 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.591264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:56:11.658760 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.658722    2559 generic.go:356] "Generic (PLEG): container finished" podID="7971cc18-6394-4397-bead-16d69a766ba0" containerID="5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b" exitCode=0
Jul 22 01:56:11.658970 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.658773    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"
Jul 22 01:56:11.658970 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.658825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" event={"ID":"7971cc18-6394-4397-bead-16d69a766ba0","Type":"ContainerDied","Data":"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"}
Jul 22 01:56:11.658970 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.658898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz" event={"ID":"7971cc18-6394-4397-bead-16d69a766ba0","Type":"ContainerDied","Data":"07d3e3413b444816d1e12aad74f9804afbc79501c1c3f83f1175613e28e4fcf7"}
Jul 22 01:56:11.658970 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.658933    2559 scope.go:117] "RemoveContainer" containerID="5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"
Jul 22 01:56:11.668839 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.668819    2559 scope.go:117] "RemoveContainer" containerID="5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"
Jul 22 01:56:11.669122 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:56:11.669101    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b\": container with ID starting with 5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b not found: ID does not exist" containerID="5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"
Jul 22 01:56:11.669210 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.669151    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b"} err="failed to get container status \"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b\": rpc error: code = NotFound desc = could not find container \"5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b\": container with ID starting with 5bacfd53168828203924a975a69f581839b8c87c6ec134f21e69e520ad90155b not found: ID does not exist"
Jul 22 01:56:11.708693 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.708663    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca\") pod \"7971cc18-6394-4397-bead-16d69a766ba0\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") "
Jul 22 01:56:11.708877 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.708811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") pod \"7971cc18-6394-4397-bead-16d69a766ba0\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") "
Jul 22 01:56:11.708877 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.708845    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbg6r\" (UniqueName: \"kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r\") pod \"7971cc18-6394-4397-bead-16d69a766ba0\" (UID: \"7971cc18-6394-4397-bead-16d69a766ba0\") "
Jul 22 01:56:11.709020 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.708992    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7971cc18-6394-4397-bead-16d69a766ba0" (UID: "7971cc18-6394-4397-bead-16d69a766ba0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:56:11.709085 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.709067    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7971cc18-6394-4397-bead-16d69a766ba0-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:11.711082 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.711050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r" (OuterVolumeSpecName: "kube-api-access-sbg6r") pod "7971cc18-6394-4397-bead-16d69a766ba0" (UID: "7971cc18-6394-4397-bead-16d69a766ba0"). InnerVolumeSpecName "kube-api-access-sbg6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:56:11.711210 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.711090    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7971cc18-6394-4397-bead-16d69a766ba0" (UID: "7971cc18-6394-4397-bead-16d69a766ba0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:56:11.810599 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.810548    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7971cc18-6394-4397-bead-16d69a766ba0-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:11.810599 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.810590    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbg6r\" (UniqueName: \"kubernetes.io/projected/7971cc18-6394-4397-bead-16d69a766ba0-kube-api-access-sbg6r\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:11.981118 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.981079    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:56:11.982776 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:11.982753    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fffbfad3-6884d66bd6-9qkpz"]
Jul 22 01:56:13.696963 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:13.696922    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7971cc18-6394-4397-bead-16d69a766ba0" path="/var/lib/kubelet/pods/7971cc18-6394-4397-bead-16d69a766ba0/volumes"
Jul 22 01:56:19.635610 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.635576    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:19.636024 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.636010    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7971cc18-6394-4397-bead-16d69a766ba0" containerName="maas-api"
Jul 22 01:56:19.636084 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.636027    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7971cc18-6394-4397-bead-16d69a766ba0" containerName="maas-api"
Jul 22 01:56:19.636121 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.636091    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7971cc18-6394-4397-bead-16d69a766ba0" containerName="maas-api"
Jul 22 01:56:19.640573 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.640555    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.642832 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.642809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3247df58-serving-cert\""
Jul 22 01:56:19.651487 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.651459    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:19.787093 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.787052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbjx\" (UniqueName: \"kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.787313 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.787123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.787313 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.787227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.888395 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.888307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbjx\" (UniqueName: \"kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.888395 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.888360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.888594 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.888455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.889151 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.889071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.890886 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.890855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.897476 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.897445    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbjx\" (UniqueName: \"kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx\") pod \"maas-api-e2e-ait-3247df58-9557b6cf6-75z5b\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:19.952483 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:19.952452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:20.096725 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:20.096701    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:20.099333 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:56:20.099304    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9237ba26_c02e_48da_a09c_be7767d9bf01.slice/crio-24991fba1529fd48cb6947f11651720237ba9990a3e605f9d19cad7bd2270168 WatchSource:0}: Error finding container 24991fba1529fd48cb6947f11651720237ba9990a3e605f9d19cad7bd2270168: Status 404 returned error can't find the container with id 24991fba1529fd48cb6947f11651720237ba9990a3e605f9d19cad7bd2270168
Jul 22 01:56:20.713203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:20.713103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" event={"ID":"9237ba26-c02e-48da-a09c-be7767d9bf01","Type":"ContainerStarted","Data":"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"}
Jul 22 01:56:20.713203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:20.713179    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:20.713203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:20.713201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" event={"ID":"9237ba26-c02e-48da-a09c-be7767d9bf01","Type":"ContainerStarted","Data":"24991fba1529fd48cb6947f11651720237ba9990a3e605f9d19cad7bd2270168"}
Jul 22 01:56:20.743701 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:20.743648    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" podStartSLOduration=1.396104138 podStartE2EDuration="1.74363227s" totalImagesPullingTime="347.528132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:56:20.741893718 +0000 UTC m=+1727.571830539" watchObservedRunningTime="2026-07-22 01:56:20.74363227 +0000 UTC m=+1727.573569081"
Jul 22 01:56:26.724171 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:26.724113    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:56.046769 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.046728    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:56.047279 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.046969    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" podUID="9237ba26-c02e-48da-a09c-be7767d9bf01" containerName="maas-api" containerID="cri-o://52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff" gracePeriod=30
Jul 22 01:56:56.305637 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.305577    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:56.406641 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.406607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls\") pod \"9237ba26-c02e-48da-a09c-be7767d9bf01\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") "
Jul 22 01:56:56.406641 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.406648    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zbjx\" (UniqueName: \"kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx\") pod \"9237ba26-c02e-48da-a09c-be7767d9bf01\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") "
Jul 22 01:56:56.406834 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.406720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca\") pod \"9237ba26-c02e-48da-a09c-be7767d9bf01\" (UID: \"9237ba26-c02e-48da-a09c-be7767d9bf01\") "
Jul 22 01:56:56.407143 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.407108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9237ba26-c02e-48da-a09c-be7767d9bf01" (UID: "9237ba26-c02e-48da-a09c-be7767d9bf01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:56:56.408920 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.408897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx" (OuterVolumeSpecName: "kube-api-access-4zbjx") pod "9237ba26-c02e-48da-a09c-be7767d9bf01" (UID: "9237ba26-c02e-48da-a09c-be7767d9bf01"). InnerVolumeSpecName "kube-api-access-4zbjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:56:56.409055 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.409041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9237ba26-c02e-48da-a09c-be7767d9bf01" (UID: "9237ba26-c02e-48da-a09c-be7767d9bf01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:56:56.507787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.507756    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9237ba26-c02e-48da-a09c-be7767d9bf01-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:56.507787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.507787    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9237ba26-c02e-48da-a09c-be7767d9bf01-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:56.507787 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.507801    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zbjx\" (UniqueName: \"kubernetes.io/projected/9237ba26-c02e-48da-a09c-be7767d9bf01-kube-api-access-4zbjx\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:56:56.885066 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.885035    2559 generic.go:356] "Generic (PLEG): container finished" podID="9237ba26-c02e-48da-a09c-be7767d9bf01" containerID="52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff" exitCode=0
Jul 22 01:56:56.885066 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.885072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" event={"ID":"9237ba26-c02e-48da-a09c-be7767d9bf01","Type":"ContainerDied","Data":"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"}
Jul 22 01:56:56.885066 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.885078    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"
Jul 22 01:56:56.885397 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.885116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b" event={"ID":"9237ba26-c02e-48da-a09c-be7767d9bf01","Type":"ContainerDied","Data":"24991fba1529fd48cb6947f11651720237ba9990a3e605f9d19cad7bd2270168"}
Jul 22 01:56:56.885397 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.885159    2559 scope.go:117] "RemoveContainer" containerID="52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"
Jul 22 01:56:56.894749 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.894732    2559 scope.go:117] "RemoveContainer" containerID="52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"
Jul 22 01:56:56.895018 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:56:56.894998    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff\": container with ID starting with 52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff not found: ID does not exist" containerID="52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"
Jul 22 01:56:56.895083 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.895026    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff"} err="failed to get container status \"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff\": rpc error: code = NotFound desc = could not find container \"52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff\": container with ID starting with 52b3eda1ffecf0ffcfa56132dd9c1f3e8475b4524a647ace43cc65f2f0c4e3ff not found: ID does not exist"
Jul 22 01:56:56.914819 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.912221    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:56.916721 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:56.916696    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3247df58-9557b6cf6-75z5b"]
Jul 22 01:56:57.697143 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:56:57.697105    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9237ba26-c02e-48da-a09c-be7767d9bf01" path="/var/lib/kubelet/pods/9237ba26-c02e-48da-a09c-be7767d9bf01/volumes"
Jul 22 01:57:05.319581 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.319547    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:05.319978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.319923    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9237ba26-c02e-48da-a09c-be7767d9bf01" containerName="maas-api"
Jul 22 01:57:05.319978 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.319936    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9237ba26-c02e-48da-a09c-be7767d9bf01" containerName="maas-api"
Jul 22 01:57:05.320060 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.320017    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9237ba26-c02e-48da-a09c-be7767d9bf01" containerName="maas-api"
Jul 22 01:57:05.322796 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.322774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.324851 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.324826    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9db3f612-serving-cert\""
Jul 22 01:57:05.333564 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.333535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:05.389580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.389546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.389580 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.389585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.389791 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.389735    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvlp\" (UniqueName: \"kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.491100 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.491064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvlp\" (UniqueName: \"kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.491314 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.491122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.491314 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.491195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.491314 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:57:05.491262    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-serving-cert: secret "maas-api-e2e-derive-9db3f612-serving-cert" not found
Jul 22 01:57:05.491431 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:57:05.491339    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls podName:f4909528-5f32-403e-9536-85fd8338b3f7 nodeName:}" failed. No retries permitted until 2026-07-22 01:57:05.991319109 +0000 UTC m=+1772.821255921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls") pod "maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" (UID: "f4909528-5f32-403e-9536-85fd8338b3f7") : secret "maas-api-e2e-derive-9db3f612-serving-cert" not found
Jul 22 01:57:05.491890 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.491871    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.502428 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.502396    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvlp\" (UniqueName: \"kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.996383 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.996342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:05.998917 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:05.998887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") pod \"maas-api-e2e-derive-9db3f612-695bb895c-xvvg4\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:06.234706 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.234670    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:06.378684 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.378645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:06.380726 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:57:06.380699    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4909528_5f32_403e_9536_85fd8338b3f7.slice/crio-f364cd0ac34e4d02208b6a6887af7e5cbca9cbdd9624fa2fb471b77686f6f82d WatchSource:0}: Error finding container f364cd0ac34e4d02208b6a6887af7e5cbca9cbdd9624fa2fb471b77686f6f82d: Status 404 returned error can't find the container with id f364cd0ac34e4d02208b6a6887af7e5cbca9cbdd9624fa2fb471b77686f6f82d
Jul 22 01:57:06.935555 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.935527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" event={"ID":"f4909528-5f32-403e-9536-85fd8338b3f7","Type":"ContainerStarted","Data":"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"}
Jul 22 01:57:06.935700 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.935588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" event={"ID":"f4909528-5f32-403e-9536-85fd8338b3f7","Type":"ContainerStarted","Data":"f364cd0ac34e4d02208b6a6887af7e5cbca9cbdd9624fa2fb471b77686f6f82d"}
Jul 22 01:57:06.935700 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.935620    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:06.952983 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:06.952933    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" podStartSLOduration=1.478254015 podStartE2EDuration="1.952918386s" totalImagesPullingTime="474.664371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:57:06.951809213 +0000 UTC m=+1773.781746025" watchObservedRunningTime="2026-07-22 01:57:06.952918386 +0000 UTC m=+1773.782855251"
Jul 22 01:57:12.945620 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:12.945588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:33.716204 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:33.716171    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:57:33.719760 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:33.719740    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 01:57:40.637988 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:40.637933    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:40.638828 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:40.638763    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" podUID="f4909528-5f32-403e-9536-85fd8338b3f7" containerName="maas-api" containerID="cri-o://852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554" gracePeriod=30
Jul 22 01:57:40.896832 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:40.896773    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:41.028621 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.028585    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca\") pod \"f4909528-5f32-403e-9536-85fd8338b3f7\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") "
Jul 22 01:57:41.028621 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.028632    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcvlp\" (UniqueName: \"kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp\") pod \"f4909528-5f32-403e-9536-85fd8338b3f7\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") "
Jul 22 01:57:41.028883 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.028680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") pod \"f4909528-5f32-403e-9536-85fd8338b3f7\" (UID: \"f4909528-5f32-403e-9536-85fd8338b3f7\") "
Jul 22 01:57:41.029034 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.029010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4909528-5f32-403e-9536-85fd8338b3f7" (UID: "f4909528-5f32-403e-9536-85fd8338b3f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:57:41.031035 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.031010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4909528-5f32-403e-9536-85fd8338b3f7" (UID: "f4909528-5f32-403e-9536-85fd8338b3f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:57:41.031171 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.031100    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp" (OuterVolumeSpecName: "kube-api-access-rcvlp") pod "f4909528-5f32-403e-9536-85fd8338b3f7" (UID: "f4909528-5f32-403e-9536-85fd8338b3f7"). InnerVolumeSpecName "kube-api-access-rcvlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:57:41.101518 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.101473    2559 generic.go:356] "Generic (PLEG): container finished" podID="f4909528-5f32-403e-9536-85fd8338b3f7" containerID="852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554" exitCode=0
Jul 22 01:57:41.101710 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.101523    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"
Jul 22 01:57:41.101710 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.101563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" event={"ID":"f4909528-5f32-403e-9536-85fd8338b3f7","Type":"ContainerDied","Data":"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"}
Jul 22 01:57:41.101710 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.101617    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4" event={"ID":"f4909528-5f32-403e-9536-85fd8338b3f7","Type":"ContainerDied","Data":"f364cd0ac34e4d02208b6a6887af7e5cbca9cbdd9624fa2fb471b77686f6f82d"}
Jul 22 01:57:41.101710 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.101639    2559 scope.go:117] "RemoveContainer" containerID="852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"
Jul 22 01:57:41.111052 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.111033    2559 scope.go:117] "RemoveContainer" containerID="852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"
Jul 22 01:57:41.111336 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:57:41.111317    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554\": container with ID starting with 852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554 not found: ID does not exist" containerID="852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"
Jul 22 01:57:41.111418 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.111348    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554"} err="failed to get container status \"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554\": rpc error: code = NotFound desc = could not find container \"852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554\": container with ID starting with 852ead996cd7e6fc2e78721bfa8d00cce25d8263cd29ea052ce73c6244687554 not found: ID does not exist"
Jul 22 01:57:41.121630 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.121605    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:41.125410 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.125387    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9db3f612-695bb895c-xvvg4"]
Jul 22 01:57:41.129515 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.129497    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4909528-5f32-403e-9536-85fd8338b3f7-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:57:41.129581 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.129520    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcvlp\" (UniqueName: \"kubernetes.io/projected/f4909528-5f32-403e-9536-85fd8338b3f7-kube-api-access-rcvlp\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:57:41.129581 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.129537    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4909528-5f32-403e-9536-85fd8338b3f7-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:57:41.696028 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:57:41.695992    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4909528-5f32-403e-9536-85fd8338b3f7" path="/var/lib/kubelet/pods/f4909528-5f32-403e-9536-85fd8338b3f7/volumes"
Jul 22 01:59:27.513858 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.513824    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:27.514650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.514216    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4909528-5f32-403e-9536-85fd8338b3f7" containerName="maas-api"
Jul 22 01:59:27.514650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.514229    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4909528-5f32-403e-9536-85fd8338b3f7" containerName="maas-api"
Jul 22 01:59:27.514650 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.514319    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4909528-5f32-403e-9536-85fd8338b3f7" containerName="maas-api"
Jul 22 01:59:27.517609 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.517589    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.519662 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.519638    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9d2d152a-serving-cert\""
Jul 22 01:59:27.532178 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.532121    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:27.609786 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.609743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdmhb\" (UniqueName: \"kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.609980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.609853    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.609980 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.609964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.710590 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.710551    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.710793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.710646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.710793 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:59:27.710688    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-serving-cert: secret "maas-api-e2e-mt-9d2d152a-serving-cert" not found
Jul 22 01:59:27.710793 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.710715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdmhb\" (UniqueName: \"kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.710793 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:59:27.710749    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls podName:b7cdefdd-6231-4dfa-ba8c-1bc63dca0418 nodeName:}" failed. No retries permitted until 2026-07-22 01:59:28.21073207 +0000 UTC m=+1915.040668858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls") pod "maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" (UID: "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418") : secret "maas-api-e2e-mt-9d2d152a-serving-cert" not found
Jul 22 01:59:27.711401 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.711376    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:27.719237 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:27.719214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdmhb\" (UniqueName: \"kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:28.225203 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:28.225155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:28.227686 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:28.227658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") pod \"maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:28.432225 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:28.432191    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:28.578497 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:28.578382    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:28.585340 ip-10-0-135-67 kubenswrapper[2559]: W0722 01:59:28.585304    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7cdefdd_6231_4dfa_ba8c_1bc63dca0418.slice/crio-e6a451ee44ec1b7dd76c48e60da8a4cf2e6c9ec1e175343f7af0fe5d8363cf0e WatchSource:0}: Error finding container e6a451ee44ec1b7dd76c48e60da8a4cf2e6c9ec1e175343f7af0fe5d8363cf0e: Status 404 returned error can't find the container with id e6a451ee44ec1b7dd76c48e60da8a4cf2e6c9ec1e175343f7af0fe5d8363cf0e
Jul 22 01:59:28.631439 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:28.631400    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" event={"ID":"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418","Type":"ContainerStarted","Data":"e6a451ee44ec1b7dd76c48e60da8a4cf2e6c9ec1e175343f7af0fe5d8363cf0e"}
Jul 22 01:59:29.639091 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:29.639053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" event={"ID":"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418","Type":"ContainerStarted","Data":"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"}
Jul 22 01:59:29.639507 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:29.639167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:29.656919 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:29.656868    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" podStartSLOduration=2.180324029 podStartE2EDuration="2.656852814s" totalImagesPullingTime="476.528785ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 01:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 01:59:29.655506777 +0000 UTC m=+1916.485443589" watchObservedRunningTime="2026-07-22 01:59:29.656852814 +0000 UTC m=+1916.486789653"
Jul 22 01:59:35.649676 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:35.649643    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:50.163069 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.163029    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:50.165653 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.163317    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" podUID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" containerName="maas-api" containerID="cri-o://450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd" gracePeriod=30
Jul 22 01:59:50.425626 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.425565    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:50.529931 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.529886    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca\") pod \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") "
Jul 22 01:59:50.530169 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.530038    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdmhb\" (UniqueName: \"kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb\") pod \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") "
Jul 22 01:59:50.530169 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.530067    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") pod \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\" (UID: \"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418\") "
Jul 22 01:59:50.530361 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.530331    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" (UID: "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 01:59:50.532359 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.532324    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb" (OuterVolumeSpecName: "kube-api-access-gdmhb") pod "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" (UID: "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418"). InnerVolumeSpecName "kube-api-access-gdmhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 01:59:50.532470 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.532373    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" (UID: "b7cdefdd-6231-4dfa-ba8c-1bc63dca0418"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 01:59:50.631407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.631363    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:59:50.631407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.631397    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdmhb\" (UniqueName: \"kubernetes.io/projected/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-kube-api-access-gdmhb\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:59:50.631407 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.631407    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 01:59:50.737704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.737616    2559 generic.go:356] "Generic (PLEG): container finished" podID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" containerID="450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd" exitCode=0
Jul 22 01:59:50.737704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.737649    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" event={"ID":"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418","Type":"ContainerDied","Data":"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"}
Jul 22 01:59:50.737704 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.737702    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f" event={"ID":"b7cdefdd-6231-4dfa-ba8c-1bc63dca0418","Type":"ContainerDied","Data":"e6a451ee44ec1b7dd76c48e60da8a4cf2e6c9ec1e175343f7af0fe5d8363cf0e"}
Jul 22 01:59:50.737932 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.737723    2559 scope.go:117] "RemoveContainer" containerID="450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"
Jul 22 01:59:50.737932 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.737659    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"
Jul 22 01:59:50.747703 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.747685    2559 scope.go:117] "RemoveContainer" containerID="450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"
Jul 22 01:59:50.748026 ip-10-0-135-67 kubenswrapper[2559]: E0722 01:59:50.748008    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd\": container with ID starting with 450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd not found: ID does not exist" containerID="450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"
Jul 22 01:59:50.748071 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.748036    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd"} err="failed to get container status \"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd\": rpc error: code = NotFound desc = could not find container \"450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd\": container with ID starting with 450f0df009e201303d6091dd451f226f6378cbcb8d5f1c768c508d2d2ecf48cd not found: ID does not exist"
Jul 22 01:59:50.760227 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.760195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:50.765397 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:50.765367    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9d2d152a-594d57d8f8-8226f"]
Jul 22 01:59:51.696771 ip-10-0-135-67 kubenswrapper[2559]: I0722 01:59:51.696725    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" path="/var/lib/kubelet/pods/b7cdefdd-6231-4dfa-ba8c-1bc63dca0418/volumes"
Jul 22 02:00:24.823484 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.823447    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:00:24.823959 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.823805    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" containerName="maas-api"
Jul 22 02:00:24.823959 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.823818    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" containerName="maas-api"
Jul 22 02:00:24.823959 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.823890    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7cdefdd-6231-4dfa-ba8c-1bc63dca0418" containerName="maas-api"
Jul 22 02:00:24.827112 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.827097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.829288 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.829267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7e4a4670-serving-cert\""
Jul 22 02:00:24.834921 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.834896    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:00:24.846400 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.846364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.846541 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.846482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.846541 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.846517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbfrv\" (UniqueName: \"kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.947006 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.946974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.947238 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.947093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.947238 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.947123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbfrv\" (UniqueName: \"kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.947369 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:00:24.947272    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-serving-cert: secret "maas-api-e2e-mt-7e4a4670-serving-cert" not found
Jul 22 02:00:24.947369 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:00:24.947365    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls podName:4a9a9476-3cec-4d7a-82c1-2ee462bc7401 nodeName:}" failed. No retries permitted until 2026-07-22 02:00:25.447343651 +0000 UTC m=+1972.277280444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls") pod "maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" (UID: "4a9a9476-3cec-4d7a-82c1-2ee462bc7401") : secret "maas-api-e2e-mt-7e4a4670-serving-cert" not found
Jul 22 02:00:24.947723 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.947701    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:24.957600 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:24.957577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbfrv\" (UniqueName: \"kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:25.452238 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:25.452143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:25.454984 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:25.454957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") pod \"maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:25.738846 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:25.738757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:25.905168 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:25.905117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:00:25.907420 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:00:25.907391    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a9a9476_3cec_4d7a_82c1_2ee462bc7401.slice/crio-0ef67d0a56416d43b31b961acd7b54e8c923790d8a4620d54b79baa0972230a7 WatchSource:0}: Error finding container 0ef67d0a56416d43b31b961acd7b54e8c923790d8a4620d54b79baa0972230a7: Status 404 returned error can't find the container with id 0ef67d0a56416d43b31b961acd7b54e8c923790d8a4620d54b79baa0972230a7
Jul 22 02:00:25.908665 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:25.908648    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:00:26.913464 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:26.913432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" event={"ID":"4a9a9476-3cec-4d7a-82c1-2ee462bc7401","Type":"ContainerStarted","Data":"0ef67d0a56416d43b31b961acd7b54e8c923790d8a4620d54b79baa0972230a7"}
Jul 22 02:00:30.935583 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:30.935539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" event={"ID":"4a9a9476-3cec-4d7a-82c1-2ee462bc7401","Type":"ContainerStarted","Data":"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"}
Jul 22 02:00:30.935968 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:30.935629    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:00:30.955192 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:30.955122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" podStartSLOduration=2.988731754 podStartE2EDuration="6.955107669s" totalImagesPullingTime="3.966375915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:00:30.95238848 +0000 UTC m=+1977.782325303" watchObservedRunningTime="2026-07-22 02:00:30.955107669 +0000 UTC m=+1977.785044480"
Jul 22 02:00:36.945813 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:00:36.945785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:01:33.843581 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:33.843547    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:01:33.844156 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:33.843790    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" podUID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" containerName="maas-api" containerID="cri-o://a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1" gracePeriod=30
Jul 22 02:01:34.097364 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.097299    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:01:34.185409 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.185376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbfrv\" (UniqueName: \"kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv\") pod \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") "
Jul 22 02:01:34.185588 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.185431    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca\") pod \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") "
Jul 22 02:01:34.185588 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.185490    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") pod \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\" (UID: \"4a9a9476-3cec-4d7a-82c1-2ee462bc7401\") "
Jul 22 02:01:34.185847 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.185814    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a9a9476-3cec-4d7a-82c1-2ee462bc7401" (UID: "4a9a9476-3cec-4d7a-82c1-2ee462bc7401"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:01:34.187851 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.187825    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a9a9476-3cec-4d7a-82c1-2ee462bc7401" (UID: "4a9a9476-3cec-4d7a-82c1-2ee462bc7401"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:01:34.187851 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.187831    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv" (OuterVolumeSpecName: "kube-api-access-kbfrv") pod "4a9a9476-3cec-4d7a-82c1-2ee462bc7401" (UID: "4a9a9476-3cec-4d7a-82c1-2ee462bc7401"). InnerVolumeSpecName "kube-api-access-kbfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:01:34.245785 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.245751    2559 generic.go:356] "Generic (PLEG): container finished" podID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" containerID="a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1" exitCode=0
Jul 22 02:01:34.245939 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.245825    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"
Jul 22 02:01:34.245939 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.245832    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" event={"ID":"4a9a9476-3cec-4d7a-82c1-2ee462bc7401","Type":"ContainerDied","Data":"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"}
Jul 22 02:01:34.245939 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.245914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9" event={"ID":"4a9a9476-3cec-4d7a-82c1-2ee462bc7401","Type":"ContainerDied","Data":"0ef67d0a56416d43b31b961acd7b54e8c923790d8a4620d54b79baa0972230a7"}
Jul 22 02:01:34.246042 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.245940    2559 scope.go:117] "RemoveContainer" containerID="a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"
Jul 22 02:01:34.260742 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.260719    2559 scope.go:117] "RemoveContainer" containerID="a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"
Jul 22 02:01:34.261198 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:01:34.261173    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1\": container with ID starting with a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1 not found: ID does not exist" containerID="a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"
Jul 22 02:01:34.261332 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.261205    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1"} err="failed to get container status \"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1\": rpc error: code = NotFound desc = could not find container \"a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1\": container with ID starting with a6c8acfff947126e54ae47b0d9152e9229638b0200c9e0a54c690e930ff6aba1 not found: ID does not exist"
Jul 22 02:01:34.277550 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.277520    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:01:34.281313 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.281293    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7e4a4670-6b58557f8d-vgkd9"]
Jul 22 02:01:34.286748 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.286729    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbfrv\" (UniqueName: \"kubernetes.io/projected/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-kube-api-access-kbfrv\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:01:34.286824 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.286751    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:01:34.286824 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:34.286763    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a9a9476-3cec-4d7a-82c1-2ee462bc7401-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:01:35.695890 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:01:35.695855    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" path="/var/lib/kubelet/pods/4a9a9476-3cec-4d7a-82c1-2ee462bc7401/volumes"
Jul 22 02:02:33.746898 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:02:33.746869    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:02:33.749900 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:02:33.749876    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:03:29.735839 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.735758    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:03:29.736423 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.736274    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" containerName="maas-api"
Jul 22 02:03:29.736423 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.736295    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" containerName="maas-api"
Jul 22 02:03:29.736556 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.736431    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a9a9476-3cec-4d7a-82c1-2ee462bc7401" containerName="maas-api"
Jul 22 02:03:29.739331 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.739312    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.741698 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.741674    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-cf99ea-serving-cert\""
Jul 22 02:03:29.751140 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.751098    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:03:29.834718 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.834681    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbmj\" (UniqueName: \"kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.834970 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.834857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.834970 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.834932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.935839 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.935791    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.936045 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.935860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbmj\" (UniqueName: \"kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.936045 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.935951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.936609 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.936584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.938412 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.938386    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:29.943955 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:29.943930    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbmj\" (UniqueName: \"kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj\") pod \"maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:30.054100 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:30.053999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:30.206696 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:30.206668    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:03:30.208806 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:03:30.208777    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81b3388_9a95_4225_a8e7_e81fd0167311.slice/crio-e2f2df4281a5faa052c1ed56b22cd992f335864991e68dd1f4c8d06d1b065a0c WatchSource:0}: Error finding container e2f2df4281a5faa052c1ed56b22cd992f335864991e68dd1f4c8d06d1b065a0c: Status 404 returned error can't find the container with id e2f2df4281a5faa052c1ed56b22cd992f335864991e68dd1f4c8d06d1b065a0c
Jul 22 02:03:30.817796 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:30.817764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" event={"ID":"b81b3388-9a95-4225-a8e7-e81fd0167311","Type":"ContainerStarted","Data":"e2f2df4281a5faa052c1ed56b22cd992f335864991e68dd1f4c8d06d1b065a0c"}
Jul 22 02:03:31.824856 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:31.824816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" event={"ID":"b81b3388-9a95-4225-a8e7-e81fd0167311","Type":"ContainerStarted","Data":"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"}
Jul 22 02:03:31.825293 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:31.824953    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:31.844351 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:31.844292    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" podStartSLOduration=2.28934721 podStartE2EDuration="2.844275852s" totalImagesPullingTime="554.928642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:03:31.842429206 +0000 UTC m=+2158.672366018" watchObservedRunningTime="2026-07-22 02:03:31.844275852 +0000 UTC m=+2158.674212663"
Jul 22 02:03:37.690357 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.690319    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:03:37.694615 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.694585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.697868 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.697829    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-207f15-serving-cert\""
Jul 22 02:03:37.707459 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.707431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:03:37.707802 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.707773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.707992 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.707964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.708189 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.708166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4h8m\" (UniqueName: \"kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.809040 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.809002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.809277 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.809098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4h8m\" (UniqueName: \"kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.809277 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:03:37.809211    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-serving-cert: secret "maas-api-e2e-inf-b-207f15-serving-cert" not found
Jul 22 02:03:37.809277 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.809265    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.809515 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:03:37.809297    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls podName:7188de6d-7708-4b75-9bb0-a76dd43962f4 nodeName:}" failed. No retries permitted until 2026-07-22 02:03:38.309276515 +0000 UTC m=+2165.139213308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls") pod "maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" (UID: "7188de6d-7708-4b75-9bb0-a76dd43962f4") : secret "maas-api-e2e-inf-b-207f15-serving-cert" not found
Jul 22 02:03:37.809970 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.809952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.817939 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.817916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4h8m\" (UniqueName: \"kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:37.835848 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:37.835822    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:03:38.314193 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:38.314122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:38.316830 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:38.316802    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-207f15-8d5874748-fpxb8\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:38.608927 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:38.608903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:38.751586 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:38.751549    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:03:38.756056 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:03:38.756021    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7188de6d_7708_4b75_9bb0_a76dd43962f4.slice/crio-d7b3e1d10d15ceec11d5ce73d579d60e20dd4e6ca589dc66c6505445f3a73c32 WatchSource:0}: Error finding container d7b3e1d10d15ceec11d5ce73d579d60e20dd4e6ca589dc66c6505445f3a73c32: Status 404 returned error can't find the container with id d7b3e1d10d15ceec11d5ce73d579d60e20dd4e6ca589dc66c6505445f3a73c32
Jul 22 02:03:38.868388 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:38.868303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" event={"ID":"7188de6d-7708-4b75-9bb0-a76dd43962f4","Type":"ContainerStarted","Data":"d7b3e1d10d15ceec11d5ce73d579d60e20dd4e6ca589dc66c6505445f3a73c32"}
Jul 22 02:03:39.874335 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:39.874303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" event={"ID":"7188de6d-7708-4b75-9bb0-a76dd43962f4","Type":"ContainerStarted","Data":"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"}
Jul 22 02:03:39.874769 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:39.874416    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:03:39.897433 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:39.897382    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" podStartSLOduration=2.560114883 podStartE2EDuration="2.897366182s" totalImagesPullingTime="337.251299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:03:39.896061477 +0000 UTC m=+2166.725998288" watchObservedRunningTime="2026-07-22 02:03:39.897366182 +0000 UTC m=+2166.727302999"
Jul 22 02:03:45.884783 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:03:45.884754    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:05:24.404816 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.404779    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:05:24.407441 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.405026    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" podUID="b81b3388-9a95-4225-a8e7-e81fd0167311" containerName="maas-api" containerID="cri-o://0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2" gracePeriod=30
Jul 22 02:05:24.664039 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.663964    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:05:24.706876 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.706831    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls\") pod \"b81b3388-9a95-4225-a8e7-e81fd0167311\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") "
Jul 22 02:05:24.707055 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.706914    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djbmj\" (UniqueName: \"kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj\") pod \"b81b3388-9a95-4225-a8e7-e81fd0167311\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") "
Jul 22 02:05:24.707055 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.707021    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca\") pod \"b81b3388-9a95-4225-a8e7-e81fd0167311\" (UID: \"b81b3388-9a95-4225-a8e7-e81fd0167311\") "
Jul 22 02:05:24.707480 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.707446    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b81b3388-9a95-4225-a8e7-e81fd0167311" (UID: "b81b3388-9a95-4225-a8e7-e81fd0167311"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:05:24.709217 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.709183    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj" (OuterVolumeSpecName: "kube-api-access-djbmj") pod "b81b3388-9a95-4225-a8e7-e81fd0167311" (UID: "b81b3388-9a95-4225-a8e7-e81fd0167311"). InnerVolumeSpecName "kube-api-access-djbmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:05:24.709336 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.709240    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b81b3388-9a95-4225-a8e7-e81fd0167311" (UID: "b81b3388-9a95-4225-a8e7-e81fd0167311"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:05:24.807913 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.807871    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djbmj\" (UniqueName: \"kubernetes.io/projected/b81b3388-9a95-4225-a8e7-e81fd0167311-kube-api-access-djbmj\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:24.807913 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.807908    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b81b3388-9a95-4225-a8e7-e81fd0167311-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:24.807913 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:24.807919    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b81b3388-9a95-4225-a8e7-e81fd0167311-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:25.394556 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.394519    2559 generic.go:356] "Generic (PLEG): container finished" podID="b81b3388-9a95-4225-a8e7-e81fd0167311" containerID="0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2" exitCode=0
Jul 22 02:05:25.394751 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.394571    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"
Jul 22 02:05:25.394751 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.394581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" event={"ID":"b81b3388-9a95-4225-a8e7-e81fd0167311","Type":"ContainerDied","Data":"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"}
Jul 22 02:05:25.394751 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.394637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj" event={"ID":"b81b3388-9a95-4225-a8e7-e81fd0167311","Type":"ContainerDied","Data":"e2f2df4281a5faa052c1ed56b22cd992f335864991e68dd1f4c8d06d1b065a0c"}
Jul 22 02:05:25.394751 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.394667    2559 scope.go:117] "RemoveContainer" containerID="0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"
Jul 22 02:05:25.404465 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.404442    2559 scope.go:117] "RemoveContainer" containerID="0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"
Jul 22 02:05:25.404747 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:05:25.404728    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2\": container with ID starting with 0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2 not found: ID does not exist" containerID="0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"
Jul 22 02:05:25.404804 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.404756    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2"} err="failed to get container status \"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2\": rpc error: code = NotFound desc = could not find container \"0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2\": container with ID starting with 0b2eb3c5d8daa496d98fcf78b1d6d6292f581a801bc39c00854b553d383ff4e2 not found: ID does not exist"
Jul 22 02:05:25.421737 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.421707    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:05:25.425603 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.425574    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-cf99ea-78f98c48c9-ngpwj"]
Jul 22 02:05:25.696351 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:25.696270    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b81b3388-9a95-4225-a8e7-e81fd0167311" path="/var/lib/kubelet/pods/b81b3388-9a95-4225-a8e7-e81fd0167311/volumes"
Jul 22 02:05:36.125465 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.125429    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"]
Jul 22 02:05:36.125847 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.125816    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b81b3388-9a95-4225-a8e7-e81fd0167311" containerName="maas-api"
Jul 22 02:05:36.125847 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.125826    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b81b3388-9a95-4225-a8e7-e81fd0167311" containerName="maas-api"
Jul 22 02:05:36.125919 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.125903    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b81b3388-9a95-4225-a8e7-e81fd0167311" containerName="maas-api"
Jul 22 02:05:36.130404 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.130386    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:36.132598 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.132573    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-twths\""
Jul 22 02:05:36.137949 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.137789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"]
Jul 22 02:05:36.222632 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.222591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-207f15-dct9h\" (UID: \"04672f46-c0de-402e-8456-3037d9a7c4d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:36.324162 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.324087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-207f15-dct9h\" (UID: \"04672f46-c0de-402e-8456-3037d9a7c4d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:36.324741 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.324721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-207f15-dct9h\" (UID: \"04672f46-c0de-402e-8456-3037d9a7c4d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:36.442279 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.442180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:36.584771 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.584746    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"]
Jul 22 02:05:36.587276 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:05:36.587249    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04672f46_c0de_402e_8456_3037d9a7c4d8.slice/crio-a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79 WatchSource:0}: Error finding container a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79: Status 404 returned error can't find the container with id a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79
Jul 22 02:05:36.589560 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:36.589543    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 02:05:37.457422 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:37.457380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h" event={"ID":"04672f46-c0de-402e-8456-3037d9a7c4d8","Type":"ContainerStarted","Data":"a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79"}
Jul 22 02:05:39.470879 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:39.470845    2559 generic.go:356] "Generic (PLEG): container finished" podID="04672f46-c0de-402e-8456-3037d9a7c4d8" containerID="87cc9a594b8e08a79cf7c0c2fbbe7cf9b22f218313d827888213bf2d4626fc46" exitCode=0
Jul 22 02:05:39.471324 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:39.470969    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h" event={"ID":"04672f46-c0de-402e-8456-3037d9a7c4d8","Type":"ContainerDied","Data":"87cc9a594b8e08a79cf7c0c2fbbe7cf9b22f218313d827888213bf2d4626fc46"}
Jul 22 02:05:40.618650 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:40.618622    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:40.768733 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:40.768640    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca\") pod \"04672f46-c0de-402e-8456-3037d9a7c4d8\" (UID: \"04672f46-c0de-402e-8456-3037d9a7c4d8\") "
Jul 22 02:05:40.769018 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:40.768995    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04672f46-c0de-402e-8456-3037d9a7c4d8" (UID: "04672f46-c0de-402e-8456-3037d9a7c4d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:05:40.870076 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:40.870018    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04672f46-c0de-402e-8456-3037d9a7c4d8-maas-api-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:41.487030 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:41.486996    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"
Jul 22 02:05:41.487209 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:41.487031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h" event={"ID":"04672f46-c0de-402e-8456-3037d9a7c4d8","Type":"ContainerDied","Data":"a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79"}
Jul 22 02:05:41.487209 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:41.487078    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1a6baf699efcdbfe7cddba45354baee5d2e3c2eabf4e613e4321d7765d68b79"
Jul 22 02:05:46.787258 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:46.787224    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:05:46.787723 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:46.787474    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" podUID="7188de6d-7708-4b75-9bb0-a76dd43962f4" containerName="maas-api" containerID="cri-o://db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f" gracePeriod=30
Jul 22 02:05:47.041930 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.041868    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:05:47.231443 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.231407    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") pod \"7188de6d-7708-4b75-9bb0-a76dd43962f4\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") "
Jul 22 02:05:47.231637 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.231451    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4h8m\" (UniqueName: \"kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m\") pod \"7188de6d-7708-4b75-9bb0-a76dd43962f4\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") "
Jul 22 02:05:47.231637 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.231500    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca\") pod \"7188de6d-7708-4b75-9bb0-a76dd43962f4\" (UID: \"7188de6d-7708-4b75-9bb0-a76dd43962f4\") "
Jul 22 02:05:47.231925 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.231899    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7188de6d-7708-4b75-9bb0-a76dd43962f4" (UID: "7188de6d-7708-4b75-9bb0-a76dd43962f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:05:47.233694 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.233672    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7188de6d-7708-4b75-9bb0-a76dd43962f4" (UID: "7188de6d-7708-4b75-9bb0-a76dd43962f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:05:47.233790 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.233704    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m" (OuterVolumeSpecName: "kube-api-access-r4h8m") pod "7188de6d-7708-4b75-9bb0-a76dd43962f4" (UID: "7188de6d-7708-4b75-9bb0-a76dd43962f4"). InnerVolumeSpecName "kube-api-access-r4h8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:05:47.333200 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.333088    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4h8m\" (UniqueName: \"kubernetes.io/projected/7188de6d-7708-4b75-9bb0-a76dd43962f4-kube-api-access-r4h8m\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:47.333200 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.333117    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7188de6d-7708-4b75-9bb0-a76dd43962f4-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:47.333200 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.333150    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7188de6d-7708-4b75-9bb0-a76dd43962f4-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:05:47.514600 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.514559    2559 generic.go:356] "Generic (PLEG): container finished" podID="7188de6d-7708-4b75-9bb0-a76dd43962f4" containerID="db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f" exitCode=0
Jul 22 02:05:47.514793 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.514605    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"
Jul 22 02:05:47.514793 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.514628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" event={"ID":"7188de6d-7708-4b75-9bb0-a76dd43962f4","Type":"ContainerDied","Data":"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"}
Jul 22 02:05:47.514793 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.514678    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8" event={"ID":"7188de6d-7708-4b75-9bb0-a76dd43962f4","Type":"ContainerDied","Data":"d7b3e1d10d15ceec11d5ce73d579d60e20dd4e6ca589dc66c6505445f3a73c32"}
Jul 22 02:05:47.514793 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.514701    2559 scope.go:117] "RemoveContainer" containerID="db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"
Jul 22 02:05:47.524313 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.524294    2559 scope.go:117] "RemoveContainer" containerID="db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"
Jul 22 02:05:47.524578 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:05:47.524557    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f\": container with ID starting with db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f not found: ID does not exist" containerID="db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"
Jul 22 02:05:47.524638 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.524591    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f"} err="failed to get container status \"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f\": rpc error: code = NotFound desc = could not find container \"db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f\": container with ID starting with db8d3a0c92b00557ccad0b242afba8548f7d71002854573f34385a4abd4cf12f not found: ID does not exist"
Jul 22 02:05:47.535258 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.535037    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:05:47.536936 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.536916    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-207f15-8d5874748-fpxb8"]
Jul 22 02:05:47.697232 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:47.697200    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7188de6d-7708-4b75-9bb0-a76dd43962f4" path="/var/lib/kubelet/pods/7188de6d-7708-4b75-9bb0-a76dd43962f4/volumes"
Jul 22 02:05:51.209258 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:51.209222    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"]
Jul 22 02:05:51.213112 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:51.213083    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-207f15-dct9h"]
Jul 22 02:05:51.696264 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:05:51.696229    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04672f46-c0de-402e-8456-3037d9a7c4d8" path="/var/lib/kubelet/pods/04672f46-c0de-402e-8456-3037d9a7c4d8/volumes"
Jul 22 02:06:02.434199 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434159    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:02.434786 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434693    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04672f46-c0de-402e-8456-3037d9a7c4d8" containerName="revoke-keys"
Jul 22 02:06:02.434786 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04672f46-c0de-402e-8456-3037d9a7c4d8" containerName="revoke-keys"
Jul 22 02:06:02.434786 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434759    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7188de6d-7708-4b75-9bb0-a76dd43962f4" containerName="maas-api"
Jul 22 02:06:02.434786 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434768    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7188de6d-7708-4b75-9bb0-a76dd43962f4" containerName="maas-api"
Jul 22 02:06:02.435023 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434869    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="04672f46-c0de-402e-8456-3037d9a7c4d8" containerName="revoke-keys"
Jul 22 02:06:02.435023 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.434885    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7188de6d-7708-4b75-9bb0-a76dd43962f4" containerName="maas-api"
Jul 22 02:06:02.439564 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.439541    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.442489 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.442469    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-353f20-serving-cert\""
Jul 22 02:06:02.457348 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.457320    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:02.461457 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.461431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.461663 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.461641    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz86p\" (UniqueName: \"kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.461823 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.461809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.562755 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.562714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.562949 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.562779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz86p\" (UniqueName: \"kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.562949 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.562829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.562949 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:06:02.562902    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-serving-cert: secret "maas-api-e2e-api-a-353f20-serving-cert" not found
Jul 22 02:06:02.563080 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:06:02.562973    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls podName:fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e nodeName:}" failed. No retries permitted until 2026-07-22 02:06:03.06295206 +0000 UTC m=+2309.892888854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls") pod "maas-api-e2e-api-a-353f20-5d74b77848-46bvz" (UID: "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e") : secret "maas-api-e2e-api-a-353f20-serving-cert" not found
Jul 22 02:06:02.563571 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.563547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:02.573684 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:02.573658    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz86p\" (UniqueName: \"kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:03.067788 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:03.067754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:03.070436 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:03.070406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") pod \"maas-api-e2e-api-a-353f20-5d74b77848-46bvz\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:03.351638 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:03.351535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:03.500882 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:03.500857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:03.502965 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:06:03.502925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabb8b5e_4d56_4b1f_9de5_795bc9b6ad6e.slice/crio-e14b646caad209437f3a50b5710144adc4890dabeff3d8b03e1c7a3d9c3f8c19 WatchSource:0}: Error finding container e14b646caad209437f3a50b5710144adc4890dabeff3d8b03e1c7a3d9c3f8c19: Status 404 returned error can't find the container with id e14b646caad209437f3a50b5710144adc4890dabeff3d8b03e1c7a3d9c3f8c19
Jul 22 02:06:03.594558 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:03.594523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" event={"ID":"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e","Type":"ContainerStarted","Data":"e14b646caad209437f3a50b5710144adc4890dabeff3d8b03e1c7a3d9c3f8c19"}
Jul 22 02:06:04.600839 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:04.600793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" event={"ID":"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e","Type":"ContainerStarted","Data":"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"}
Jul 22 02:06:04.601296 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:04.600958    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:04.617431 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:04.617353    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" podStartSLOduration=2.159675095 podStartE2EDuration="2.617338445s" totalImagesPullingTime="457.66335ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:06:04.61590846 +0000 UTC m=+2311.445845284" watchObservedRunningTime="2026-07-22 02:06:04.617338445 +0000 UTC m=+2311.447275308"
Jul 22 02:06:10.521835 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.521804    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:06:10.525799 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.525774    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.528441 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.528415    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4f2856-serving-cert\""
Jul 22 02:06:10.542288 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.542261    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:06:10.610869 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.610839    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:10.644832 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.644793    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djj87\" (UniqueName: \"kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.645051 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.644928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.645051 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.644968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.745915 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.745883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.746123 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.745969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djj87\" (UniqueName: \"kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.746123 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.746108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.746754 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.746726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.748551 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.748524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.754719 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.754693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djj87\" (UniqueName: \"kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87\") pod \"maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.837706 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.837625    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:10.999196 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:10.999169    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:06:11.001084 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:06:11.001053    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38d617e_788f_485f_8e87_8f5c2e6fa4ba.slice/crio-01dce735bc0f2e53fadee3a6f94bd9ff56f5aa804a6bc483cf91432962daeb41 WatchSource:0}: Error finding container 01dce735bc0f2e53fadee3a6f94bd9ff56f5aa804a6bc483cf91432962daeb41: Status 404 returned error can't find the container with id 01dce735bc0f2e53fadee3a6f94bd9ff56f5aa804a6bc483cf91432962daeb41
Jul 22 02:06:11.642904 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:11.642863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" event={"ID":"b38d617e-788f-485f-8e87-8f5c2e6fa4ba","Type":"ContainerStarted","Data":"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"}
Jul 22 02:06:11.643380 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:11.642934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" event={"ID":"b38d617e-788f-485f-8e87-8f5c2e6fa4ba","Type":"ContainerStarted","Data":"01dce735bc0f2e53fadee3a6f94bd9ff56f5aa804a6bc483cf91432962daeb41"}
Jul 22 02:06:11.643380 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:11.642982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:11.659564 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:11.659510    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" podStartSLOduration=1.324690599 podStartE2EDuration="1.659491643s" totalImagesPullingTime="334.801044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:06:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:06:11.658543725 +0000 UTC m=+2318.488480563" watchObservedRunningTime="2026-07-22 02:06:11.659491643 +0000 UTC m=+2318.489428523"
Jul 22 02:06:17.653274 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:17.653243    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:06:39.408324 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.408285    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:39.408808 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.408547    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" podUID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" containerName="maas-api" containerID="cri-o://a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18" gracePeriod=30
Jul 22 02:06:39.667640 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.667582    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:39.711019 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.710987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca\") pod \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") "
Jul 22 02:06:39.711211 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.711033    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz86p\" (UniqueName: \"kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p\") pod \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") "
Jul 22 02:06:39.711211 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.711108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") pod \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\" (UID: \"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e\") "
Jul 22 02:06:39.711487 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.711456    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" (UID: "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:06:39.713356 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.713324    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" (UID: "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:06:39.713470 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.713399    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p" (OuterVolumeSpecName: "kube-api-access-hz86p") pod "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" (UID: "fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e"). InnerVolumeSpecName "kube-api-access-hz86p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:06:39.781425 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.781389    2559 generic.go:356] "Generic (PLEG): container finished" podID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" containerID="a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18" exitCode=0
Jul 22 02:06:39.781595 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.781431    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"
Jul 22 02:06:39.781595 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.781477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" event={"ID":"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e","Type":"ContainerDied","Data":"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"}
Jul 22 02:06:39.781595 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.781528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz" event={"ID":"fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e","Type":"ContainerDied","Data":"e14b646caad209437f3a50b5710144adc4890dabeff3d8b03e1c7a3d9c3f8c19"}
Jul 22 02:06:39.781595 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.781549    2559 scope.go:117] "RemoveContainer" containerID="a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"
Jul 22 02:06:39.791194 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.791176    2559 scope.go:117] "RemoveContainer" containerID="a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"
Jul 22 02:06:39.791487 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:06:39.791467    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18\": container with ID starting with a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18 not found: ID does not exist" containerID="a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"
Jul 22 02:06:39.791548 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.791495    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18"} err="failed to get container status \"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18\": rpc error: code = NotFound desc = could not find container \"a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18\": container with ID starting with a30b52a25a645685899b2dd041c3cd139c2955885f0fe2c222793be29a8a2b18 not found: ID does not exist"
Jul 22 02:06:39.802201 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.802174    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:39.806963 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.806940    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-353f20-5d74b77848-46bvz"]
Jul 22 02:06:39.812373 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.812354    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:06:39.812458 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.812378    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz86p\" (UniqueName: \"kubernetes.io/projected/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-kube-api-access-hz86p\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:06:39.812458 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:39.812394    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:06:41.697030 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:06:41.696995    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" path="/var/lib/kubelet/pods/fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e/volumes"
Jul 22 02:07:06.249818 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.249782    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:07:06.250413 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.250015    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" podUID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" containerName="maas-api" containerID="cri-o://59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473" gracePeriod=30
Jul 22 02:07:06.510384 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.510319    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:07:06.657391 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.657352    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djj87\" (UniqueName: \"kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87\") pod \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") "
Jul 22 02:07:06.657391 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.657393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls\") pod \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") "
Jul 22 02:07:06.657607 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.657441    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca\") pod \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\" (UID: \"b38d617e-788f-485f-8e87-8f5c2e6fa4ba\") "
Jul 22 02:07:06.657883 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.657847    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b38d617e-788f-485f-8e87-8f5c2e6fa4ba" (UID: "b38d617e-788f-485f-8e87-8f5c2e6fa4ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:07:06.659646 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.659621    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b38d617e-788f-485f-8e87-8f5c2e6fa4ba" (UID: "b38d617e-788f-485f-8e87-8f5c2e6fa4ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:07:06.659754 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.659657    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87" (OuterVolumeSpecName: "kube-api-access-djj87") pod "b38d617e-788f-485f-8e87-8f5c2e6fa4ba" (UID: "b38d617e-788f-485f-8e87-8f5c2e6fa4ba"). InnerVolumeSpecName "kube-api-access-djj87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:07:06.759053 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.759020    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djj87\" (UniqueName: \"kubernetes.io/projected/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-kube-api-access-djj87\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:07:06.759053 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.759048    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:07:06.759053 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.759057    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b38d617e-788f-485f-8e87-8f5c2e6fa4ba-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:07:06.920743 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.920706    2559 generic.go:356] "Generic (PLEG): container finished" podID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" containerID="59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473" exitCode=0
Jul 22 02:07:06.920920 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.920755    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"
Jul 22 02:07:06.920920 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.920756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" event={"ID":"b38d617e-788f-485f-8e87-8f5c2e6fa4ba","Type":"ContainerDied","Data":"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"}
Jul 22 02:07:06.920920 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.920862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq" event={"ID":"b38d617e-788f-485f-8e87-8f5c2e6fa4ba","Type":"ContainerDied","Data":"01dce735bc0f2e53fadee3a6f94bd9ff56f5aa804a6bc483cf91432962daeb41"}
Jul 22 02:07:06.920920 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.920892    2559 scope.go:117] "RemoveContainer" containerID="59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"
Jul 22 02:07:06.930500 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.930480    2559 scope.go:117] "RemoveContainer" containerID="59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"
Jul 22 02:07:06.930746 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:07:06.930726    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473\": container with ID starting with 59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473 not found: ID does not exist" containerID="59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"
Jul 22 02:07:06.930796 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.930758    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473"} err="failed to get container status \"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473\": rpc error: code = NotFound desc = could not find container \"59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473\": container with ID starting with 59c852c0f9585f6800f48d3893039127f1632de6b08b1f23126d74538058e473 not found: ID does not exist"
Jul 22 02:07:06.940744 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.940719    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:07:06.944055 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:06.944035    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4f2856-6bb4f8bb6c-x9pcq"]
Jul 22 02:07:07.696403 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:07.696360    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" path="/var/lib/kubelet/pods/b38d617e-788f-485f-8e87-8f5c2e6fa4ba/volumes"
Jul 22 02:07:21.919067 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919028    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:07:21.919668 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919594    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" containerName="maas-api"
Jul 22 02:07:21.919668 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919615    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" containerName="maas-api"
Jul 22 02:07:21.919668 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919624    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" containerName="maas-api"
Jul 22 02:07:21.919668 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919630    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" containerName="maas-api"
Jul 22 02:07:21.919871 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919699    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabb8b5e-4d56-4b1f-9de5-795bc9b6ad6e" containerName="maas-api"
Jul 22 02:07:21.919871 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.919711    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38d617e-788f-485f-8e87-8f5c2e6fa4ba" containerName="maas-api"
Jul 22 02:07:21.923211 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.923190    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:21.925377 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.925355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-40b699-serving-cert\""
Jul 22 02:07:21.933884 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.933859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:07:21.994700 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.994661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:21.994889 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.994731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:21.994889 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:21.994788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfjcs\" (UniqueName: \"kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.095467 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.095431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.095693 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.095492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfjcs\" (UniqueName: \"kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.095693 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.095562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.095693 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:07:22.095575    2559 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-serving-cert: secret "maas-api-e2e-shared-a-40b699-serving-cert" not found
Jul 22 02:07:22.095693 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:07:22.095641    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls podName:a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0 nodeName:}" failed. No retries permitted until 2026-07-22 02:07:22.595624999 +0000 UTC m=+2389.425561788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls") pod "maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" (UID: "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0") : secret "maas-api-e2e-shared-a-40b699-serving-cert" not found
Jul 22 02:07:22.096168 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.096152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.104017 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.103991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfjcs\" (UniqueName: \"kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.598570 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.598533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.601150 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.601103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") pod \"maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.836314 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.836273    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:22.978452 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:22.978425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:07:22.980931 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:07:22.980900    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f0aa8d_c31c_4d8b_ab20_16ad99cdeac0.slice/crio-51acc015349f0fb62b3e1f88a98938e7bae4d44c46b6c5bf8b666b718bc87a33 WatchSource:0}: Error finding container 51acc015349f0fb62b3e1f88a98938e7bae4d44c46b6c5bf8b666b718bc87a33: Status 404 returned error can't find the container with id 51acc015349f0fb62b3e1f88a98938e7bae4d44c46b6c5bf8b666b718bc87a33
Jul 22 02:07:23.003001 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:23.002968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" event={"ID":"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0","Type":"ContainerStarted","Data":"51acc015349f0fb62b3e1f88a98938e7bae4d44c46b6c5bf8b666b718bc87a33"}
Jul 22 02:07:24.009372 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:24.009333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" event={"ID":"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0","Type":"ContainerStarted","Data":"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"}
Jul 22 02:07:24.009772 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:24.009484    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:24.026908 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:24.026842    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" podStartSLOduration=2.57073187 podStartE2EDuration="3.026827021s" totalImagesPullingTime="456.095151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:07:24.025296295 +0000 UTC m=+2390.855233152" watchObservedRunningTime="2026-07-22 02:07:24.026827021 +0000 UTC m=+2390.856763831"
Jul 22 02:07:30.015758 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.015720    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:07:30.019824 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.019803    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.020344 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.020322    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:07:30.022183 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.022161    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1f4af7-serving-cert\""
Jul 22 02:07:30.028426 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.028362    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:07:30.074672 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.074643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.074882 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.074699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.074882 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.074854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99p62\" (UniqueName: \"kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.175896 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.175865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.176098 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.175931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.176098 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.175958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99p62\" (UniqueName: \"kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.176805 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.176723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.178564 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.178543    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.183760 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.183735    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99p62\" (UniqueName: \"kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62\") pod \"maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.333098 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.333005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:30.474754 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:30.474720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:07:30.477311 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:07:30.477282    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bd44ce_f564_42a6_b5e9_06ea1d2e4036.slice/crio-e553aa8bd0409308a1c9f76c564e39145f3a68c441e59f341c9808218d876fe3 WatchSource:0}: Error finding container e553aa8bd0409308a1c9f76c564e39145f3a68c441e59f341c9808218d876fe3: Status 404 returned error can't find the container with id e553aa8bd0409308a1c9f76c564e39145f3a68c441e59f341c9808218d876fe3
Jul 22 02:07:31.049795 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:31.049758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" event={"ID":"77bd44ce-f564-42a6-b5e9-06ea1d2e4036","Type":"ContainerStarted","Data":"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"}
Jul 22 02:07:31.050232 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:31.049808    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" event={"ID":"77bd44ce-f564-42a6-b5e9-06ea1d2e4036","Type":"ContainerStarted","Data":"e553aa8bd0409308a1c9f76c564e39145f3a68c441e59f341c9808218d876fe3"}
Jul 22 02:07:31.050232 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:31.049893    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:07:31.066404 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:31.066157    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" podStartSLOduration=1.684411613 podStartE2EDuration="2.066111683s" totalImagesPullingTime="381.70007ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 02:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:07:31.065973024 +0000 UTC m=+2397.895909827" watchObservedRunningTime="2026-07-22 02:07:31.066111683 +0000 UTC m=+2397.896048493"
Jul 22 02:07:33.776585 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:33.776559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:07:33.780808 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:33.780785    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:07:37.061943 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:07:37.061908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:12:33.806581 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:12:33.806504    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:12:33.811034 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:12:33.811008    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:12:33.946339 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:12:33.946305    2559 scope.go:117] "RemoveContainer" containerID="87cc9a594b8e08a79cf7c0c2fbbe7cf9b22f218313d827888213bf2d4626fc46"
Jul 22 02:15:06.766862 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:06.766817    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:15:06.767455 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:06.767082    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" podUID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" containerName="maas-api" containerID="cri-o://03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb" gracePeriod=30
Jul 22 02:15:07.021934 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.021864    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:15:07.079352 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.079322    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca\") pod \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") "
Jul 22 02:15:07.079514 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.079380    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfjcs\" (UniqueName: \"kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs\") pod \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") "
Jul 22 02:15:07.079514 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.079418    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") pod \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\" (UID: \"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0\") "
Jul 22 02:15:07.079680 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.079655    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" (UID: "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:15:07.079769 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.079755    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:07.081678 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.081652    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" (UID: "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:15:07.081804 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.081698    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs" (OuterVolumeSpecName: "kube-api-access-qfjcs") pod "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" (UID: "a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0"). InnerVolumeSpecName "kube-api-access-qfjcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:15:07.181140 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.181105    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfjcs\" (UniqueName: \"kubernetes.io/projected/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-kube-api-access-qfjcs\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:07.181303 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.181156    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:07.237015 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.236976    2559 generic.go:356] "Generic (PLEG): container finished" podID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" containerID="03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb" exitCode=0
Jul 22 02:15:07.237203 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.237027    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"
Jul 22 02:15:07.237203 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.237060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" event={"ID":"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0","Type":"ContainerDied","Data":"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"}
Jul 22 02:15:07.237203 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.237112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm" event={"ID":"a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0","Type":"ContainerDied","Data":"51acc015349f0fb62b3e1f88a98938e7bae4d44c46b6c5bf8b666b718bc87a33"}
Jul 22 02:15:07.237203 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.237163    2559 scope.go:117] "RemoveContainer" containerID="03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"
Jul 22 02:15:07.247192 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.247167    2559 scope.go:117] "RemoveContainer" containerID="03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"
Jul 22 02:15:07.247519 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:15:07.247497    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb\": container with ID starting with 03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb not found: ID does not exist" containerID="03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"
Jul 22 02:15:07.247575 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.247531    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb"} err="failed to get container status \"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb\": rpc error: code = NotFound desc = could not find container \"03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb\": container with ID starting with 03af2e35ffcffc4f43913049d48ca896dd515989b90d26e8c91d31525d7051eb not found: ID does not exist"
Jul 22 02:15:07.258326 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.258298    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:15:07.262108 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.262081    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-40b699-6dc45d899d-6fcvm"]
Jul 22 02:15:07.696107 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:07.696066    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" path="/var/lib/kubelet/pods/a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0/volumes"
Jul 22 02:15:29.085092 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.084993    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:15:29.085652 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.085249    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" podUID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" containerName="maas-api" containerID="cri-o://215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358" gracePeriod=30
Jul 22 02:15:29.530792 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.530766    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:15:29.689741 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.689638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99p62\" (UniqueName: \"kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62\") pod \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") "
Jul 22 02:15:29.689741 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.689682    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca\") pod \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") "
Jul 22 02:15:29.689741 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.689743    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls\") pod \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\" (UID: \"77bd44ce-f564-42a6-b5e9-06ea1d2e4036\") "
Jul 22 02:15:29.690116 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.690086    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77bd44ce-f564-42a6-b5e9-06ea1d2e4036" (UID: "77bd44ce-f564-42a6-b5e9-06ea1d2e4036"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 02:15:29.692038 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.692012    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62" (OuterVolumeSpecName: "kube-api-access-99p62") pod "77bd44ce-f564-42a6-b5e9-06ea1d2e4036" (UID: "77bd44ce-f564-42a6-b5e9-06ea1d2e4036"). InnerVolumeSpecName "kube-api-access-99p62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 02:15:29.692165 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.692092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77bd44ce-f564-42a6-b5e9-06ea1d2e4036" (UID: "77bd44ce-f564-42a6-b5e9-06ea1d2e4036"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 02:15:29.791054 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.790999    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99p62\" (UniqueName: \"kubernetes.io/projected/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-kube-api-access-99p62\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:29.791274 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.791140    2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-openshift-service-ca\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:29.791274 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:29.791167    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77bd44ce-f564-42a6-b5e9-06ea1d2e4036-maas-api-tls\") on node \"ip-10-0-135-67.ec2.internal\" DevicePath \"\""
Jul 22 02:15:30.353415 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.353378    2559 generic.go:356] "Generic (PLEG): container finished" podID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" containerID="215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358" exitCode=0
Jul 22 02:15:30.353832 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.353429    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"
Jul 22 02:15:30.353832 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.353437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" event={"ID":"77bd44ce-f564-42a6-b5e9-06ea1d2e4036","Type":"ContainerDied","Data":"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"}
Jul 22 02:15:30.353832 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.353561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc" event={"ID":"77bd44ce-f564-42a6-b5e9-06ea1d2e4036","Type":"ContainerDied","Data":"e553aa8bd0409308a1c9f76c564e39145f3a68c441e59f341c9808218d876fe3"}
Jul 22 02:15:30.353832 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.353594    2559 scope.go:117] "RemoveContainer" containerID="215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"
Jul 22 02:15:30.362624 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.362605    2559 scope.go:117] "RemoveContainer" containerID="215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"
Jul 22 02:15:30.362924 ip-10-0-135-67 kubenswrapper[2559]: E0722 02:15:30.362908    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358\": container with ID starting with 215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358 not found: ID does not exist" containerID="215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"
Jul 22 02:15:30.362989 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.362934    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358"} err="failed to get container status \"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358\": rpc error: code = NotFound desc = could not find container \"215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358\": container with ID starting with 215e9b2c441f3e41e833b4b17f641d410d1599b2abe9bf2d2799b1d702caa358 not found: ID does not exist"
Jul 22 02:15:30.374394 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.374368    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:15:30.385880 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:30.385850    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1f4af7-84d9bd86b8-54llc"]
Jul 22 02:15:31.697187 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:31.697148    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" path="/var/lib/kubelet/pods/77bd44ce-f564-42a6-b5e9-06ea1d2e4036/volumes"
Jul 22 02:15:47.134985 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:47.134951    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4vgqv_d99a3e81-2daf-4221-928a-58ef5e7b3954/manager/0.log"
Jul 22 02:15:47.255930 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:47.255902    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6w2n9_8ee60e40-2de7-489b-a039-6600f2eea14b/manager/0.log"
Jul 22 02:15:47.378253 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:47.378221    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6887b55f68-z9tpx_ee82f2e6-1c69-44b7-82a3-1dc791d1a9be/manager/0.log"
Jul 22 02:15:47.740537 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:47.740508    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-7zjdd_36bbf2eb-d9c1-4d10-a273-e120791773e3/copy-manifests/0.log"
Jul 22 02:15:47.747181 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:47.747160    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-7zjdd_36bbf2eb-d9c1-4d10-a273-e120791773e3/manager/0.log"
Jul 22 02:15:48.399035 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:48.399002    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7c4b85df8d-xh7qn_f9eeca5e-90d8-46f2-936e-f40982494b93/maas-api/0.log"
Jul 22 02:15:51.250709 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:51.250680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vj7bj_7b387f07-b299-4ab6-ab17-4b290f33bd00/manager/0.log"
Jul 22 02:15:51.763670 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:51.763637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bdpqp_f871e869-c3eb-47a4-9337-9455cd531db8/discovery/0.log"
Jul 22 02:15:52.000084 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:52.000058    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7dbc5fd-n9zmf_db1acbfc-90b4-4925-88d8-414e8f2cc0b9/kube-auth-proxy/0.log"
Jul 22 02:15:52.263535 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:52.263506    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97ws4_a53113d4-14b1-4127-8459-236b5ab9c317/payload-pre-processing/0.log"
Jul 22 02:15:52.521999 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:52.521896    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c5485bddb-2hssz_326680c8-a142-4a9f-8acf-d3e5aa48ae5c/router/0.log"
Jul 22 02:15:53.032651 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:53.032618    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vgmhk_0e62ca32-415a-41d8-9076-5650aeae8e75/main/0.log"
Jul 22 02:15:53.400442 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:53.400407    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-6cvx4_9007b486-781b-4f0f-ac56-9d0f6d856141/main/0.log"
Jul 22 02:15:53.523018 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:15:53.522987    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-7s6fl_eba39b63-d903-41a6-8a7b-fd6f3ef121ae/main/0.log"
Jul 22 02:16:02.428902 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:02.428871    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9znw5_8e870cc0-e8ba-4c77-bbd9-bd0abca000e5/global-pull-secret-syncer/0.log"
Jul 22 02:16:02.611009 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:02.610976    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rczm4_a9124ada-91a6-4a83-b3d5-1fd257417ef9/konnectivity-agent/0.log"
Jul 22 02:16:02.632830 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:02.632804    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-67.ec2.internal_1a131ae19b4796263370658bdbdc05dd/haproxy/0.log"
Jul 22 02:16:07.755468 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:07.755432    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vj7bj_7b387f07-b299-4ab6-ab17-4b290f33bd00/manager/0.log"
Jul 22 02:16:09.457519 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:09.457489    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-8p45n_20f2093a-0134-4aef-af55-54802185ad5e/cluster-monitoring-operator/0.log"
Jul 22 02:16:09.712319 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:09.712246    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htb9m_846298ec-f9bf-43b3-af1d-656b9492c81d/node-exporter/0.log"
Jul 22 02:16:09.741636 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:09.741607    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htb9m_846298ec-f9bf-43b3-af1d-656b9492c81d/kube-rbac-proxy/0.log"
Jul 22 02:16:09.765219 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:09.765193    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htb9m_846298ec-f9bf-43b3-af1d-656b9492c81d/init-textfile/0.log"
Jul 22 02:16:11.539084 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.539049    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-qkv6z_1acdcfd5-e001-49df-9493-7e123d67686d/networking-console-plugin/0.log"
Jul 22 02:16:11.734857 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.734813    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"]
Jul 22 02:16:11.735217 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735204    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" containerName="maas-api"
Jul 22 02:16:11.735277 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735218    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" containerName="maas-api"
Jul 22 02:16:11.735277 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735234    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" containerName="maas-api"
Jul 22 02:16:11.735277 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735239    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" containerName="maas-api"
Jul 22 02:16:11.735429 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735299    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3f0aa8d-c31c-4d8b-ab20-16ad99cdeac0" containerName="maas-api"
Jul 22 02:16:11.735429 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.735308    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bd44ce-f564-42a6-b5e9-06ea1d2e4036" containerName="maas-api"
Jul 22 02:16:11.738666 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.738644    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.740941 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.740918    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvctt\"/\"kube-root-ca.crt\""
Jul 22 02:16:11.741659 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.741636    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bvctt\"/\"default-dockercfg-zqgnq\""
Jul 22 02:16:11.741779 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.741637    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bvctt\"/\"openshift-service-ca.crt\""
Jul 22 02:16:11.748087 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.748060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"]
Jul 22 02:16:11.880724 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.880688    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-proc\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.880724 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.880725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-podres\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.880945 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.880759    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-lib-modules\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.880945 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.880876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpb5t\" (UniqueName: \"kubernetes.io/projected/587d3cbe-9931-451f-9cd0-7286b594daf3-kube-api-access-mpb5t\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.880945 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.880908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-sys\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981607 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-proc\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981607 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-podres\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981815 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-proc\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981815 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-lib-modules\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981815 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-lib-modules\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981815 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpb5t\" (UniqueName: \"kubernetes.io/projected/587d3cbe-9931-451f-9cd0-7286b594daf3-kube-api-access-mpb5t\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981815 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981719    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-podres\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981981 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-sys\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.981981 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.981925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/587d3cbe-9931-451f-9cd0-7286b594daf3-sys\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:11.989809 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:11.989791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpb5t\" (UniqueName: \"kubernetes.io/projected/587d3cbe-9931-451f-9cd0-7286b594daf3-kube-api-access-mpb5t\") pod \"perf-node-gather-daemonset-zrnwm\" (UID: \"587d3cbe-9931-451f-9cd0-7286b594daf3\") " pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:12.050251 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.050202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:12.189281 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.189254    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"]
Jul 22 02:16:12.191425 ip-10-0-135-67 kubenswrapper[2559]: W0722 02:16:12.191396    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod587d3cbe_9931_451f_9cd0_7286b594daf3.slice/crio-7e18ceec4b6e180e9333240ffc36a5f91e7a7669a7522dea141e1f9631d8fd58 WatchSource:0}: Error finding container 7e18ceec4b6e180e9333240ffc36a5f91e7a7669a7522dea141e1f9631d8fd58: Status 404 returned error can't find the container with id 7e18ceec4b6e180e9333240ffc36a5f91e7a7669a7522dea141e1f9631d8fd58
Jul 22 02:16:12.196359 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.196339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/2.log"
Jul 22 02:16:12.201595 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.201575    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mnkqw_8a93aec7-dc61-449b-9176-dc5afc29324e/console-operator/3.log"
Jul 22 02:16:12.553175 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.553071    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm" event={"ID":"587d3cbe-9931-451f-9cd0-7286b594daf3","Type":"ContainerStarted","Data":"580efd39edc810a3e61999839e53f6991f3ce818bbe63fc37b097bb79cd5067a"}
Jul 22 02:16:12.553175 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.553122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm" event={"ID":"587d3cbe-9931-451f-9cd0-7286b594daf3","Type":"ContainerStarted","Data":"7e18ceec4b6e180e9333240ffc36a5f91e7a7669a7522dea141e1f9631d8fd58"}
Jul 22 02:16:12.553583 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.553198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:12.570860 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:12.570799    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm" podStartSLOduration=1.570783923 podStartE2EDuration="1.570783923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 02:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 02:16:12.569330527 +0000 UTC m=+2919.399267355" watchObservedRunningTime="2026-07-22 02:16:12.570783923 +0000 UTC m=+2919.400720733"
Jul 22 02:16:13.398926 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:13.398891    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-z5lmj_1c867840-35a3-4ade-a085-de8894729e6e/volume-data-source-validator/0.log"
Jul 22 02:16:14.479701 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:14.479672    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4prq4_3745794e-a157-4e3d-9397-b1f3d1bd6cbe/dns/0.log"
Jul 22 02:16:14.503814 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:14.503785    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4prq4_3745794e-a157-4e3d-9397-b1f3d1bd6cbe/kube-rbac-proxy/0.log"
Jul 22 02:16:14.697087 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:14.697057    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pfnkz_3c949326-9864-4f26-9a35-c256ed1653d7/dns-node-resolver/0.log"
Jul 22 02:16:15.325637 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:15.325607    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-md9fz_dca8765b-c288-4e68-b70a-411adfad43ba/node-ca/0.log"
Jul 22 02:16:16.453669 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:16.453637    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bdpqp_f871e869-c3eb-47a4-9337-9455cd531db8/discovery/0.log"
Jul 22 02:16:16.519586 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:16.519551    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7dbc5fd-n9zmf_db1acbfc-90b4-4925-88d8-414e8f2cc0b9/kube-auth-proxy/0.log"
Jul 22 02:16:16.645524 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:16.645497    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97ws4_a53113d4-14b1-4127-8459-236b5ab9c317/payload-pre-processing/0.log"
Jul 22 02:16:16.711170 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:16.711070    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c5485bddb-2hssz_326680c8-a142-4a9f-8acf-d3e5aa48ae5c/router/0.log"
Jul 22 02:16:17.443144 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:17.443110    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hkwrg_599e36cc-774f-4be9-ba42-fadaa561fc2f/serve-healthcheck-canary/0.log"
Jul 22 02:16:17.973138 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:17.973110    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rv2hx_c9092964-52a3-4a04-bf50-e0071a53b374/insights-operator/0.log"
Jul 22 02:16:17.973869 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:17.973850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rv2hx_c9092964-52a3-4a04-bf50-e0071a53b374/insights-operator/1.log"
Jul 22 02:16:18.000656 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:18.000630    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g64jd_9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3/kube-rbac-proxy/0.log"
Jul 22 02:16:18.025781 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:18.025753    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g64jd_9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3/exporter/0.log"
Jul 22 02:16:18.050041 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:18.050014    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g64jd_9e48aff0-ca3b-47fe-a22b-057b5dc3a5d3/extractor/0.log"
Jul 22 02:16:18.568711 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:18.568684    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bvctt/perf-node-gather-daemonset-zrnwm"
Jul 22 02:16:20.411241 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:20.411213    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-4vgqv_d99a3e81-2daf-4221-928a-58ef5e7b3954/manager/0.log"
Jul 22 02:16:20.592772 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:20.592738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6w2n9_8ee60e40-2de7-489b-a039-6600f2eea14b/manager/0.log"
Jul 22 02:16:20.703428 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:20.703388    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6887b55f68-z9tpx_ee82f2e6-1c69-44b7-82a3-1dc791d1a9be/manager/0.log"
Jul 22 02:16:20.869324 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:20.869295    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-7zjdd_36bbf2eb-d9c1-4d10-a273-e120791773e3/manager/0.log"
Jul 22 02:16:20.890794 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:20.890771    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9869b8c7c-7zjdd_36bbf2eb-d9c1-4d10-a273-e120791773e3/copy-manifests/0.log"
Jul 22 02:16:21.455010 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:21.454961    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bdpqp_f871e869-c3eb-47a4-9337-9455cd531db8/discovery/0.log"
Jul 22 02:16:21.479193 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:21.479167    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7dbc5fd-n9zmf_db1acbfc-90b4-4925-88d8-414e8f2cc0b9/kube-auth-proxy/0.log"
Jul 22 02:16:21.573928 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:21.573849    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97ws4_a53113d4-14b1-4127-8459-236b5ab9c317/payload-pre-processing/0.log"
Jul 22 02:16:21.620935 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:21.620906    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c5485bddb-2hssz_326680c8-a142-4a9f-8acf-d3e5aa48ae5c/router/0.log"
Jul 22 02:16:22.848994 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:22.848957    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bdpqp_f871e869-c3eb-47a4-9337-9455cd531db8/discovery/0.log"
Jul 22 02:16:22.882831 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:22.882805    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d7dbc5fd-n9zmf_db1acbfc-90b4-4925-88d8-414e8f2cc0b9/kube-auth-proxy/0.log"
Jul 22 02:16:22.980441 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:22.980348    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-97ws4_a53113d4-14b1-4127-8459-236b5ab9c317/payload-pre-processing/0.log"
Jul 22 02:16:23.030444 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:23.030422    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c5485bddb-2hssz_326680c8-a142-4a9f-8acf-d3e5aa48ae5c/router/0.log"
Jul 22 02:16:27.148591 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:27.148566    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-hlmpp_0beeccbb-9c9b-4655-b91c-7de322352221/migrator/0.log"
Jul 22 02:16:27.170206 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:27.170179    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-hlmpp_0beeccbb-9c9b-4655-b91c-7de322352221/graceful-termination/0.log"
Jul 22 02:16:27.526765 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:27.526684    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-xnsjm_cb065bf4-7e56-4ef0-bf99-93bd1ab260e8/kube-storage-version-migrator-operator/1.log"
Jul 22 02:16:27.527468 ip-10-0-135-67 kubenswrapper[2559]: I0722 02:16:27.527447    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-xnsjm_cb065bf4-7e56-4ef0-bf99-93bd1ab260e8/kube-storage-version-migrator-operator/0.log"