Jul 22 19:59:36.081254 ip-10-0-133-202 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 19:59:36.081460 ip-10-0-133-202 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 19:59:36.081706 ip-10-0-133-202 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 19:59:36.082236 ip-10-0-133-202 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 19:59:46.196944 ip-10-0-133-202 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 19:59:46.196961 ip-10-0-133-202 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6da03558accd4283876b190dab7100c3 --
Jul 22 20:01:45.079651 ip-10-0-133-202 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 20:01:45.428172 ip-10-0-133-202 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:01:45.428172 ip-10-0-133-202 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 20:01:45.428172 ip-10-0-133-202 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:01:45.428172 ip-10-0-133-202 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 20:01:45.428172 ip-10-0-133-202 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 20:01:45.429779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.429683    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435217    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435239    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435243    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435247    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435250    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435253    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435256    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435259    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.435250 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435263    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435266    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435269    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435272    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435274    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435277    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435280    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435283    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435286    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435289    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435292    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435295    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435297    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435300    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435302    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435305    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435315    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435317    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435320    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435322    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.435591 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435325    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435327    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435330    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435333    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435335    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435337    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435340    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435424    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435428    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435430    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435433    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435436    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435438    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435441    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435445    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435448    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435450    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435453    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435456    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435458    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.436112 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435461    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435464    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435466    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435470    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435472    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435475    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435477    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435480    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435482    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435485    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435488    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435491    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435493    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435496    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435498    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435501    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435505    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435507    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435510    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.436622 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435513    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435515    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435518    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435522    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435526    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435529    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435533    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435536    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435539    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435542    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435545    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435547    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435550    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435553    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435555    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435559    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435565    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435568    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435573    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.437075 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435577    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435580    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435583    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435586    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435589    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435592    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435595    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435597    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435600    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435603    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435606    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435608    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.435611    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436319    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436326    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436329    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436332    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436335    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436338    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436357    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.437579 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436362    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436365    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436368    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436371    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436374    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436376    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436379    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436382    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436384    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436387    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436390    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436393    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436395    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436398    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436400    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436403    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436406    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436408    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436411    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436413    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.438055 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436416    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436418    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436423    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436427    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436430    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436433    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436436    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436439    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436442    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436444    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436447    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436449    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436452    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436455    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436458    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436460    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436463    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436465    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436468    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.438566 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436470    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436473    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436476    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436479    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436483    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436486    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436489    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436492    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436494    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436497    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436500    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436503    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436505    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436509    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436512    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436515    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436517    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436520    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436522    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.439025 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436525    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436527    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436530    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436532    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436535    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436537    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436540    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436544    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436547    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436549    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436551    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436554    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436557    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436559    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436562    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436564    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436567    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436569    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436573    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436576    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.439499 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436578    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436581    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436583    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436586    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436588    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436591    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436593    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436596    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436598    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436601    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436603    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436606    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436609    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.436611    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437020    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437026    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437028    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437031    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437034    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437036    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.440002 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437039    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437042    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437044    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437047    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437050    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437052    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437055    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437057    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437059    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437062    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437065    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437068    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437070    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437073    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437075    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437078    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437081    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437083    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437086    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.440506 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437088    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437093    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437097    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437100    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437102    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437105    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437108    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437111    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437114    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437116    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437119    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437122    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437125    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437127    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437130    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437132    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437135    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437138    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437140    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.441007 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437143    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437145    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437148    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437150    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437152    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437155    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437158    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437160    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437163    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437165    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437167    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437170    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437172    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437175    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437177    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437180    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437184    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437186    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437188    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437191    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.441478 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437193    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437196    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437199    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437203    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437206    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437209    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437212    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437215    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437218    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437221    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437224    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437226    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437229    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437231    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437234    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437236    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437238    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437241    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437244    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.441965 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437247    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437250    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437253    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437256    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437259    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437262    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437265    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437268    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437270    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437273    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437275    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437278    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437280    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437283    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437286    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.437289    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437385    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437393    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437400    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437404    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 20:01:45.442500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437408    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437412    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437416    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437420    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437423    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437426    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437430    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437433    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437436    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437439    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437442    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437445    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437449    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437452    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437456    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437459    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437462    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437465    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437468    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437472    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437475    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437478    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437482    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437485    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 20:01:45.442980 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437488    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437491    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437497    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437500    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437505    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437508    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437511    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437514    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437517    2582 flags.go:64] FLAG: --enable-server="true"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437520    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437524    2582 flags.go:64] FLAG: --event-burst="100"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437527    2582 flags.go:64] FLAG: --event-qps="50"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437530    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437534    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437537    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437541    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437544    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437547    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437550    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437553    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437555    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437559    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437562    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437565    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437567    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 20:01:45.443570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437570    2582 flags.go:64] FLAG: --feature-gates=""
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437574    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437577    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437581    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437585    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437588    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437591    2582 flags.go:64] FLAG: --help="false"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437594    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437597    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437603    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437606    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437609    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437613    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437616    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437619    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437621    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437624    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437627    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437630    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437633    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437636    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437638    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437642    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437644    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 20:01:45.444171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437647    2582 flags.go:64] FLAG: --lock-file=""
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437650    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437653    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437656    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437661    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437665    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437668    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437671    2582 flags.go:64] FLAG: --logging-format="text"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437674    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437677    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437679    2582 flags.go:64] FLAG: --manifest-url=""
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437684    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437688    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437691    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437695    2582 flags.go:64] FLAG: --max-pods="110"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437698    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437701    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437705    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437708    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437711    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437714    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437717    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437724    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437727    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437730    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 20:01:45.444811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437733    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437736    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437742    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437745    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437748    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437751    2582 flags.go:64] FLAG: --port="10250"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437754    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437757    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0470033c1de90ebb0"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437761    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437763    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437766    2582 flags.go:64] FLAG: --register-node="true"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437769    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437773    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437777    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437779    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437782    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437786    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437794    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437798    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437801    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437804    2582 flags.go:64] FLAG: --runonce="false"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437807    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437810    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437813    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437815    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 20:01:45.445450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437819    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437822    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437825    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437828    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437831    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437834    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437837    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437840    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437843    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437845    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437848    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437853    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437856    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437859    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437863    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437866    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437869    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437871    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437874    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437877    2582 flags.go:64] FLAG: --v="2"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437881    2582 flags.go:64] FLAG: --version="false"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437885    2582 flags.go:64] FLAG: --vmodule=""
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437889    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.437892    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438013    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.446096 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438017    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438021    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438024    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438027    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438030    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438032    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438035    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438039    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438042    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438044    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438047    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438049    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438052    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438055    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438058    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438060    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438063    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438066    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438068    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.446714 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438071    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438074    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438076    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438079    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438082    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438084    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438088    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438092    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438095    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438099    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438102    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438105    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438108    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438112    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438115    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438117    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438120    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438123    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438125    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438128    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.447171 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438132    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438134    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438137    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438140    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438142    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438145    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438147    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438150    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438153    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438155    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438158    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438160    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438163    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438165    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438168    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438171    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438173    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438177    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438179    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438182    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.447678 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438184    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438187    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438189    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438197    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438200    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438204    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438207    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438210    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438212    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438215    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438217    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438220    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438224    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438227    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438229    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438232    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438234    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438237    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438240    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438242    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.448167 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438244    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438247    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438250    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438252    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438256    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438260    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438263    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438266    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438268    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438271    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438274    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438276    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438279    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438281    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438283    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438286    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438292    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438296    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.448782 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.438298    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.438943    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.445966    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.445985    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.446784    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.446792    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446858    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446864    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446867    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446870    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446873    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446876    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446879    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446882    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.449212 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446884    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446887    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446890    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446894    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446897    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446901    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446903    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446906    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446909    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446911    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446916    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446919    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446922    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446925    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446928    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446931    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446934    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446938    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.449580 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446940    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446943    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446946    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446954    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446958    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446960    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446963    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446966    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446969    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446971    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446974    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446976    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446979    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446982    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446984    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446987    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446989    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446992    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446995    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.446998    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.450006 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447000    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447002    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447005    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447008    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447010    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447012    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447015    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447017    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447020    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447023    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447025    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447028    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447030    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447033    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447035    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447039    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447048    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447050    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447053    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447056    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.450508 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447058    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447061    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447063    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447066    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447068    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447071    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447073    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447076    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447079    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447081    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447084    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447086    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447088    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447091    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447093    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447096    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447098    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447101    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447103    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447107    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.450993 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447110    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447112    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447115    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447117    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447121    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447123    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447125    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447128    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447131    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447138    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447141    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447144    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447146    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.447151    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447297    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 20:01:45.451503 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447301    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447304    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447307    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447310    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447312    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447315    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447317    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447320    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447322    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447325    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447327    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447330    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447333    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447335    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447337    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447340    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447360    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447363    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447366    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447368    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 20:01:45.451868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447371    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447373    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447376    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447379    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447383    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447387    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447390    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447399    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447402    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447404    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447407    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447410    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447412    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447416    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447419    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447422    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447425    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447427    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447430    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 20:01:45.452355 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447433    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447436    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447438    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447441    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447444    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447446    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447448    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447451    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447453    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447456    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447458    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447461    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447463    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447466    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447468    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447471    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447473    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447476    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447479    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447481    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 20:01:45.452812 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447484    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447493    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447496    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447498    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447501    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447503    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447506    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447508    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447511    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447513    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447515    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447518    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447520    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447524    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447528    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447530    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447533    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447536    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447538    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 20:01:45.453284 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447541    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447544    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447546    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447549    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447552    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447554    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447557    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447559    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447562    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447565    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447567    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447570    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447573    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447575    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447578    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447586    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447588    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447591    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447593    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 20:01:45.453759 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:45.447596    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.447601    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.447763    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.449969    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.451286    2582 server.go:1019] "Starting client certificate rotation"
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.451414    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 20:01:45.454214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.452141    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 20:01:45.454460 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.454445    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 20:01:45.456428 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.456359    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 20:01:45.466614 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.466590    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 22 20:01:45.468926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.468910    2582 log.go:25] "Validated CRI v1 image API"
Jul 22 20:01:45.470426 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.470379    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 20:01:45.474569 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.474548    2582 fs.go:135] Filesystem UUIDs: map[0b57b60c-44dd-49ed-9954-ff10b275251d:/dev/nvme0n1p4 752e7895-e6cd-4414-9c9d-f04632fc7508:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 22 20:01:45.474569 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.474568    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 20:01:45.479298 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.479278    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 20:01:45.480093 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.479977    2582 manager.go:216] Machine: {Timestamp:2026-07-22 20:01:45.478711676 +0000 UTC m=+0.291205314 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098796 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20eccef71c5dccb5390597b4627ae0 SystemUUID:ec20ecce-f71c-5dcc-b539-0597b4627ae0 BootID:6da03558-accd-4283-876b-190dab7100c3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:b9:da:41:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:b9:da:41:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:5d:db:62:c9:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 20:01:45.480093 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.480087    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 20:01:45.480233 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.480221    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 20:01:45.483027 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483003    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 20:01:45.483170 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483031    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-202.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 20:01:45.483746 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483735    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 20:01:45.483779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483748    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 20:01:45.483779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483755    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 20:01:45.483779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.483769    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 20:01:45.485180 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.485169    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 20:01:45.489455 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489443    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 20:01:45.489593 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489584    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 20:01:45.489622 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489617    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 20:01:45.489649 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489631    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 20:01:45.489649 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489646    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 20:01:45.489707 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489676    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 22 20:01:45.489707 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.489686    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 20:01:45.490091 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.490079    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 20:01:45.490129 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.490098    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 20:01:45.492198 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.492158    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 20:01:45.494212 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.494198    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 20:01:45.494280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.494228    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 20:01:45.495448 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495437    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495452    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495459    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495465    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495474    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495479    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495487    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495492    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495499    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495504    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 20:01:45.495509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495513    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 20:01:45.495766 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.495518    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 20:01:45.496239 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.496230    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 20:01:45.496272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.496239    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 20:01:45.497753 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.497724    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 20:01:45.497831 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.497804    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-202.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 20:01:45.497955 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.497938    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-202.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 20:01:45.499854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.499842    2582 server.go:1268] "Started kubelet"
Jul 22 20:01:45.500130 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.500094    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 20:01:45.500728 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.500657    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 20:01:45.500826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.500777    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 20:01:45.500888 ip-10-0-133-202 systemd[1]: Started Kubernetes Kubelet.
Jul 22 20:01:45.501731 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.501712    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nmnh"
Jul 22 20:01:45.502538 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.502495    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 20:01:45.503312 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.503297    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 20:01:45.506501 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.506480    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 20:01:45.509006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.508989    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4nmnh"
Jul 22 20:01:45.510046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.510028    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 20:01:45.510142 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.510125    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 20:01:45.510260 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.510147    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:45.511291 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511184    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 20:01:45.511291 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511203    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 20:01:45.511448 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511305    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 20:01:45.511448 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511314    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 20:01:45.511722 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511701    2582 factory.go:55] Registering systemd factory
Jul 22 20:01:45.511722 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.511725    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 22 20:01:45.511923 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.510888    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-202.ec2.internal.18c4b520f503ee4e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-202.ec2.internal,UID:ip-10-0-133-202.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-202.ec2.internal,},FirstTimestamp:2026-07-22 20:01:45.499815502 +0000 UTC m=+0.312309136,LastTimestamp:2026-07-22 20:01:45.499815502 +0000 UTC m=+0.312309136,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-202.ec2.internal,}"
Jul 22 20:01:45.512408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512385    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 20:01:45.512492 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512476    2582 factory.go:153] Registering CRI-O factory
Jul 22 20:01:45.512492 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512491    2582 factory.go:223] Registration of the crio container factory successfully
Jul 22 20:01:45.512589 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512540    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 20:01:45.512589 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512563    2582 factory.go:103] Registering Raw factory
Jul 22 20:01:45.512589 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.512578    2582 manager.go:1196] Started watching for new ooms in manager
Jul 22 20:01:45.513041 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.513022    2582 manager.go:349] Starting recovery of all containers
Jul 22 20:01:45.519738 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.519672    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:45.522581 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.522559    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-202.ec2.internal\" not found" node="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:45.523428 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.523413    2582 manager.go:354] Recovery completed
Jul 22 20:01:45.527894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.527881    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:45.530820 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.530793    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:45.530908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.530822    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:45.530908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.530837    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:45.531408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.531395    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 20:01:45.531408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.531406    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 20:01:45.531503 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.531414    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:45.531503 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.531422    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 20:01:45.532171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.532157    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:45.532227 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.532185    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:45.532227 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.532196    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:45.533537 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.533524    2582 policy_none.go:49] "None policy: Start"
Jul 22 20:01:45.533573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.533540    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 20:01:45.533573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.533549    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 20:01:45.535497 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.535485    2582 policy_none.go:47] "Start"
Jul 22 20:01:45.576259 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576069    2582 manager.go:337] "Starting Device Plugin manager"
Jul 22 20:01:45.576435 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.576278    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 20:01:45.576435 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576293    2582 server.go:87] "Starting device plugin registration server"
Jul 22 20:01:45.576557 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576545    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 20:01:45.576615 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576564    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 20:01:45.576662 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576651    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 20:01:45.576741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576730    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 20:01:45.576741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.576741    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 20:01:45.577315 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.577291    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 20:01:45.577425 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.577337    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:45.677015 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.676970    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:45.679390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.677995    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:45.679390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.678031    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:45.679390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.678042    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:45.679390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.678070    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:45.687014 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.686993    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:45.687115 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.687020    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-202.ec2.internal\": node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:45.689522 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.689495    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 20:01:45.690753 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.690733    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 20:01:45.690806 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.690783    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 20:01:45.690848 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.690810    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 20:01:45.690848 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.690845    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 20:01:45.692629 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:45.692614    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:45.716085 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:45.716055    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:46.872956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.872911    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"]
Jul 22 20:01:46.873079 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.873023    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:46.874633 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.874614    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:46.874770 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.874647    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:46.874770 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.874663    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:46.877037 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877023    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:46.877176 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877137    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.877249 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877192    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:46.877820 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877804    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:46.877820 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877819    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:46.877820 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877831    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:46.877820 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877837    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:46.878006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877841    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:46.878006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.877847    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:46.880127 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.880110    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.880242 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.880134    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 20:01:46.886029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.886015    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 20:01:46.886110 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.886042    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 20:01:46.886110 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.886054    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeHasSufficientPID"
Jul 22 20:01:46.895699 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:46.895673    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-202.ec2.internal\" not found" node="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.897915 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:46.897898    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:46.901568 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:46.901553    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-202.ec2.internal\" not found" node="ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.994857 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.994823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.994972 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.994861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a4dd5d87507128fa706ef61307a77d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-202.ec2.internal\" (UID: \"3a4dd5d87507128fa706ef61307a77d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.994972 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:46.994879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:46.998894 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:46.998875    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.095578 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095548    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a4dd5d87507128fa706ef61307a77d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-202.ec2.internal\" (UID: \"3a4dd5d87507128fa706ef61307a77d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.095649 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095568    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a4dd5d87507128fa706ef61307a77d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-202.ec2.internal\" (UID: \"3a4dd5d87507128fa706ef61307a77d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.095649 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.095710 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.095710 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095679    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.095710 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.095691    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cb6fd3ca4b20ada76316c0bc9b0e1a3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal\" (UID: \"2cb6fd3ca4b20ada76316c0bc9b0e1a3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.099605 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.099586    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.199218 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.199174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.200228 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.200199    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.204452 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.204438    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.300946 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.300911    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.401629 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.401544    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.502203 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.502174    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.532373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.532342    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 20:01:47.532797 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.532511    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 20:01:47.532797 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.532540    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 20:01:47.596708 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.596667    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 19:56:46 +0000 UTC" deadline="2028-04-06 09:40:14.945501422 +0000 UTC"
Jul 22 20:01:47.596708 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.596701    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14965h38m27.348804237s"
Jul 22 20:01:47.602283 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:47.602268    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-202.ec2.internal\" not found"
Jul 22 20:01:47.689866 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.689788    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:47.692531 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.692516    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.701478 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.701458    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 20:01:47.703128 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.703111    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal"
Jul 22 20:01:47.711956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.711932    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 20:01:47.971533 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:47.971501    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4dd5d87507128fa706ef61307a77d9.slice/crio-67cfd48d759bd328616a1a0dccba60c86cca147934406dd0afbe71057afec879 WatchSource:0}: Error finding container 67cfd48d759bd328616a1a0dccba60c86cca147934406dd0afbe71057afec879: Status 404 returned error can't find the container with id 67cfd48d759bd328616a1a0dccba60c86cca147934406dd0afbe71057afec879
Jul 22 20:01:47.971715 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:47.971694    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb6fd3ca4b20ada76316c0bc9b0e1a3.slice/crio-d65ebc237481a89f57e8335be19ebebcff8d084d0ecce888782817cbf6362a2e WatchSource:0}: Error finding container d65ebc237481a89f57e8335be19ebebcff8d084d0ecce888782817cbf6362a2e: Status 404 returned error can't find the container with id d65ebc237481a89f57e8335be19ebebcff8d084d0ecce888782817cbf6362a2e
Jul 22 20:01:47.977971 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:47.977905    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:01:48.145307 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.145273    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:48.572721 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.572683    2582 apiserver.go:52] "Watching apiserver"
Jul 22 20:01:48.579264 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.579236    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 20:01:48.579667 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.579637    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl","openshift-dns/node-resolver-vzx2n","openshift-image-registry/node-ca-ch7l9","openshift-multus/multus-additional-cni-plugins-7j5w7","openshift-network-diagnostics/network-check-target-gklkp","openshift-ovn-kubernetes/ovnkube-node-xncsx","kube-system/konnectivity-agent-nljlm","kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gvxq8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal","openshift-multus/multus-5j5cn","openshift-multus/network-metrics-daemon-qqz6z","openshift-network-operator/iptables-alerter-m7w6k","kube-system/global-pull-secret-syncer-vgksv"]
Jul 22 20:01:48.582184 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.582162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.584977 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.584949    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 20:01:48.585067 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.585031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 20:01:48.585624 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.585594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.586036 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.586008    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bd8jz\""
Jul 22 20:01:48.588363 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.588229    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.589100 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.589073    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.589203 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.589126    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcp6c\""
Jul 22 20:01:48.589576 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.589560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.590358 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.590336    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 20:01:48.590564 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.590451    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.590810 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.590790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.591416 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.591395    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.591608 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.591590    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-49gqp\""
Jul 22 20:01:48.591903 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.591885    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 20:01:48.592141 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.592123    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 20:01:48.593638 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593618    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.594081 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593916    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-svdmf\""
Jul 22 20:01:48.594081 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593971    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 20:01:48.594081 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 20:01:48.594081 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593971    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.594081 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.593995    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 20:01:48.594319 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.594207    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:48.594319 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.594255    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:48.596630 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.596608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.599044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.598857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.599044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.598874    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.599044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.598923    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9nptm\""
Jul 22 20:01:48.599291 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.599258    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 20:01:48.599346 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.599319    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 20:01:48.599488 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.599473    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.599605 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.599587    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 20:01:48.599699 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.599680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 20:01:48.601097 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.601078    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.601225 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.601169    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-646c2\""
Jul 22 20:01:48.601365 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.601341    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.601744 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.601725    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.603740 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.603839 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.603839 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:48.603950 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73220400-0041-4a54-8349-6446c7c9f2a5-konnectivity-ca\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.603950 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz2sb\" (UniqueName: \"kubernetes.io/projected/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-kube-api-access-qz2sb\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.603950 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-etc-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.603950 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-ovn\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.603950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-node-log\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604252 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-config\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604252 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed509c9f-d6a6-467a-b776-c8d1671f2415-host\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.604327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-os-release\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.604327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-netns\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-log-socket\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmcp\" (UniqueName: \"kubernetes.io/projected/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-kube-api-access-gxmcp\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-kubelet\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-systemd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed509c9f-d6a6-467a-b776-c8d1671f2415-serviceca\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.604511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-cnibin\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604514    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kplbk\""
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxf79\" (UniqueName: \"kubernetes.io/projected/8f22dc14-8fec-4714-ac30-36fe0a25077f-kube-api-access-lxf79\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604557    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-iptables-alerter-script\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604585    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-systemd-units\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604650    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-slash\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-netd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.604786 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-var-lib-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-bin\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf6gj\" (UniqueName: \"kubernetes.io/projected/ed509c9f-d6a6-467a-b776-c8d1671f2415-kube-api-access-qf6gj\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovn-node-metrics-cert\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73220400-0041-4a54-8349-6446c7c9f2a5-agent-certs\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-host-slash\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-env-overrides\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.604999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-script-lib\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.605240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.605016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-system-cni-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.605833 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.605814    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 20:01:48.606810 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.606784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.606906 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.606866    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:48.607036 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.607016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mzflp\""
Jul 22 20:01:48.607255 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.607239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 20:01:48.607351 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.607254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 20:01:48.609476 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.609457    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.611910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.611887    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p2jcx\""
Jul 22 20:01:48.612001 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.611888    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 20:01:48.612213 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.612195    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.612292 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.612272    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:48.626732 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.626700    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dpflk"
Jul 22 20:01:48.634690 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.634661    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dpflk"
Jul 22 20:01:48.684993 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.684955    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:48.695226 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.695200    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-node-log\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-multus-certs\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stnxm\" (UniqueName: \"kubernetes.io/projected/cdf26b52-3886-41a2-83a3-ad9d622590a7-kube-api-access-stnxm\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-socket-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-registration-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706317    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-node-log\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-sys-fs\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.706349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-config\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-os-release\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-cnibin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-cni-binary-copy\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-netns\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c3da3-aa1a-4139-84b1-88f9b1703936-tmp-dir\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed509c9f-d6a6-467a-b776-c8d1671f2415-serviceca\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxf79\" (UniqueName: \"kubernetes.io/projected/8f22dc14-8fec-4714-ac30-36fe0a25077f-kube-api-access-lxf79\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-var-lib-kubelet\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-device-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.706739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706725    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-daemon-config\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-iptables-alerter-script\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-systemd-units\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-multus\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-modprobe-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-var-lib-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-bin\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-config\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.706978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-conf-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73220400-0041-4a54-8349-6446c7c9f2a5-agent-certs\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-var-lib-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-systemd-units\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-bin\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-os-release\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-host-slash\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-run\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9hc\" (UniqueName: \"kubernetes.io/projected/98ad4d33-33ff-4903-8939-6df151f68c72-kube-api-access-5c9hc\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-env-overrides\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed509c9f-d6a6-467a-b776-c8d1671f2415-serviceca\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-system-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-socket-dir-parent\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-kubelet\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707632    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-conf\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-sys\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73220400-0041-4a54-8349-6446c7c9f2a5-konnectivity-ca\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-ovn\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.707822 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-iptables-alerter-script\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707870    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed509c9f-d6a6-467a-b776-c8d1671f2415-host\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707953    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.707977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-bin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708013    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-lib-modules\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-host-slash\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-etc-selinux\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-netns\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-log-socket\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmcp\" (UniqueName: \"kubernetes.io/projected/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-kube-api-access-gxmcp\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-env-overrides\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqw7\" (UniqueName: \"kubernetes.io/projected/336b9427-e19b-4563-a77e-6d1e9f9dff13-kube-api-access-6tqw7\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-ovn\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-tuned\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.708610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-dbus\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-kubelet\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708353    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-systemd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-log-socket\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-cnibin\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708600    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73220400-0041-4a54-8349-6446c7c9f2a5-konnectivity-ca\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysconfig\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-systemd\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-kubelet\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a98c3da3-aa1a-4139-84b1-88f9b1703936-hosts-file\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-cnibin\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708777    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed509c9f-d6a6-467a-b776-c8d1671f2415-host\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708800    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-systemd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-slash\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-netd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.709382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-run-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-slash\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-cni-netd\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708974    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-netns\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.708978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-k8s-cni-cncf-io\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bmf\" (UniqueName: \"kubernetes.io/projected/2daef6c5-3620-4336-8f5a-457787a6cf93-kube-api-access-c8bmf\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-host\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf6gj\" (UniqueName: \"kubernetes.io/projected/ed509c9f-d6a6-467a-b776-c8d1671f2415-kube-api-access-qf6gj\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709278    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-kubelet-config\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovn-node-metrics-cert\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-etc-kubernetes\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-tmp\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnw7p\" (UniqueName: \"kubernetes.io/projected/a98c3da3-aa1a-4139-84b1-88f9b1703936-kube-api-access-xnw7p\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-script-lib\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710165 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-system-cni-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709483    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709499    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8f22dc14-8fec-4714-ac30-36fe0a25077f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-os-release\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-hostroot\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-kubernetes\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz2sb\" (UniqueName: \"kubernetes.io/projected/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-kube-api-access-qz2sb\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-etc-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-host-run-ovn-kubernetes\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-etc-openvswitch\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.709966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f22dc14-8fec-4714-ac30-36fe0a25077f-system-cni-dir\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.710894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.710201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovnkube-script-lib\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.712002 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.711980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-ovn-node-metrics-cert\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.712107 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.712007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73220400-0041-4a54-8349-6446c7c9f2a5-agent-certs\") pod \"konnectivity-agent-nljlm\" (UID: \"73220400-0041-4a54-8349-6446c7c9f2a5\") " pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.715759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.715729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxf79\" (UniqueName: \"kubernetes.io/projected/8f22dc14-8fec-4714-ac30-36fe0a25077f-kube-api-access-lxf79\") pod \"multus-additional-cni-plugins-7j5w7\" (UID: \"8f22dc14-8fec-4714-ac30-36fe0a25077f\") " pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.717580 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.717557    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:01:48.717663 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.717585    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:01:48.717663 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.717605    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:48.717763 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.717675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:49.217646337 +0000 UTC m=+2.948338202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:48.718273 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.717871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf6gj\" (UniqueName: \"kubernetes.io/projected/ed509c9f-d6a6-467a-b776-c8d1671f2415-kube-api-access-qf6gj\") pod \"node-ca-ch7l9\" (UID: \"ed509c9f-d6a6-467a-b776-c8d1671f2415\") " pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.718273 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.718177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz2sb\" (UniqueName: \"kubernetes.io/projected/d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5-kube-api-access-qz2sb\") pod \"iptables-alerter-m7w6k\" (UID: \"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5\") " pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.719741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.719719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmcp\" (UniqueName: \"kubernetes.io/projected/b78bcc6a-a479-4eb3-af5a-6fe92426af2a-kube-api-access-gxmcp\") pod \"ovnkube-node-xncsx\" (UID: \"b78bcc6a-a479-4eb3-af5a-6fe92426af2a\") " pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.783027 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.782969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal" event={"ID":"3a4dd5d87507128fa706ef61307a77d9","Type":"ContainerStarted","Data":"67cfd48d759bd328616a1a0dccba60c86cca147934406dd0afbe71057afec879"}
Jul 22 20:01:48.785032 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.784997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal" event={"ID":"2cb6fd3ca4b20ada76316c0bc9b0e1a3","Type":"ContainerStarted","Data":"d65ebc237481a89f57e8335be19ebebcff8d084d0ecce888782817cbf6362a2e"}
Jul 22 20:01:48.810184 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-conf-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-run\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9hc\" (UniqueName: \"kubernetes.io/projected/98ad4d33-33ff-4903-8939-6df151f68c72-kube-api-access-5c9hc\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-system-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-socket-dir-parent\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-kubelet\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-conf\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810356    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-sys\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-bin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-lib-modules\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-etc-selinux\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810456    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqw7\" (UniqueName: \"kubernetes.io/projected/336b9427-e19b-4563-a77e-6d1e9f9dff13-kube-api-access-6tqw7\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-tuned\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-dbus\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810531    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysconfig\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-systemd\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a98c3da3-aa1a-4139-84b1-88f9b1703936-hosts-file\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-k8s-cni-cncf-io\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810662    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bmf\" (UniqueName: \"kubernetes.io/projected/2daef6c5-3620-4336-8f5a-457787a6cf93-kube-api-access-c8bmf\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.810687 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-host\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-kubelet-config\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-etc-kubernetes\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-tmp\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnw7p\" (UniqueName: \"kubernetes.io/projected/a98c3da3-aa1a-4139-84b1-88f9b1703936-kube-api-access-xnw7p\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810909    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-os-release\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810932    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-hostroot\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-kubernetes\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.810984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-multus-certs\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stnxm\" (UniqueName: \"kubernetes.io/projected/cdf26b52-3886-41a2-83a3-ad9d622590a7-kube-api-access-stnxm\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-socket-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-registration-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-sys-fs\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811110    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-cnibin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-cni-binary-copy\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811195    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-netns\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c3da3-aa1a-4139-84b1-88f9b1703936-tmp-dir\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.811305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-k8s-cni-cncf-io\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-var-lib-kubelet\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-device-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-daemon-config\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-multus\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-modprobe-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811659    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-modprobe-d\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-host\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-conf-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.811785    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.811862    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:49.311840766 +0000 UTC m=+3.042532656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.811927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-run\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-kubelet-config\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812168    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-etc-kubernetes\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-system-cni-dir\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-socket-dir-parent\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812299    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-kubelet\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysctl-conf\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-sys\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a98c3da3-aa1a-4139-84b1-88f9b1703936-hosts-file\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-systemd\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812595    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-device-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-bin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-lib-modules\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.812920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-etc-selinux\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-multus-daemon-config\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-var-lib-cni-multus\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.813324    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:48.813392    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:49.313376629 +0000 UTC m=+3.044068510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-sysconfig\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/41063cd5-8b22-4be6-b670-294312e455e7-dbus\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:48.813571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.812551    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-var-lib-kubelet\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.813939 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-socket-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.813939 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-os-release\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.813939 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813909    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-hostroot\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.814077 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.813960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-kubernetes\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.814077 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-multus-certs\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c3da3-aa1a-4139-84b1-88f9b1703936-tmp-dir\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-host-run-netns\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/336b9427-e19b-4563-a77e-6d1e9f9dff13-cni-binary-copy\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/336b9427-e19b-4563-a77e-6d1e9f9dff13-cnibin\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-sys-fs\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.814755 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.814716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/98ad4d33-33ff-4903-8939-6df151f68c72-registration-dir\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.816630 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.816609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-tmp\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.816764 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.816743    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cdf26b52-3886-41a2-83a3-ad9d622590a7-etc-tuned\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.830417 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.830357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9hc\" (UniqueName: \"kubernetes.io/projected/98ad4d33-33ff-4903-8939-6df151f68c72-kube-api-access-5c9hc\") pod \"aws-ebs-csi-driver-node-m86sl\" (UID: \"98ad4d33-33ff-4903-8939-6df151f68c72\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.832137 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.832107    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnw7p\" (UniqueName: \"kubernetes.io/projected/a98c3da3-aa1a-4139-84b1-88f9b1703936-kube-api-access-xnw7p\") pod \"node-resolver-vzx2n\" (UID: \"a98c3da3-aa1a-4139-84b1-88f9b1703936\") " pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.832593 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.832568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bmf\" (UniqueName: \"kubernetes.io/projected/2daef6c5-3620-4336-8f5a-457787a6cf93-kube-api-access-c8bmf\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:48.836076 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.836053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqw7\" (UniqueName: \"kubernetes.io/projected/336b9427-e19b-4563-a77e-6d1e9f9dff13-kube-api-access-6tqw7\") pod \"multus-5j5cn\" (UID: \"336b9427-e19b-4563-a77e-6d1e9f9dff13\") " pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.836458 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.836433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stnxm\" (UniqueName: \"kubernetes.io/projected/cdf26b52-3886-41a2-83a3-ad9d622590a7-kube-api-access-stnxm\") pod \"tuned-gvxq8\" (UID: \"cdf26b52-3886-41a2-83a3-ad9d622590a7\") " pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.896353 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.896322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:01:48.905181 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.905088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7w6k"
Jul 22 20:01:48.907858 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.907826    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73220400_0041_4a54_8349_6446c7c9f2a5.slice/crio-ac108b93f72f52a6d3ad3ba87282c9993d518700e27cd178f762efe3915638a5 WatchSource:0}: Error finding container ac108b93f72f52a6d3ad3ba87282c9993d518700e27cd178f762efe3915638a5: Status 404 returned error can't find the container with id ac108b93f72f52a6d3ad3ba87282c9993d518700e27cd178f762efe3915638a5
Jul 22 20:01:48.914309 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.914283    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a1c8a0_6e2d_4c71_b9bb_5d6de8a254f5.slice/crio-33ca6c78ea3620c8959dcc3c6909acb248b31363286c5223aa6c7dbc74040fd6 WatchSource:0}: Error finding container 33ca6c78ea3620c8959dcc3c6909acb248b31363286c5223aa6c7dbc74040fd6: Status 404 returned error can't find the container with id 33ca6c78ea3620c8959dcc3c6909acb248b31363286c5223aa6c7dbc74040fd6
Jul 22 20:01:48.915198 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.915178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ch7l9"
Jul 22 20:01:48.920346 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.920326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7j5w7"
Jul 22 20:01:48.926116 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.926088    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded509c9f_d6a6_467a_b776_c8d1671f2415.slice/crio-48dd8965ea624ce554d68460e70f36a1add2a1638533ff36319e5e726381c9c1 WatchSource:0}: Error finding container 48dd8965ea624ce554d68460e70f36a1add2a1638533ff36319e5e726381c9c1: Status 404 returned error can't find the container with id 48dd8965ea624ce554d68460e70f36a1add2a1638533ff36319e5e726381c9c1
Jul 22 20:01:48.926993 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.926974    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:01:48.931386 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.931362    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f22dc14_8fec_4714_ac30_36fe0a25077f.slice/crio-d858665f31de15e53ea4dd5683b7c71a5e103435626ac4de6042366cc5f35611 WatchSource:0}: Error finding container d858665f31de15e53ea4dd5683b7c71a5e103435626ac4de6042366cc5f35611: Status 404 returned error can't find the container with id d858665f31de15e53ea4dd5683b7c71a5e103435626ac4de6042366cc5f35611
Jul 22 20:01:48.934342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.934322    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gvxq8"
Jul 22 20:01:48.938509 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.938482    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78bcc6a_a479_4eb3_af5a_6fe92426af2a.slice/crio-880ac19e5759f2a196d76ad6f0c961cd631c7c3fd7f5103e7638c68246fb5c86 WatchSource:0}: Error finding container 880ac19e5759f2a196d76ad6f0c961cd631c7c3fd7f5103e7638c68246fb5c86: Status 404 returned error can't find the container with id 880ac19e5759f2a196d76ad6f0c961cd631c7c3fd7f5103e7638c68246fb5c86
Jul 22 20:01:48.943274 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.943217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl"
Jul 22 20:01:48.944656 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.944634    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf26b52_3886_41a2_83a3_ad9d622590a7.slice/crio-76fd42b62dd7cc466bbcc37588c98b6f6dab033de133f1f75ec9671285aa4f11 WatchSource:0}: Error finding container 76fd42b62dd7cc466bbcc37588c98b6f6dab033de133f1f75ec9671285aa4f11: Status 404 returned error can't find the container with id 76fd42b62dd7cc466bbcc37588c98b6f6dab033de133f1f75ec9671285aa4f11
Jul 22 20:01:48.949954 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.949930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vzx2n"
Jul 22 20:01:48.953961 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.953936    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ad4d33_33ff_4903_8939_6df151f68c72.slice/crio-d6cc5f85575f3c4d6f043efe2a45ff4906749732e2da934d7e730256bd4fc970 WatchSource:0}: Error finding container d6cc5f85575f3c4d6f043efe2a45ff4906749732e2da934d7e730256bd4fc970: Status 404 returned error can't find the container with id d6cc5f85575f3c4d6f043efe2a45ff4906749732e2da934d7e730256bd4fc970
Jul 22 20:01:48.954360 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:48.954342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5j5cn"
Jul 22 20:01:48.964618 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.964570    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98c3da3_aa1a_4139_84b1_88f9b1703936.slice/crio-c9a843ab62dfeb481e1223becd16e82553d430620055bd9e17b4830cb739fa9c WatchSource:0}: Error finding container c9a843ab62dfeb481e1223becd16e82553d430620055bd9e17b4830cb739fa9c: Status 404 returned error can't find the container with id c9a843ab62dfeb481e1223becd16e82553d430620055bd9e17b4830cb739fa9c
Jul 22 20:01:48.967298 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:01:48.967275    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336b9427_e19b_4563_a77e_6d1e9f9dff13.slice/crio-5bc1990d1fe7b11d611c3af83d6406e49f00eed789bf46b5cd16b5b4baa78f5d WatchSource:0}: Error finding container 5bc1990d1fe7b11d611c3af83d6406e49f00eed789bf46b5cd16b5b4baa78f5d: Status 404 returned error can't find the container with id 5bc1990d1fe7b11d611c3af83d6406e49f00eed789bf46b5cd16b5b4baa78f5d
Jul 22 20:01:49.122507 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.122481    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 20:01:49.315287 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.315254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:49.315483 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.315322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:49.315483 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.315383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:49.315483 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315442    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:01:49.315483 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315470    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:01:49.315483 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315484    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:49.315744 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315503    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:49.315744 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315546    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:50.315527363 +0000 UTC m=+4.046219253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:49.315744 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315569    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:50.31555849 +0000 UTC m=+4.046250357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:49.315744 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315593    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:49.315744 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.315628    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:50.315613789 +0000 UTC m=+4.046305653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:49.639688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.639643    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 19:56:48 +0000 UTC" deadline="2028-02-17 16:55:23.291881768 +0000 UTC"
Jul 22 20:01:49.639688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.639672    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13796h53m33.652213139s"
Jul 22 20:01:49.773510 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.773472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:49.773656 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.773492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:49.773656 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.773587    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:49.773728 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:49.773671    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:49.788219 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.788186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ch7l9" event={"ID":"ed509c9f-d6a6-467a-b776-c8d1671f2415","Type":"ContainerStarted","Data":"48dd8965ea624ce554d68460e70f36a1add2a1638533ff36319e5e726381c9c1"}
Jul 22 20:01:49.789328 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.789300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7w6k" event={"ID":"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5","Type":"ContainerStarted","Data":"33ca6c78ea3620c8959dcc3c6909acb248b31363286c5223aa6c7dbc74040fd6"}
Jul 22 20:01:49.790399 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.790374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5j5cn" event={"ID":"336b9427-e19b-4563-a77e-6d1e9f9dff13","Type":"ContainerStarted","Data":"5bc1990d1fe7b11d611c3af83d6406e49f00eed789bf46b5cd16b5b4baa78f5d"}
Jul 22 20:01:49.791496 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.791458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl" event={"ID":"98ad4d33-33ff-4903-8939-6df151f68c72","Type":"ContainerStarted","Data":"d6cc5f85575f3c4d6f043efe2a45ff4906749732e2da934d7e730256bd4fc970"}
Jul 22 20:01:49.792474 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.792451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gvxq8" event={"ID":"cdf26b52-3886-41a2-83a3-ad9d622590a7","Type":"ContainerStarted","Data":"76fd42b62dd7cc466bbcc37588c98b6f6dab033de133f1f75ec9671285aa4f11"}
Jul 22 20:01:49.793513 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.793484    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerStarted","Data":"d858665f31de15e53ea4dd5683b7c71a5e103435626ac4de6042366cc5f35611"}
Jul 22 20:01:49.794520 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.794493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nljlm" event={"ID":"73220400-0041-4a54-8349-6446c7c9f2a5","Type":"ContainerStarted","Data":"ac108b93f72f52a6d3ad3ba87282c9993d518700e27cd178f762efe3915638a5"}
Jul 22 20:01:49.795579 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.795560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzx2n" event={"ID":"a98c3da3-aa1a-4139-84b1-88f9b1703936","Type":"ContainerStarted","Data":"c9a843ab62dfeb481e1223becd16e82553d430620055bd9e17b4830cb739fa9c"}
Jul 22 20:01:49.796721 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:49.796700    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"880ac19e5759f2a196d76ad6f0c961cd631c7c3fd7f5103e7638c68246fb5c86"}
Jul 22 20:01:50.322715 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.322656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:50.322910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.322738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:50.322910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.322783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:50.323009 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.322921    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:01:50.323009 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.322939    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:01:50.323009 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.322951    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:50.323009 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.323006    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:52.322989178 +0000 UTC m=+6.053681047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:50.323486 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.323450    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:50.323585 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.323511    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:52.323495687 +0000 UTC m=+6.054187558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:50.323585 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.323564    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:50.323692 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.323593    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:52.32358332 +0000 UTC m=+6.054275191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:50.640913 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.640628    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 19:56:48 +0000 UTC" deadline="2028-01-12 13:15:10.957290111 +0000 UTC"
Jul 22 20:01:50.640913 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.640913    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12929h13m20.316381868s"
Jul 22 20:01:50.776315 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.775782    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:50.776315 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:50.775950    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:50.810134 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:50.810098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal" event={"ID":"3a4dd5d87507128fa706ef61307a77d9","Type":"ContainerStarted","Data":"5b262ec9b75f3828f188be5eea3f2403ab3e319d782f19bada183bd041d47fe7"}
Jul 22 20:01:51.773285 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:51.773247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:51.773835 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:51.773384    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:51.773835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:51.773773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:51.773971 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:51.773866    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:51.821594 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:51.821243    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal" event={"ID":"2cb6fd3ca4b20ada76316c0bc9b0e1a3","Type":"ContainerStarted","Data":"ebc756e76794c782c4759c3df277ceabf247d6602b6f9a9ea2e4d97160137ae1"}
Jul 22 20:01:51.836334 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:51.836231    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-202.ec2.internal" podStartSLOduration=4.836209065 podStartE2EDuration="4.836209065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:01:50.827611196 +0000 UTC m=+4.558303085" watchObservedRunningTime="2026-07-22 20:01:51.836209065 +0000 UTC m=+5.566900954"
Jul 22 20:01:52.340669 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:52.340615    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:52.340854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:52.340675    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:52.340854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:52.340720    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:52.340962 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.340857    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:52.340962 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.340917    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:56.340898059 +0000 UTC m=+10.071589927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:52.341077 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.340980    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:52.341077 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.341012    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:56.341001323 +0000 UTC m=+10.071693194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:52.341242 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.341097    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:01:52.341242 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.341110    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:01:52.341242 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.341123    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:52.341242 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.341177    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:01:56.341165473 +0000 UTC m=+10.071857343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:52.775963 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:52.775095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:52.775963 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:52.775522    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:53.773230 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:53.772995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:53.773230 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:53.773115    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:53.773230 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:53.773175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:53.773514 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:53.773269    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:54.773708 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:54.773646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:54.774194 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:54.773795    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:55.773475 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:55.772858    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:55.773475 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:55.772991    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:55.773475 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:55.773365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:55.773475 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:55.773435    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:56.376826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.376783    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.376917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.376968    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.376999    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377011    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377059    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:04.377044878 +0000 UTC m=+18.107736742 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377070    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377132    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:04.377115964 +0000 UTC m=+18.107807850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.376977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377213    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:56.377309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.377262    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:04.37724928 +0000 UTC m=+18.107941148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:01:56.773902 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.773824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:56.774058 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:56.773924    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:56.833369 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.833327    2582 generic.go:356] "Generic (PLEG): container finished" podID="2cb6fd3ca4b20ada76316c0bc9b0e1a3" containerID="ebc756e76794c782c4759c3df277ceabf247d6602b6f9a9ea2e4d97160137ae1" exitCode=0
Jul 22 20:01:56.833369 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:56.833380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal" event={"ID":"2cb6fd3ca4b20ada76316c0bc9b0e1a3","Type":"ContainerDied","Data":"ebc756e76794c782c4759c3df277ceabf247d6602b6f9a9ea2e4d97160137ae1"}
Jul 22 20:01:57.773610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:57.773539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:57.774076 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:57.773549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:57.774076 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:57.773682    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:01:57.774076 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:57.773709    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:58.773569 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:58.773538    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:01:58.773746 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:58.773678    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:01:59.773486 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:59.773451    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:01:59.773634 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:01:59.773458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:01:59.773634 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:59.773563    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:01:59.773727 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:01:59.773640    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:00.773042 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:00.773004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:00.773507 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:00.773134    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:01.773763 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:01.773723    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:01.774267 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:01.773733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:01.774267 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:01.773839    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:01.774267 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:01.773911    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:02.773724 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:02.773692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:02.773885 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:02.773828    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:03.772991 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:03.772964    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:03.773177 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:03.773092    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:03.773177 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:03.773135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:03.773265 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:03.773246    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:04.438926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:04.438889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:04.438926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:04.438936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:04.438976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439072    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439091    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439116    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439133    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439163    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439168    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:20.43913133 +0000 UTC m=+34.169823217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439187    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:20.439177623 +0000 UTC m=+34.169869489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:02:04.439464 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.439202    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:20.439192025 +0000 UTC m=+34.169883896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:02:04.773409 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:04.773320    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:04.773563 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:04.773465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:05.773632 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:05.773599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:05.773632 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:05.773620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:05.774207 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:05.773727    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:05.774207 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:05.773843    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:06.774014 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:06.773981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:06.774456 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:06.774088    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:07.773141 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:07.773105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:07.773358 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:07.773174    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:07.773358 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:07.773264    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:07.773478 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:07.773419    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:08.773268 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.773247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:08.773611 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:08.773352    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:08.870575 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.870543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5j5cn" event={"ID":"336b9427-e19b-4563-a77e-6d1e9f9dff13","Type":"ContainerStarted","Data":"1e2db7bc0330e9139504f4d7aadc9d8ac53cdb38b44ed757e047d68f5214c046"}
Jul 22 20:02:08.872025 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.872002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl" event={"ID":"98ad4d33-33ff-4903-8939-6df151f68c72","Type":"ContainerStarted","Data":"da5467c2e2fa3a1186bad6bf2063a639b87e1925ebe7d79306607e119fada15e"}
Jul 22 20:02:08.873317 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.873296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gvxq8" event={"ID":"cdf26b52-3886-41a2-83a3-ad9d622590a7","Type":"ContainerStarted","Data":"f3deed9c128c67f1562b4e91acf7c1194cb6428492fa700e9fd798d8c545ecaf"}
Jul 22 20:02:08.874789 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.874767    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="7c0a48000f372f289a41dddc97b61e1496bf0b868e3ad7986fcd0990b3cab2c9" exitCode=0
Jul 22 20:02:08.874886 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.874830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"7c0a48000f372f289a41dddc97b61e1496bf0b868e3ad7986fcd0990b3cab2c9"}
Jul 22 20:02:08.876293 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.876258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nljlm" event={"ID":"73220400-0041-4a54-8349-6446c7c9f2a5","Type":"ContainerStarted","Data":"b0ca114da94b6bb7bf350e1344c6a96c12c469fd7e3e9858560a24e047e21dc5"}
Jul 22 20:02:08.878124 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.878103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal" event={"ID":"2cb6fd3ca4b20ada76316c0bc9b0e1a3","Type":"ContainerStarted","Data":"4fa8581ea9253a8113742d814ceb04b15c7fef801a11f3b51240fb69a2293b06"}
Jul 22 20:02:08.879663 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.879640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vzx2n" event={"ID":"a98c3da3-aa1a-4139-84b1-88f9b1703936","Type":"ContainerStarted","Data":"85adb3a717531cf60dfdac78bd760098d7ed1571f2af15eee54a3be858ab6f99"}
Jul 22 20:02:08.883975 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.883954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:02:08.884308 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.884291    2582 generic.go:356] "Generic (PLEG): container finished" podID="b78bcc6a-a479-4eb3-af5a-6fe92426af2a" containerID="ac41211cfc84af8b7904101ca54f0428e6861198c4e44ce8c7daf53a97943770" exitCode=1
Jul 22 20:02:08.884379 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.884358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"91a19e0f8edda752dca72439a0c8f1c45e4e51b28076de4ef546cfa1a46af7f2"}
Jul 22 20:02:08.884434 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.884416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerDied","Data":"ac41211cfc84af8b7904101ca54f0428e6861198c4e44ce8c7daf53a97943770"}
Jul 22 20:02:08.884516 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.884458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"2a4ea37f6fed51430efcc2456c3f6ca4a9a37984211b37293748b5ea806a7cfc"}
Jul 22 20:02:08.885424 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.885406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ch7l9" event={"ID":"ed509c9f-d6a6-467a-b776-c8d1671f2415","Type":"ContainerStarted","Data":"51a0aa9b80df9cd14c49eb9ab13376fcbb49d6d150a3fef9857f42d24b59a417"}
Jul 22 20:02:08.888139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.888104    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5j5cn" podStartSLOduration=3.555604959 podStartE2EDuration="22.888091868s" totalImagesPullingTime="19.332486909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.887504352 +0000 UTC m=+22.618196239" watchObservedRunningTime="2026-07-22 20:02:08.888091868 +0000 UTC m=+22.618783754"
Jul 22 20:02:08.902471 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.902421    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ch7l9" podStartSLOduration=3.563043667 podStartE2EDuration="22.902409327s" totalImagesPullingTime="19.33936566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.901996146 +0000 UTC m=+22.632688033" watchObservedRunningTime="2026-07-22 20:02:08.902409327 +0000 UTC m=+22.633101226"
Jul 22 20:02:08.940050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.939673    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gvxq8" podStartSLOduration=3.640968707 podStartE2EDuration="22.939652589s" totalImagesPullingTime="19.298683882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.939267056 +0000 UTC m=+22.669958945" watchObservedRunningTime="2026-07-22 20:02:08.939652589 +0000 UTC m=+22.670344477"
Jul 22 20:02:08.955509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.955454    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vzx2n" podStartSLOduration=3.653432756 podStartE2EDuration="22.955429293s" totalImagesPullingTime="19.301996537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.954762776 +0000 UTC m=+22.685454662" watchObservedRunningTime="2026-07-22 20:02:08.955429293 +0000 UTC m=+22.686121183"
Jul 22 20:02:08.975001 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:08.974957    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-202.ec2.internal" podStartSLOduration=21.974942927 podStartE2EDuration="21.974942927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.974594713 +0000 UTC m=+22.705286601" watchObservedRunningTime="2026-07-22 20:02:08.974942927 +0000 UTC m=+22.705634814"
Jul 22 20:02:09.773603 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.773560    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:09.774255 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:09.773668    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:09.774255 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.773726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:09.774255 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:09.773818    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:09.890716 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.890641    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:02:09.891022 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.890997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"65ff0f9bfbe5da2a84835af5975ec0823857a87e66e29835507ac024a4672a45"}
Jul 22 20:02:09.891142 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.891080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"af77bc086ad02fa20bc28d23eaff81dd8edb7a5f8cb787cd14509c8be92c506d"}
Jul 22 20:02:09.891142 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.891132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"0ccc25776c89720e8c6c052ee016a5df55dabe57e0c2e8fdb5bde15180e5b413"}
Jul 22 20:02:09.892661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.892637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7w6k" event={"ID":"d7a1c8a0-6e2d-4c71-b9bb-5d6de8a254f5","Type":"ContainerStarted","Data":"1d97230745d72a0af946dc97bda25f5ca1d12d31b05fbd846df7439c7193f06d"}
Jul 22 20:02:09.908040 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.907996    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nljlm" podStartSLOduration=9.093097339 podStartE2EDuration="23.9079814s" totalImagesPullingTime="14.814884061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:08.992116375 +0000 UTC m=+22.722808264" watchObservedRunningTime="2026-07-22 20:02:09.9079814 +0000 UTC m=+23.638673286"
Jul 22 20:02:09.908294 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:09.908274    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m7w6k" podStartSLOduration=4.579962505 podStartE2EDuration="23.908267655s" totalImagesPullingTime="19.32830515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:09.9078756 +0000 UTC m=+23.638567488" watchObservedRunningTime="2026-07-22 20:02:09.908267655 +0000 UTC m=+23.638959539"
Jul 22 20:02:10.426629 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:10.426594    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:02:10.427125 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:10.427108    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:02:10.773554 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:10.773465    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:10.773713 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:10.773612    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:10.895356 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:10.895313    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:02:10.895845 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:10.895817    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nljlm"
Jul 22 20:02:11.596498 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.596478    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 20:02:11.673455 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.673342    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T20:02:11.596495609Z","UUID":"a8d43b7e-6db4-4084-b853-56d73a3f8864","Handler":null,"Name":"","Endpoint":""}
Jul 22 20:02:11.675117 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.675088    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 20:02:11.675262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.675130    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 20:02:11.773799 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.773700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:11.774275 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:11.773824    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:11.774275 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.773877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:11.774275 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:11.773975    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:11.899347 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.899313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl" event={"ID":"98ad4d33-33ff-4903-8939-6df151f68c72","Type":"ContainerStarted","Data":"62ecd883d25fa94fda2236d0be1ffae62a00ae13b6c23b5b567e4890e8b46ff7"}
Jul 22 20:02:11.903074 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.903045    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:02:11.903563 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:11.903535    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"fa7bcad2909dd71f5836cad53600881f0517d4129c60d80828d68afe4b459cae"}
Jul 22 20:02:12.773688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:12.773354    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:12.773881 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:12.773737    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:13.773091 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.773005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:13.773280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.773005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:13.773280 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:13.773132    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:13.773280 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:13.773211    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:13.910501 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.910466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl" event={"ID":"98ad4d33-33ff-4903-8939-6df151f68c72","Type":"ContainerStarted","Data":"9dbc06fa43941edc19ad5f4bc5e670b1ba47e87eebe6e3b36ad33837c54bf814"}
Jul 22 20:02:13.914101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.914075    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:02:13.914480 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.914457    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"4b6cd38657f4d73fd25605d11cda8641b75a458a405075b10c180b0bd853f4da"}
Jul 22 20:02:13.914779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.914752    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:13.914876 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.914833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:13.914926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.914903    2582 scope.go:117] "RemoveContainer" containerID="ac41211cfc84af8b7904101ca54f0428e6861198c4e44ce8c7daf53a97943770"
Jul 22 20:02:13.931667 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.931451    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:13.931776 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:13.931458    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m86sl" podStartSLOduration=4.050197624 podStartE2EDuration="27.931441105s" totalImagesPullingTime="23.881243481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:13.931330976 +0000 UTC m=+27.662022864" watchObservedRunningTime="2026-07-22 20:02:13.931441105 +0000 UTC m=+27.662132999"
Jul 22 20:02:14.773830 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:14.773800    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:14.773994 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:14.773932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:15.352066 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.352042    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vgksv"]
Jul 22 20:02:15.352388 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.352162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:15.352388 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:15.352239    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:15.355988 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.355953    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gklkp"]
Jul 22 20:02:15.356127 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.356079    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:15.356209 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:15.356181    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:15.356801 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.356764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqz6z"]
Jul 22 20:02:15.356894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.356852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:15.356949 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:15.356925    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:15.920747 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.920660    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="97b272d03b8cb7e9a6f40031979cb4b6bff897c76ac3128d96fc9c5f45c5fca1" exitCode=0
Jul 22 20:02:15.920908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.920748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"97b272d03b8cb7e9a6f40031979cb4b6bff897c76ac3128d96fc9c5f45c5fca1"}
Jul 22 20:02:15.924839 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.924817    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:02:15.925246 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.925222    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" event={"ID":"b78bcc6a-a479-4eb3-af5a-6fe92426af2a","Type":"ContainerStarted","Data":"a2167aaadd2ec65bb505c6c8d48f8759460c202547e516e706d7d1be334e5506"}
Jul 22 20:02:15.925477 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.925451    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:15.940620 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.940593    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:15.963104 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:15.963063    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx" podStartSLOduration=10.406467542 podStartE2EDuration="29.963046744s" totalImagesPullingTime="19.556579202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:15.96230225 +0000 UTC m=+29.692994137" watchObservedRunningTime="2026-07-22 20:02:15.963046744 +0000 UTC m=+29.693738632"
Jul 22 20:02:16.776933 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:16.776752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:16.777336 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:16.776789    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:16.777336 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:16.776998    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:16.777336 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:16.777071    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:16.777336 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:16.776803    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:16.777336 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:16.777142    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:18.773248 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:18.773189    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:18.773694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:18.773260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:18.773694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:18.773260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:18.773694 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:18.773343    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:18.773694 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:18.773439    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:18.773694 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:18.773514    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:20.455103 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.455046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:20.455103 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.455109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.455171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455226    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455263    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455283    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455300    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret podName:41063cd5-8b22-4be6-b670-294312e455e7 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:52.455278274 +0000 UTC m=+66.185970164 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret") pod "global-pull-secret-syncer-vgksv" (UID: "41063cd5-8b22-4be6-b670-294312e455e7") : object "kube-system"/"original-pull-secret" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455305    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455315    2582 projected.go:196] Error preparing data for projected volume kube-api-access-79nqh for pod openshift-network-diagnostics/network-check-target-gklkp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455316    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:52.455308887 +0000 UTC m=+66.186000752 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 20:02:20.455719 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.455370    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh podName:1b46eccf-ba09-4d6b-9a77-73ff1d3af690 nodeName:}" failed. No retries permitted until 2026-07-22 20:02:52.45535141 +0000 UTC m=+66.186043275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-79nqh" (UniqueName: "kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh") pod "network-check-target-gklkp" (UID: "1b46eccf-ba09-4d6b-9a77-73ff1d3af690") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 20:02:20.776277 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.776210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:20.776421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.776211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:20.776421 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.776304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vgksv" podUID="41063cd5-8b22-4be6-b670-294312e455e7"
Jul 22 20:02:20.776421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:20.776214    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:20.776421 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.776374    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gklkp" podUID="1b46eccf-ba09-4d6b-9a77-73ff1d3af690"
Jul 22 20:02:20.776583 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:20.776453    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:02:21.110964 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.110935    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-202.ec2.internal" event="NodeReady"
Jul 22 20:02:21.111117 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.111066    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 20:02:21.154796 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.154766    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s9nph"]
Jul 22 20:02:21.205452 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.205414    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cc7zn"]
Jul 22 20:02:21.205603 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.205549    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.208087 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.208062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 20:02:21.208087 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.208084    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbn42\""
Jul 22 20:02:21.208331 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.208316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 20:02:21.226292 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.226261    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9nph"]
Jul 22 20:02:21.226292 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.226298    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc7zn"]
Jul 22 20:02:21.226467 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.226372    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.228978 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.228956    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 20:02:21.229326 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.229309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 20:02:21.229390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.229324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 20:02:21.229390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.229345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9cx5s\""
Jul 22 20:02:21.361131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad83725-93b2-413a-92fc-5b33791f8396-cert\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.361131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.361131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-tmp-dir\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.361354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361165    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pp4m\" (UniqueName: \"kubernetes.io/projected/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-kube-api-access-9pp4m\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.361354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7zxs\" (UniqueName: \"kubernetes.io/projected/4ad83725-93b2-413a-92fc-5b33791f8396-kube-api-access-z7zxs\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.361354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.361286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-config-volume\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.462375 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad83725-93b2-413a-92fc-5b33791f8396-cert\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.462375 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462393    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-tmp-dir\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:21.462508    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pp4m\" (UniqueName: \"kubernetes.io/projected/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-kube-api-access-9pp4m\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:21.462584    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:21.962561731 +0000 UTC m=+35.693253619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7zxs\" (UniqueName: \"kubernetes.io/projected/4ad83725-93b2-413a-92fc-5b33791f8396-kube-api-access-z7zxs\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-tmp-dir\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.462931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.462666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-config-volume\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.463253 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.463123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-config-volume\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.466523 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.466504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad83725-93b2-413a-92fc-5b33791f8396-cert\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.470790 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.470764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7zxs\" (UniqueName: \"kubernetes.io/projected/4ad83725-93b2-413a-92fc-5b33791f8396-kube-api-access-z7zxs\") pod \"ingress-canary-cc7zn\" (UID: \"4ad83725-93b2-413a-92fc-5b33791f8396\") " pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.470907 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.470831    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pp4m\" (UniqueName: \"kubernetes.io/projected/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-kube-api-access-9pp4m\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.535219 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.535181    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cc7zn"
Jul 22 20:02:21.736299 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.736099    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cc7zn"]
Jul 22 20:02:21.739939 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:02:21.739913    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad83725_93b2_413a_92fc_5b33791f8396.slice/crio-61633c76a8fd7dd41f03750ff0102419cf2bb6a7fb5a6f3a554e3caaccda5e09 WatchSource:0}: Error finding container 61633c76a8fd7dd41f03750ff0102419cf2bb6a7fb5a6f3a554e3caaccda5e09: Status 404 returned error can't find the container with id 61633c76a8fd7dd41f03750ff0102419cf2bb6a7fb5a6f3a554e3caaccda5e09
Jul 22 20:02:21.938989 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.938879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc7zn" event={"ID":"4ad83725-93b2-413a-92fc-5b33791f8396","Type":"ContainerStarted","Data":"61633c76a8fd7dd41f03750ff0102419cf2bb6a7fb5a6f3a554e3caaccda5e09"}
Jul 22 20:02:21.966214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:21.966179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:21.966347 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:21.966328    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:21.966405 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:21.966395    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:22.966377642 +0000 UTC m=+36.697069510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:22.773046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.773017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:22.773046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.773057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:22.773661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.773017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:22.775785 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.775757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 20:02:22.775910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.775878    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l85mx\""
Jul 22 20:02:22.776053 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.776035    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 20:02:22.776160 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.776036    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nrd5t\""
Jul 22 20:02:22.776740 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.776496    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 20:02:22.776740 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.776541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 20:02:22.943470 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.943436    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="338958385a4e78329c1539fd75b2a0431fa4765757b9d834fca3059b9ea67fdc" exitCode=0
Jul 22 20:02:22.943639 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.943514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"338958385a4e78329c1539fd75b2a0431fa4765757b9d834fca3059b9ea67fdc"}
Jul 22 20:02:22.973923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:22.973887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:22.974126 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:22.974034    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:22.974126 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:22.974101    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:24.974081295 +0000 UTC m=+38.704773178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:24.950646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:24.950595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cc7zn" event={"ID":"4ad83725-93b2-413a-92fc-5b33791f8396","Type":"ContainerStarted","Data":"0965502eafb9f674edc2ab573a60d70090d49e0ca38dec25475b3f117d3fa4ef"}
Jul 22 20:02:24.953057 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:24.953030    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="54e116c80a0061ef05a231a2d805495ca233401bbb28efea2d8c07defda4ed40" exitCode=0
Jul 22 20:02:24.953224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:24.953072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"54e116c80a0061ef05a231a2d805495ca233401bbb28efea2d8c07defda4ed40"}
Jul 22 20:02:24.965373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:24.965175    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cc7zn" podStartSLOduration=0.887441003 podStartE2EDuration="3.965139472s" totalImagesPullingTime="3.077698469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:24.964497554 +0000 UTC m=+38.695189441" watchObservedRunningTime="2026-07-22 20:02:24.965139472 +0000 UTC m=+38.695831362"
Jul 22 20:02:24.991921 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:24.991891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:24.992090 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:24.992050    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:24.992135 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:24.992119    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:28.992101592 +0000 UTC m=+42.722793460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:29.026908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:29.026861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:29.027439 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:29.027008    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:29.027439 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:29.027074    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:37.027058206 +0000 UTC m=+50.757750082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:30.971419 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:30.971381    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="80ecbce94686c22cff1f8367c3cdf65e79ef3e65edae6e2ea54955b48493b597" exitCode=0
Jul 22 20:02:30.971893 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:30.971439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"80ecbce94686c22cff1f8367c3cdf65e79ef3e65edae6e2ea54955b48493b597"}
Jul 22 20:02:31.976748 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:31.976716    2582 generic.go:356] "Generic (PLEG): container finished" podID="8f22dc14-8fec-4714-ac30-36fe0a25077f" containerID="03fd9c9d739d676400e8814a384c005c9a9e9d038707608a73450fee7aad4b3a" exitCode=0
Jul 22 20:02:31.976748 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:31.976755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerDied","Data":"03fd9c9d739d676400e8814a384c005c9a9e9d038707608a73450fee7aad4b3a"}
Jul 22 20:02:32.982235 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:32.982204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" event={"ID":"8f22dc14-8fec-4714-ac30-36fe0a25077f","Type":"ContainerStarted","Data":"d4363a83e2107cc898ce81b130a681089945340c686277c53fb00e5bc0eb6c7d"}
Jul 22 20:02:33.003524 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:33.003460    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7j5w7" podStartSLOduration=7.348624295 podStartE2EDuration="47.003439361s" totalImagesPullingTime="39.654815066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:33.00244579 +0000 UTC m=+46.733137676" watchObservedRunningTime="2026-07-22 20:02:33.003439361 +0000 UTC m=+46.734131249"
Jul 22 20:02:37.086889 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:37.086845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:37.087405 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:37.087004    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:37.087405 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:37.087071    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:02:53.087055541 +0000 UTC m=+66.817747406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:45.488445 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.488406    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"]
Jul 22 20:02:45.494383 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.494337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.497493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.497465    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 20:02:45.497493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.497466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 20:02:45.497701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.497487    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 20:02:45.497701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.497596    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 20:02:45.501759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.501737    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"]
Jul 22 20:02:45.548739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.548702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91d22b4-c574-46d3-b639-4df07eb06d67-tmp\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.548910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.548762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e91d22b4-c574-46d3-b639-4df07eb06d67-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.548910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.548802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzbn\" (UniqueName: \"kubernetes.io/projected/e91d22b4-c574-46d3-b639-4df07eb06d67-kube-api-access-4mzbn\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.649601 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.649557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91d22b4-c574-46d3-b639-4df07eb06d67-tmp\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.649776 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.649619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e91d22b4-c574-46d3-b639-4df07eb06d67-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.649776 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.649638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzbn\" (UniqueName: \"kubernetes.io/projected/e91d22b4-c574-46d3-b639-4df07eb06d67-kube-api-access-4mzbn\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.649987 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.649965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91d22b4-c574-46d3-b639-4df07eb06d67-tmp\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.653647 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.653618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e91d22b4-c574-46d3-b639-4df07eb06d67-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.657158 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.657116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzbn\" (UniqueName: \"kubernetes.io/projected/e91d22b4-c574-46d3-b639-4df07eb06d67-kube-api-access-4mzbn\") pod \"klusterlet-addon-workmgr-7fdc5684d9-cc4lk\" (UID: \"e91d22b4-c574-46d3-b639-4df07eb06d67\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.804642 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.804550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:45.923859 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:45.923829    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"]
Jul 22 20:02:45.926552 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:02:45.926517    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91d22b4_c574_46d3_b639_4df07eb06d67.slice/crio-be8699123fccfc0158300de7394428cf1ffa10b4be329ca8bdbda7635dbc13a1 WatchSource:0}: Error finding container be8699123fccfc0158300de7394428cf1ffa10b4be329ca8bdbda7635dbc13a1: Status 404 returned error can't find the container with id be8699123fccfc0158300de7394428cf1ffa10b4be329ca8bdbda7635dbc13a1
Jul 22 20:02:46.013570 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:46.013533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk" event={"ID":"e91d22b4-c574-46d3-b639-4df07eb06d67","Type":"ContainerStarted","Data":"be8699123fccfc0158300de7394428cf1ffa10b4be329ca8bdbda7635dbc13a1"}
Jul 22 20:02:47.941801 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:47.941771    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xncsx"
Jul 22 20:02:52.029131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.029090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk" event={"ID":"e91d22b4-c574-46d3-b639-4df07eb06d67","Type":"ContainerStarted","Data":"7060f19b3e59442cf3b49cc5f9f07f7b4a5a8f003872300ab9f5ae34ca35f1b5"}
Jul 22 20:02:52.029610 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.029310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:52.030840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.030821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:02:52.046025 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.045976    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk" podStartSLOduration=1.802125696 podStartE2EDuration="7.045960423s" totalImagesPullingTime="5.243834727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:52.045513039 +0000 UTC m=+65.776204925" watchObservedRunningTime="2026-07-22 20:02:52.045960423 +0000 UTC m=+65.776652310"
Jul 22 20:02:52.501312 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.501262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:52.501605 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.501326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:02:52.501605 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.501478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:52.503583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.503563    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 20:02:52.503655 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.503584    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 20:02:52.503655 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.503562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 20:02:52.511689 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:52.511671    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 20:02:52.511745 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:52.511735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:03:56.511720025 +0000 UTC m=+130.242411903 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : secret "metrics-daemon-secret" not found
Jul 22 20:02:52.513592 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.513568    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 20:02:52.513805 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.513787    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/41063cd5-8b22-4be6-b670-294312e455e7-original-pull-secret\") pod \"global-pull-secret-syncer-vgksv\" (UID: \"41063cd5-8b22-4be6-b670-294312e455e7\") " pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:52.524590 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.524566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79nqh\" (UniqueName: \"kubernetes.io/projected/1b46eccf-ba09-4d6b-9a77-73ff1d3af690-kube-api-access-79nqh\") pod \"network-check-target-gklkp\" (UID: \"1b46eccf-ba09-4d6b-9a77-73ff1d3af690\") " pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:52.796417 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.796324    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vgksv"
Jul 22 20:02:52.816591 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.816559    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nrd5t\""
Jul 22 20:02:52.825510 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.825472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:52.940477 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.940445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vgksv"]
Jul 22 20:02:52.943522 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:02:52.943481    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41063cd5_8b22_4be6_b670_294312e455e7.slice/crio-cc9820308b8050901b38dedf2e2e6eff3e92f3f0ecfbd9281010d24d90d2a965 WatchSource:0}: Error finding container cc9820308b8050901b38dedf2e2e6eff3e92f3f0ecfbd9281010d24d90d2a965: Status 404 returned error can't find the container with id cc9820308b8050901b38dedf2e2e6eff3e92f3f0ecfbd9281010d24d90d2a965
Jul 22 20:02:52.973128 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:52.973088    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gklkp"]
Jul 22 20:02:52.975786 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:02:52.975755    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b46eccf_ba09_4d6b_9a77_73ff1d3af690.slice/crio-e829b843a8aaba0b912be7461897f3185401d82cabe6e54b9a4162d350116cbd WatchSource:0}: Error finding container e829b843a8aaba0b912be7461897f3185401d82cabe6e54b9a4162d350116cbd: Status 404 returned error can't find the container with id e829b843a8aaba0b912be7461897f3185401d82cabe6e54b9a4162d350116cbd
Jul 22 20:02:53.032878 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:53.032838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vgksv" event={"ID":"41063cd5-8b22-4be6-b670-294312e455e7","Type":"ContainerStarted","Data":"cc9820308b8050901b38dedf2e2e6eff3e92f3f0ecfbd9281010d24d90d2a965"}
Jul 22 20:02:53.033894 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:53.033867    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gklkp" event={"ID":"1b46eccf-ba09-4d6b-9a77-73ff1d3af690","Type":"ContainerStarted","Data":"e829b843a8aaba0b912be7461897f3185401d82cabe6e54b9a4162d350116cbd"}
Jul 22 20:02:53.108173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:53.108115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:02:53.108331 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:53.108234    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:02:53.108331 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:02:53.108293    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:03:25.108278142 +0000 UTC m=+98.838970009 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:02:56.043925 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:56.043888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gklkp" event={"ID":"1b46eccf-ba09-4d6b-9a77-73ff1d3af690","Type":"ContainerStarted","Data":"449c0d7eaa24a12f671431d468ee1719063e1d19e3f6a1e0bb7ee1ce62c5a1ac"}
Jul 22 20:02:56.044362 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:56.044028    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:02:56.062121 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:56.062073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gklkp" podStartSLOduration=67.508412057 podStartE2EDuration="1m10.062055555s" totalImagesPullingTime="2.553643498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:56.060653943 +0000 UTC m=+69.791345831" watchObservedRunningTime="2026-07-22 20:02:56.062055555 +0000 UTC m=+69.792747446"
Jul 22 20:02:59.054060 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:02:59.054023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vgksv" event={"ID":"41063cd5-8b22-4be6-b670-294312e455e7","Type":"ContainerStarted","Data":"5c05bcca68c248fa0b3d22465e574f12e793eec17cc0e6b1cf599fbc8b0e2c6c"}
Jul 22 20:03:25.130070 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:03:25.130033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:03:25.130525 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:03:25.130186    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:03:25.130525 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:03:25.130268    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:04:29.130251954 +0000 UTC m=+162.860943819 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:03:27.049816 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:03:27.049784    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gklkp"
Jul 22 20:03:27.064113 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:03:27.063989    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vgksv" podStartSLOduration=95.094962883 podStartE2EDuration="1m41.063951146s" totalImagesPullingTime="5.968988263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:02:59.068182975 +0000 UTC m=+72.798874863" watchObservedRunningTime="2026-07-22 20:03:27.063951146 +0000 UTC m=+100.794643029"
Jul 22 20:03:56.549593 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:03:56.549534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:03:56.550085 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:03:56.549689    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 20:03:56.550085 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:03:56.549768    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:58.549751162 +0000 UTC m=+252.280443031 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : secret "metrics-daemon-secret" not found
Jul 22 20:04:24.214644 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:04:24.214578    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s9nph" podUID="8c670e33-1ad4-4b20-9507-3a4e6b266fbc"
Jul 22 20:04:24.261704 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:24.261670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:04:25.787714 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:04:25.787658    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:04:29.178116 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:29.178078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:04:29.178607 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:04:29.178222    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 20:04:29.178607 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:04:29.178282    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls podName:8c670e33-1ad4-4b20-9507-3a4e6b266fbc nodeName:}" failed. No retries permitted until 2026-07-22 20:06:31.178268042 +0000 UTC m=+284.908959907 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls") pod "dns-default-s9nph" (UID: "8c670e33-1ad4-4b20-9507-3a4e6b266fbc") : secret "dns-default-metrics-tls" not found
Jul 22 20:04:36.774941 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:36.774898    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:04:51.326628 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:51.326595    2582 generic.go:356] "Generic (PLEG): container finished" podID="e91d22b4-c574-46d3-b639-4df07eb06d67" containerID="7060f19b3e59442cf3b49cc5f9f07f7b4a5a8f003872300ab9f5ae34ca35f1b5" exitCode=1
Jul 22 20:04:51.327010 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:51.326665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk" event={"ID":"e91d22b4-c574-46d3-b639-4df07eb06d67","Type":"ContainerDied","Data":"7060f19b3e59442cf3b49cc5f9f07f7b4a5a8f003872300ab9f5ae34ca35f1b5"}
Jul 22 20:04:51.327010 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:51.326974    2582 scope.go:117] "RemoveContainer" containerID="7060f19b3e59442cf3b49cc5f9f07f7b4a5a8f003872300ab9f5ae34ca35f1b5"
Jul 22 20:04:52.030024 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:52.029976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:04:52.337210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:52.337112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk" event={"ID":"e91d22b4-c574-46d3-b639-4df07eb06d67","Type":"ContainerStarted","Data":"2555af2b944e27408d11071d74e8ad2cc1b9ee0c2a891b1d6d898b5557e21b6d"}
Jul 22 20:04:52.337656 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:52.337417    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:04:52.338018 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:04:52.337997    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fdc5684d9-cc4lk"
Jul 22 20:05:52.441036 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.440998    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"]
Jul 22 20:05:52.443926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.443900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"
Jul 22 20:05:52.447912 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.447887    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zj9cs\""
Jul 22 20:05:52.452817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.452794    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"]
Jul 22 20:05:52.527549 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.527511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9j4g\" (UniqueName: \"kubernetes.io/projected/ef05af83-36f3-4e70-a0b4-0881aa2806c6-kube-api-access-m9j4g\") pod \"network-check-source-7bc5b6bf85-649wg\" (UID: \"ef05af83-36f3-4e70-a0b4-0881aa2806c6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"
Jul 22 20:05:52.534468 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.534435    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"]
Jul 22 20:05:52.537230 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.537208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.537425 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.537400    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"]
Jul 22 20:05:52.540450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.540427    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 20:05:52.540662 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.540638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2rtds\""
Jul 22 20:05:52.540662 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.540654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.540794 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.540657    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 22 20:05:52.541227 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.541208    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 20:05:52.541428 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.541403    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 22 20:05:52.542259 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.542239    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"]
Jul 22 20:05:52.543466 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.543450    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:05:52.543990 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.543972    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 20:05:52.544458 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.544315    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mt8sk\""
Jul 22 20:05:52.544635 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.544587    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 20:05:52.544712 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.544638    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 20:05:52.544857 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.544841    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-989655d5b-scqxj"]
Jul 22 20:05:52.544978 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.544961    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.547006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.546989    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:05:52.547371 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547354    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 20:05:52.547542 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547468    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:05:52.547661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mnhsk\""
Jul 22 20:05:52.547661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547577    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.547661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547599    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 20:05:52.547661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.547564    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 20:05:52.549764 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.549744    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 20:05:52.549764 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.549757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 20:05:52.550083 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550067    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fkp5n\""
Jul 22 20:05:52.550180 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550110    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 20:05:52.550423 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 20:05:52.550504 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550425    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 20:05:52.550559 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550454    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 20:05:52.550611 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"]
Jul 22 20:05:52.550718 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.550670    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.552517 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.552493    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"]
Jul 22 20:05:52.553252 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.553220    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 20:05:52.553475 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.553295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 20:05:52.553728 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.553295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gzjk5\""
Jul 22 20:05:52.554096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.553404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 20:05:52.558307 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.558281    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 20:05:52.559787 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.559605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"]
Jul 22 20:05:52.560994 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.560974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-989655d5b-scqxj"]
Jul 22 20:05:52.561971 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.561951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:05:52.628262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.628262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-stats-auth\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9j4g\" (UniqueName: \"kubernetes.io/projected/ef05af83-36f3-4e70-a0b4-0881aa2806c6-kube-api-access-m9j4g\") pod \"network-check-source-7bc5b6bf85-649wg\" (UID: \"ef05af83-36f3-4e70-a0b4-0881aa2806c6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c174d5e-eba2-421e-9065-3568b94f5de4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c174d5e-eba2-421e-9065-3568b94f5de4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbk4\" (UniqueName: \"kubernetes.io/projected/2844f29d-312c-4f84-9c68-748a1520fca7-kube-api-access-8rbk4\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-default-certificate\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2844f29d-312c-4f84-9c68-748a1520fca7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.628626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628932    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6q7x\" (UniqueName: \"kubernetes.io/projected/b5607c83-281c-494e-82b1-9aba3f0d7f5c-kube-api-access-l6q7x\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.628986    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjcqj\" (UniqueName: \"kubernetes.io/projected/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-kube-api-access-jjcqj\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2844f29d-312c-4f84-9c68-748a1520fca7-config\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvq7\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5ff\" (UniqueName: \"kubernetes.io/projected/2c174d5e-eba2-421e-9065-3568b94f5de4-kube-api-access-ww5ff\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.629400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.629196    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.635873 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.635848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9j4g\" (UniqueName: \"kubernetes.io/projected/ef05af83-36f3-4e70-a0b4-0881aa2806c6-kube-api-access-m9j4g\") pod \"network-check-source-7bc5b6bf85-649wg\" (UID: \"ef05af83-36f3-4e70-a0b4-0881aa2806c6\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"
Jul 22 20:05:52.730262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730121    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2844f29d-312c-4f84-9c68-748a1520fca7-config\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.730262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.730262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvq7\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.730262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5ff\" (UniqueName: \"kubernetes.io/projected/2c174d5e-eba2-421e-9065-3568b94f5de4-kube-api-access-ww5ff\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730351    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730412    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730427    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:53.230406212 +0000 UTC m=+246.961098076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730430    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730489    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:53.230470628 +0000 UTC m=+246.961162511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730493    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfb9c9fc-w2vz9: secret "image-registry-tls" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-stats-auth\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.730545    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls podName:3e40be46-938a-42bc-9112-42c25fc5ffe9 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:53.230530297 +0000 UTC m=+246.961222182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls") pod "image-registry-7dfb9c9fc-w2vz9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9") : secret "image-registry-tls" not found
Jul 22 20:05:52.730604 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c174d5e-eba2-421e-9065-3568b94f5de4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c174d5e-eba2-421e-9065-3568b94f5de4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730652    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbk4\" (UniqueName: \"kubernetes.io/projected/2844f29d-312c-4f84-9c68-748a1520fca7-kube-api-access-8rbk4\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730709    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-default-certificate\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2844f29d-312c-4f84-9c68-748a1520fca7-config\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2844f29d-312c-4f84-9c68-748a1520fca7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6q7x\" (UniqueName: \"kubernetes.io/projected/b5607c83-281c-494e-82b1-9aba3f0d7f5c-kube-api-access-l6q7x\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.730964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjcqj\" (UniqueName: \"kubernetes.io/projected/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-kube-api-access-jjcqj\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.731303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.731238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.732054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.731744    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.732054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.731959    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.732054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.732023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.732240 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:52.732088    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:53.232073149 +0000 UTC m=+246.962765018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:05:52.732403 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.732370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c174d5e-eba2-421e-9065-3568b94f5de4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.733423 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.733393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.733423 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.733415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-stats-auth\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.733637 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.733591    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.733854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.733836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2844f29d-312c-4f84-9c68-748a1520fca7-serving-cert\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.734319 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.734294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-default-certificate\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.734387 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.734325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c174d5e-eba2-421e-9065-3568b94f5de4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.740331 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.740282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5ff\" (UniqueName: \"kubernetes.io/projected/2c174d5e-eba2-421e-9065-3568b94f5de4-kube-api-access-ww5ff\") pod \"kube-storage-version-migrator-operator-7658d9b749-n4njw\" (UID: \"2c174d5e-eba2-421e-9065-3568b94f5de4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.741885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.741814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbk4\" (UniqueName: \"kubernetes.io/projected/2844f29d-312c-4f84-9c68-748a1520fca7-kube-api-access-8rbk4\") pod \"service-ca-operator-5bcbc94c78-2szpl\" (UID: \"2844f29d-312c-4f84-9c68-748a1520fca7\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.742171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.742131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvq7\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.742442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.742418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:52.742536 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.742468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6q7x\" (UniqueName: \"kubernetes.io/projected/b5607c83-281c-494e-82b1-9aba3f0d7f5c-kube-api-access-l6q7x\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:52.742661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.742641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjcqj\" (UniqueName: \"kubernetes.io/projected/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-kube-api-access-jjcqj\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:52.752471 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.752441    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"
Jul 22 20:05:52.856889 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.856849    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"
Jul 22 20:05:52.862989 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.862939    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"
Jul 22 20:05:52.878261 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:52.878230    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg"]
Jul 22 20:05:52.882230 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:05:52.882196    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef05af83_36f3_4e70_a0b4_0881aa2806c6.slice/crio-0d4c7e0134bc57b86c361a5caf0128469a67f2df729b141dc6985483422a89fd WatchSource:0}: Error finding container 0d4c7e0134bc57b86c361a5caf0128469a67f2df729b141dc6985483422a89fd: Status 404 returned error can't find the container with id 0d4c7e0134bc57b86c361a5caf0128469a67f2df729b141dc6985483422a89fd
Jul 22 20:05:53.002044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.001934    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw"]
Jul 22 20:05:53.007427 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:05:53.007379    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c174d5e_eba2_421e_9065_3568b94f5de4.slice/crio-2fe90fd3fc06184fce2a470f6b283833596759abc527d6feccc7f89abd0d2bec WatchSource:0}: Error finding container 2fe90fd3fc06184fce2a470f6b283833596759abc527d6feccc7f89abd0d2bec: Status 404 returned error can't find the container with id 2fe90fd3fc06184fce2a470f6b283833596759abc527d6feccc7f89abd0d2bec
Jul 22 20:05:53.020087 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.020054    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl"]
Jul 22 20:05:53.023484 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:05:53.023457    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2844f29d_312c_4f84_9c68_748a1520fca7.slice/crio-1da8f08b07c177233798d9c1fd58948b0f55f07d5f30b764003e692e4c05e40f WatchSource:0}: Error finding container 1da8f08b07c177233798d9c1fd58948b0f55f07d5f30b764003e692e4c05e40f: Status 404 returned error can't find the container with id 1da8f08b07c177233798d9c1fd58948b0f55f07d5f30b764003e692e4c05e40f
Jul 22 20:05:53.236587 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.236547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:53.236587 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.236595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:53.236788 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236701    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:53.236788 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236730    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:54.236702236 +0000 UTC m=+247.967394104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:05:53.236788 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.236751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:53.236788 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236786    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:54.236776927 +0000 UTC m=+247.967468794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:53.236925 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236858    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:05:53.236925 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236913    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:05:53.236925 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236923    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfb9c9fc-w2vz9: secret "image-registry-tls" not found
Jul 22 20:05:53.236925 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236923    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:54.236904966 +0000 UTC m=+247.967596837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:05:53.237037 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.236869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:53.237037 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:53.236950    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls podName:3e40be46-938a-42bc-9112-42c25fc5ffe9 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:54.236940518 +0000 UTC m=+247.967632384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls") pod "image-registry-7dfb9c9fc-w2vz9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9") : secret "image-registry-tls" not found
Jul 22 20:05:53.509381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.509342    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl" event={"ID":"2844f29d-312c-4f84-9c68-748a1520fca7","Type":"ContainerStarted","Data":"1da8f08b07c177233798d9c1fd58948b0f55f07d5f30b764003e692e4c05e40f"}
Jul 22 20:05:53.510705 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.510676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg" event={"ID":"ef05af83-36f3-4e70-a0b4-0881aa2806c6","Type":"ContainerStarted","Data":"e960e192a849b5fc1f4fb77ac1305547915406256d680df35aec3526e3ae6e66"}
Jul 22 20:05:53.510857 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.510720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg" event={"ID":"ef05af83-36f3-4e70-a0b4-0881aa2806c6","Type":"ContainerStarted","Data":"0d4c7e0134bc57b86c361a5caf0128469a67f2df729b141dc6985483422a89fd"}
Jul 22 20:05:53.511805 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.511783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw" event={"ID":"2c174d5e-eba2-421e-9065-3568b94f5de4","Type":"ContainerStarted","Data":"2fe90fd3fc06184fce2a470f6b283833596759abc527d6feccc7f89abd0d2bec"}
Jul 22 20:05:53.524324 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:53.524265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-649wg" podStartSLOduration=1.524248756 podStartE2EDuration="1.524248756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:05:53.523970841 +0000 UTC m=+247.254662749" watchObservedRunningTime="2026-07-22 20:05:53.524248756 +0000 UTC m=+247.254940642"
Jul 22 20:05:54.244627 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:54.244582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:54.244842 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:54.244642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:54.244842 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:54.244670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:54.244842 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:54.244707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:54.244842 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244753    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.244735274 +0000 UTC m=+249.975427139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:05:54.244842 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244817    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244846    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244877    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.244862029 +0000 UTC m=+249.975553893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244819    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244896    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.244887131 +0000 UTC m=+249.975578997 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244900    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfb9c9fc-w2vz9: secret "image-registry-tls" not found
Jul 22 20:05:54.245025 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:54.244940    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls podName:3e40be46-938a-42bc-9112-42c25fc5ffe9 nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.24492605 +0000 UTC m=+249.975617916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls") pod "image-registry-7dfb9c9fc-w2vz9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9") : secret "image-registry-tls" not found
Jul 22 20:05:56.260054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.260003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.260065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.260104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.260202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260211    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260231    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260297    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:00.260277076 +0000 UTC m=+253.990968940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260317    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:00.260307563 +0000 UTC m=+253.990999429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260333    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:00.26032458 +0000 UTC m=+253.991016452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260339    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260357    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfb9c9fc-w2vz9: secret "image-registry-tls" not found
Jul 22 20:05:56.260573 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.260412    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls podName:3e40be46-938a-42bc-9112-42c25fc5ffe9 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:00.260396514 +0000 UTC m=+253.991088379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls") pod "image-registry-7dfb9c9fc-w2vz9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9") : secret "image-registry-tls" not found
Jul 22 20:05:56.306834 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.306800    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6g7tx"]
Jul 22 20:05:56.310461 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.310428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.313662 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.313641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 20:05:56.313905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.313891    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 20:05:56.313952 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.313913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 20:05:56.314697 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.314680    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 20:05:56.314813 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.314716    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tfrxf\""
Jul 22 20:05:56.329347 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.329324    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6g7tx"]
Jul 22 20:05:56.361163 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.361115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.361163 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.361189    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-crio-socket\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.361457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.361297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-api-access-slg95\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.361457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.361378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-data-volume\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.361457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.361420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462542 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462497    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-data-volume\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462739 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-crio-socket\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-api-access-slg95\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.462854 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.462761    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:56.462854 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.462775    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 20:05:56.462854 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.462836    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.962815738 +0000 UTC m=+250.693507603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:56.462854 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.462854    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:56.962844542 +0000 UTC m=+250.693536406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : configmap "kube-rbac-proxy" not found
Jul 22 20:05:56.463035 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462910    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-crio-socket\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.463035 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.462928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-data-volume\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.471339 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.471307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slg95\" (UniqueName: \"kubernetes.io/projected/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-api-access-slg95\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.521988 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.521900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw" event={"ID":"2c174d5e-eba2-421e-9065-3568b94f5de4","Type":"ContainerStarted","Data":"63410029eb5d23a01d7907dbcf7c91512cfe778187f063243caa5317ffb8147b"}
Jul 22 20:05:56.537339 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.537280    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw" podStartSLOduration=1.1831913410000001 podStartE2EDuration="4.537263007s" totalImagesPullingTime="3.354071666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:05:56.536482409 +0000 UTC m=+250.267174296" watchObservedRunningTime="2026-07-22 20:05:56.537263007 +0000 UTC m=+250.267954947"
Jul 22 20:05:56.966837 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.966791    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.967053 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.966946    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 20:05:56.967053 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:56.966958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:56.967053 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.967027    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:57.967003144 +0000 UTC m=+251.697695015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : configmap "kube-rbac-proxy" not found
Jul 22 20:05:56.967281 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.967102    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:56.967281 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:56.967174    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:57.967140355 +0000 UTC m=+251.697832221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:57.527064 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:57.527023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl" event={"ID":"2844f29d-312c-4f84-9c68-748a1520fca7","Type":"ContainerStarted","Data":"afe41c62d018d3f77b1b30969f6543ee12bb6e85ed7f4d82eb672ba0e8416aab"}
Jul 22 20:05:57.561969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:57.561917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl" podStartSLOduration=1.500836476 podStartE2EDuration="5.561899143s" totalImagesPullingTime="4.061062667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:05:57.561272618 +0000 UTC m=+251.291964499" watchObservedRunningTime="2026-07-22 20:05:57.561899143 +0000 UTC m=+251.292591031"
Jul 22 20:05:57.976937 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:57.976897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:57.977260 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:57.977055    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:57.977260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:57.977059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:57.977260 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:57.977138    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 20:05:57.977260 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:57.977164    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:59.977127212 +0000 UTC m=+253.707819100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:57.977260 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:57.977207    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:05:59.977189562 +0000 UTC m=+253.707881439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : configmap "kube-rbac-proxy" not found
Jul 22 20:05:58.302417 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:58.302338    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzx2n_a98c3da3-aa1a-4139-84b1-88f9b1703936/dns-node-resolver/0.log"
Jul 22 20:05:58.582649 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:58.582560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:05:58.583076 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:58.582692    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 20:05:58.583076 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:58.582757    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs podName:2daef6c5-3620-4336-8f5a-457787a6cf93 nodeName:}" failed. No retries permitted until 2026-07-22 20:08:00.582740821 +0000 UTC m=+374.313432685 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs") pod "network-metrics-daemon-qqz6z" (UID: "2daef6c5-3620-4336-8f5a-457787a6cf93") : secret "metrics-daemon-secret" not found
Jul 22 20:05:59.303261 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:59.303232    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ch7l9_ed509c9f-d6a6-467a-b776-c8d1671f2415/node-ca/0.log"
Jul 22 20:05:59.993516 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:59.993460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:59.993935 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:05:59.993571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:05:59.993935 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:59.993621    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:59.993935 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:59.993685    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 20:05:59.993935 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:59.993704    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:06:03.993684528 +0000 UTC m=+257.724376414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:05:59.993935 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:05:59.993735    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:06:03.993721615 +0000 UTC m=+257.724413483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : configmap "kube-rbac-proxy" not found
Jul 22 20:06:00.102455 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:00.102418    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc7zn_4ad83725-93b2-413a-92fc-5b33791f8396/serve-healthcheck-canary/0.log"
Jul 22 20:06:00.297084 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:00.296992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:00.297089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:00.297135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:00.297182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297187    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297210    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dfb9c9fc-w2vz9: secret "image-registry-tls" not found
Jul 22 20:06:00.297280 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297275    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:08.297256031 +0000 UTC m=+262.027947920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:06:00.297504 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297280    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:06:00.297504 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297299    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls podName:3e40be46-938a-42bc-9112-42c25fc5ffe9 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:08.297288388 +0000 UTC m=+262.027980252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls") pod "image-registry-7dfb9c9fc-w2vz9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9") : secret "image-registry-tls" not found
Jul 22 20:06:00.297504 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297298    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:06:00.297504 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297318    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:08.297307664 +0000 UTC m=+262.027999528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:06:00.297504 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:00.297336    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:08.297326275 +0000 UTC m=+262.028018140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:06:04.027598 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:04.027565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:04.027973 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:04.027628    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:04.027973 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:04.027697    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 20:06:04.027973 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:04.027710    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:06:04.027973 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:04.027750    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:06:12.027735287 +0000 UTC m=+265.758427151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : configmap "kube-rbac-proxy" not found
Jul 22 20:06:04.027973 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:04.027762    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:06:12.027756567 +0000 UTC m=+265.758448431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:06:08.365624 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.365587    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.365648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.365681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.365721    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:08.365779    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:24.365758432 +0000 UTC m=+278.096450313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : configmap references non-existent config key: service-ca.crt
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:08.365808    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:08.365835    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:08.365867    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls podName:2ae99fb0-484c-4c13-bcd9-20e7546fe9e2 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:24.365853656 +0000 UTC m=+278.096545526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kb6zg" (UID: "2ae99fb0-484c-4c13-bcd9-20e7546fe9e2") : secret "cluster-monitoring-operator-tls" not found
Jul 22 20:06:08.366048 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:08.365882    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs podName:b5607c83-281c-494e-82b1-9aba3f0d7f5c nodeName:}" failed. No retries permitted until 2026-07-22 20:06:24.365876124 +0000 UTC m=+278.096567989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs") pod "router-default-989655d5b-scqxj" (UID: "b5607c83-281c-494e-82b1-9aba3f0d7f5c") : secret "router-metrics-certs-default" not found
Jul 22 20:06:08.368131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.368114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"image-registry-7dfb9c9fc-w2vz9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") " pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:08.475969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.475935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:08.607168 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:08.607122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:06:08.610405 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:08.610376    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e40be46_938a_42bc_9112_42c25fc5ffe9.slice/crio-ef65a7eca85a9303144a0df5297e825f568e299bec573f45af51b7c36dbb76f1 WatchSource:0}: Error finding container ef65a7eca85a9303144a0df5297e825f568e299bec573f45af51b7c36dbb76f1: Status 404 returned error can't find the container with id ef65a7eca85a9303144a0df5297e825f568e299bec573f45af51b7c36dbb76f1
Jul 22 20:06:09.563216 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:09.563179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" event={"ID":"3e40be46-938a-42bc-9112-42c25fc5ffe9","Type":"ContainerStarted","Data":"830e3071aa5e8cf1c323ad0fb4567869023388073378e8ce350bf2071b0cb5b9"}
Jul 22 20:06:09.563713 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:09.563229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" event={"ID":"3e40be46-938a-42bc-9112-42c25fc5ffe9","Type":"ContainerStarted","Data":"ef65a7eca85a9303144a0df5297e825f568e299bec573f45af51b7c36dbb76f1"}
Jul 22 20:06:09.563713 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:09.563316    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:09.584305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:09.584247    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" podStartSLOduration=17.58423328 podStartE2EDuration="17.58423328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:09.583193738 +0000 UTC m=+263.313885626" watchObservedRunningTime="2026-07-22 20:06:09.58423328 +0000 UTC m=+263.314925166"
Jul 22 20:06:12.097630 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:12.097008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:12.097630 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:12.097185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:12.097630 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:12.097346    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 20:06:12.097630 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:12.097407    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls podName:4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae nodeName:}" failed. No retries permitted until 2026-07-22 20:06:28.097387714 +0000 UTC m=+281.828079598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6g7tx" (UID: "4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae") : secret "insights-runtime-extractor-tls" not found
Jul 22 20:06:12.098286 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:12.098265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:19.573973 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:19.573933    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:06:24.389801 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.389757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:24.390331 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.389819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:06:24.390331 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.389847    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:24.390423 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.390394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5607c83-281c-494e-82b1-9aba3f0d7f5c-service-ca-bundle\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:24.392218 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.392196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5607c83-281c-494e-82b1-9aba3f0d7f5c-metrics-certs\") pod \"router-default-989655d5b-scqxj\" (UID: \"b5607c83-281c-494e-82b1-9aba3f0d7f5c\") " pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:24.392327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.392218    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2ae99fb0-484c-4c13-bcd9-20e7546fe9e2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kb6zg\" (UID: \"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:06:24.648015 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.647915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"
Jul 22 20:06:24.671174 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.670907    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:24.783875 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.783828    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg"]
Jul 22 20:06:24.788182 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:24.788141    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ae99fb0_484c_4c13_bcd9_20e7546fe9e2.slice/crio-065975829f7538ca6ddb3c06a22c2729f95f1ff8b8bbc832e294db87cca461ab WatchSource:0}: Error finding container 065975829f7538ca6ddb3c06a22c2729f95f1ff8b8bbc832e294db87cca461ab: Status 404 returned error can't find the container with id 065975829f7538ca6ddb3c06a22c2729f95f1ff8b8bbc832e294db87cca461ab
Jul 22 20:06:24.803243 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:24.803213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-989655d5b-scqxj"]
Jul 22 20:06:24.806358 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:24.806335    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5607c83_281c_494e_82b1_9aba3f0d7f5c.slice/crio-ef3da13378caf8c1a64d2cfcdbf55ec5e71dbf2a463447563b1c6472c6cd1967 WatchSource:0}: Error finding container ef3da13378caf8c1a64d2cfcdbf55ec5e71dbf2a463447563b1c6472c6cd1967: Status 404 returned error can't find the container with id ef3da13378caf8c1a64d2cfcdbf55ec5e71dbf2a463447563b1c6472c6cd1967
Jul 22 20:06:25.613309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.613276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-989655d5b-scqxj" event={"ID":"b5607c83-281c-494e-82b1-9aba3f0d7f5c","Type":"ContainerStarted","Data":"dced83ce03926c1bb1c2056d1dfc77bbbe8bd6380f3fe8c51efbd554328ae3ee"}
Jul 22 20:06:25.613836 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.613329    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-989655d5b-scqxj" event={"ID":"b5607c83-281c-494e-82b1-9aba3f0d7f5c","Type":"ContainerStarted","Data":"ef3da13378caf8c1a64d2cfcdbf55ec5e71dbf2a463447563b1c6472c6cd1967"}
Jul 22 20:06:25.614393 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.614371    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg" event={"ID":"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2","Type":"ContainerStarted","Data":"065975829f7538ca6ddb3c06a22c2729f95f1ff8b8bbc832e294db87cca461ab"}
Jul 22 20:06:25.632290 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.632246    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-989655d5b-scqxj" podStartSLOduration=33.632231108 podStartE2EDuration="33.632231108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:25.630594878 +0000 UTC m=+279.361286767" watchObservedRunningTime="2026-07-22 20:06:25.632231108 +0000 UTC m=+279.362923029"
Jul 22 20:06:25.672357 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.672326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:25.674909 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:25.674886    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:26.617634 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:26.617596    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:26.619196 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:26.619172    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-989655d5b-scqxj"
Jul 22 20:06:27.262208 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:27.262158    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-s9nph" podUID="8c670e33-1ad4-4b20-9507-3a4e6b266fbc"
Jul 22 20:06:27.620851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:27.620819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:28.120219 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.120173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:28.122527 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.122491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6g7tx\" (UID: \"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae\") " pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:28.419490 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.419402    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6g7tx"
Jul 22 20:06:28.545202 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.545169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6g7tx"]
Jul 22 20:06:28.548390 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:28.548363    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb230a0_b3a8_4218_bf5f_2648a9d8f7ae.slice/crio-c67ad0fb89a0a02b1ab1fe0d1b4697bdf8cb0082ebc67604e66001a9a225584d WatchSource:0}: Error finding container c67ad0fb89a0a02b1ab1fe0d1b4697bdf8cb0082ebc67604e66001a9a225584d: Status 404 returned error can't find the container with id c67ad0fb89a0a02b1ab1fe0d1b4697bdf8cb0082ebc67604e66001a9a225584d
Jul 22 20:06:28.625581 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.625528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg" event={"ID":"2ae99fb0-484c-4c13-bcd9-20e7546fe9e2","Type":"ContainerStarted","Data":"c8f699538f4896ad5e1ef00f4851e721cc4b9c168b17e038f442c8a6889d678f"}
Jul 22 20:06:28.626619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.626596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g7tx" event={"ID":"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae","Type":"ContainerStarted","Data":"c67ad0fb89a0a02b1ab1fe0d1b4697bdf8cb0082ebc67604e66001a9a225584d"}
Jul 22 20:06:28.641584 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:28.641530    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kb6zg" podStartSLOduration=33.846013817 podStartE2EDuration="36.641513649s" totalImagesPullingTime="2.795499832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:28.640670393 +0000 UTC m=+282.371362282" watchObservedRunningTime="2026-07-22 20:06:28.641513649 +0000 UTC m=+282.372205581"
Jul 22 20:06:29.583105 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:29.582933    2582 patch_prober.go:28] interesting pod/image-registry-7dfb9c9fc-w2vz9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 22 20:06:29.583105 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:29.583000    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 20:06:31.247395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:31.247341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:31.249944 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:31.249916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c670e33-1ad4-4b20-9507-3a4e6b266fbc-metrics-tls\") pod \"dns-default-s9nph\" (UID: \"8c670e33-1ad4-4b20-9507-3a4e6b266fbc\") " pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:31.523686 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:31.523604    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zbn42\""
Jul 22 20:06:31.531627 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:31.531576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:32.983354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.983312    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:06:32.990452 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.990425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:32.992677 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.992654    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 20:06:32.993548 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 22 20:06:32.993548 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993515    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 22 20:06:32.993743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 22 20:06:32.993743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993607    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 20:06:32.993743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993670    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 22 20:06:32.993898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993852    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 22 20:06:32.993898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.993885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pv4ng\""
Jul 22 20:06:32.998489 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.998047    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 22 20:06:32.999126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:32.999093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:06:33.064239 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064418 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064418 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6gf\" (UniqueName: \"kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064418 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064418 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.064619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.064517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.125934 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.125895    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"]
Jul 22 20:06:33.129357 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.129323    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.131715 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.131688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 22 20:06:33.131715 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.131723    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sdh6p\""
Jul 22 20:06:33.131932 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.131787    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 20:06:33.131932 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.131688    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 22 20:06:33.139466 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.139440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"]
Jul 22 20:06:33.165220 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6gf\" (UniqueName: \"kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165264    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a4f079-631a-4e81-9a87-9987a7d6dba3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.165408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlpt\" (UniqueName: \"kubernetes.io/projected/98a4f079-631a-4e81-9a87-9987a7d6dba3-kube-api-access-krlpt\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.165759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.165759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.165981 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.165956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.166095 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.166055    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.166444 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.166399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.166740 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.166719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.168207 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.168185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.168311 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.168231    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.173733 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.173712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6gf\" (UniqueName: \"kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf\") pod \"console-69699874f4-7twjj\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") " pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.266847 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.266759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.266847 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.266820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a4f079-631a-4e81-9a87-9987a7d6dba3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.267073 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.266861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krlpt\" (UniqueName: \"kubernetes.io/projected/98a4f079-631a-4e81-9a87-9987a7d6dba3-kube-api-access-krlpt\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.267073 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.267024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.267209 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:33.267173    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 22 20:06:33.267283 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:33.267269    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls podName:98a4f079-631a-4e81-9a87-9987a7d6dba3 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:33.767245949 +0000 UTC m=+287.497937832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-ksdc2" (UID: "98a4f079-631a-4e81-9a87-9987a7d6dba3") : secret "prometheus-operator-tls" not found
Jul 22 20:06:33.267723 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.267697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98a4f079-631a-4e81-9a87-9987a7d6dba3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.269754 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.269725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.277573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.277545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlpt\" (UniqueName: \"kubernetes.io/projected/98a4f079-631a-4e81-9a87-9987a7d6dba3-kube-api-access-krlpt\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.302247 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.302212    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:33.578564 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.578538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9nph"]
Jul 22 20:06:33.581475 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:33.581440    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c670e33_1ad4_4b20_9507_3a4e6b266fbc.slice/crio-4bc3e82d7d7a82164951df0906a4d6c3589107da2ff0304c4bb0ce7cdaf7ed89 WatchSource:0}: Error finding container 4bc3e82d7d7a82164951df0906a4d6c3589107da2ff0304c4bb0ce7cdaf7ed89: Status 404 returned error can't find the container with id 4bc3e82d7d7a82164951df0906a4d6c3589107da2ff0304c4bb0ce7cdaf7ed89
Jul 22 20:06:33.601782 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.601755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:06:33.604868 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:33.604840    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4f0971_4e87_4793_b38a_26e3d96d1550.slice/crio-af6bbc6ec0306359deb9a83e668dec570b7533c62e32fb56277449477c6d96ed WatchSource:0}: Error finding container af6bbc6ec0306359deb9a83e668dec570b7533c62e32fb56277449477c6d96ed: Status 404 returned error can't find the container with id af6bbc6ec0306359deb9a83e668dec570b7533c62e32fb56277449477c6d96ed
Jul 22 20:06:33.647196 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.647133    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g7tx" event={"ID":"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae","Type":"ContainerStarted","Data":"3f75d36ebe545c8e3b6dbb04b0ab0914b29292eea3bb031d842d0c433b9fc0c4"}
Jul 22 20:06:33.648301 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.648278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69699874f4-7twjj" event={"ID":"5d4f0971-4e87-4793-b38a-26e3d96d1550","Type":"ContainerStarted","Data":"af6bbc6ec0306359deb9a83e668dec570b7533c62e32fb56277449477c6d96ed"}
Jul 22 20:06:33.649266 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.649246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9nph" event={"ID":"8c670e33-1ad4-4b20-9507-3a4e6b266fbc","Type":"ContainerStarted","Data":"4bc3e82d7d7a82164951df0906a4d6c3589107da2ff0304c4bb0ce7cdaf7ed89"}
Jul 22 20:06:33.771897 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.771798    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:33.774336 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:33.774302    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/98a4f079-631a-4e81-9a87-9987a7d6dba3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-ksdc2\" (UID: \"98a4f079-631a-4e81-9a87-9987a7d6dba3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:34.040034 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:34.039945    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"
Jul 22 20:06:34.197918 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:34.197883    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2"]
Jul 22 20:06:34.202066 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:34.202034    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a4f079_631a_4e81_9a87_9987a7d6dba3.slice/crio-144e62fd926f41903aecf7f6eef2c3c8e4a9ed5ed74a6e4e99a020006a94ce29 WatchSource:0}: Error finding container 144e62fd926f41903aecf7f6eef2c3c8e4a9ed5ed74a6e4e99a020006a94ce29: Status 404 returned error can't find the container with id 144e62fd926f41903aecf7f6eef2c3c8e4a9ed5ed74a6e4e99a020006a94ce29
Jul 22 20:06:34.655574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:34.655531    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2" event={"ID":"98a4f079-631a-4e81-9a87-9987a7d6dba3","Type":"ContainerStarted","Data":"144e62fd926f41903aecf7f6eef2c3c8e4a9ed5ed74a6e4e99a020006a94ce29"}
Jul 22 20:06:37.671396 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:37.671311    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g7tx" event={"ID":"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae","Type":"ContainerStarted","Data":"0dc4092b8ad26f1056812e0dcc25716eddfd06a3f4f6d519d40cac8d95c756e7"}
Jul 22 20:06:38.677939 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.677895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9nph" event={"ID":"8c670e33-1ad4-4b20-9507-3a4e6b266fbc","Type":"ContainerStarted","Data":"4efbd34dbc551b36da9430721845b453ae5b3273c66ae71e72e4eaeeb41a8846"}
Jul 22 20:06:38.678450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.677962    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9nph" event={"ID":"8c670e33-1ad4-4b20-9507-3a4e6b266fbc","Type":"ContainerStarted","Data":"1caf9ec00de30176109a3256a50774df3027ec3a43babe72be17da0fa69c7db3"}
Jul 22 20:06:38.678450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.678029    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:38.680456 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.680416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2" event={"ID":"98a4f079-631a-4e81-9a87-9987a7d6dba3","Type":"ContainerStarted","Data":"f5295f37fdbb188ae9127967c97947681bc2da2f946a063702d13f005e80d802"}
Jul 22 20:06:38.680602 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.680471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2" event={"ID":"98a4f079-631a-4e81-9a87-9987a7d6dba3","Type":"ContainerStarted","Data":"38af07b9e1f6421694614af3a1b82a4499c7ef0b919f7c75de401a62adfac314"}
Jul 22 20:06:38.696597 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.696544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s9nph" podStartSLOduration=253.157513516 podStartE2EDuration="4m17.696521391s" totalImagesPullingTime="4.539007875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:38.696474404 +0000 UTC m=+292.427166292" watchObservedRunningTime="2026-07-22 20:06:38.696521391 +0000 UTC m=+292.427213283"
Jul 22 20:06:38.714441 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:38.714326    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-ksdc2" podStartSLOduration=1.79661417 podStartE2EDuration="5.714304161s" totalImagesPullingTime="3.917689991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:38.713665181 +0000 UTC m=+292.444357071" watchObservedRunningTime="2026-07-22 20:06:38.714304161 +0000 UTC m=+292.444996051"
Jul 22 20:06:39.581473 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:39.581437    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:39.776027 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:39.775979    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qqz6z" podUID="2daef6c5-3620-4336-8f5a-457787a6cf93"
Jul 22 20:06:40.474588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.474542    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"]
Jul 22 20:06:40.487029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.486999    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.489602 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.489567    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"]
Jul 22 20:06:40.490431 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.490405    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 20:06:40.490555 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.490450    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-75l2v\""
Jul 22 20:06:40.490693 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.490675    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 20:06:40.500002 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.499971    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-htxkb"]
Jul 22 20:06:40.506261 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.506234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.508754 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.508708    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 20:06:40.508862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.508784    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 20:06:40.508862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.508840    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 20:06:40.508991 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.508787    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krxkr\""
Jul 22 20:06:40.536287 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.536254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.536456 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.536383    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6mmz\" (UniqueName: \"kubernetes.io/projected/38e09e18-8f96-4f57-9e08-1a975c7b6dab-kube-api-access-s6mmz\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.536456 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.536444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e09e18-8f96-4f57-9e08-1a975c7b6dab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.536532 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.536500    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.637452 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6mmz\" (UniqueName: \"kubernetes.io/projected/38e09e18-8f96-4f57-9e08-1a975c7b6dab-kube-api-access-s6mmz\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.637660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e09e18-8f96-4f57-9e08-1a975c7b6dab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.637660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637514    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-root\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc85r\" (UniqueName: \"kubernetes.io/projected/9d49684e-bb37-4da5-8dc8-5f82b5305617-kube-api-access-nc85r\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-metrics-client-ca\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637636    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.637931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-tls\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637931 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:40.637816    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 20:06:40.637931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-sys\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.637931 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:40.637929    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls podName:38e09e18-8f96-4f57-9e08-1a975c7b6dab nodeName:}" failed. No retries permitted until 2026-07-22 20:06:41.137904258 +0000 UTC m=+294.868596144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-sz6jf" (UID: "38e09e18-8f96-4f57-9e08-1a975c7b6dab") : secret "openshift-state-metrics-tls" not found
Jul 22 20:06:40.638210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.637970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.638210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.638026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-textfile\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.638210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.638095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-wtmp\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.638210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.638136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-accelerators-collector-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.638410 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.638392    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e09e18-8f96-4f57-9e08-1a975c7b6dab-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.640677 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.640646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.649804 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.649773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6mmz\" (UniqueName: \"kubernetes.io/projected/38e09e18-8f96-4f57-9e08-1a975c7b6dab-kube-api-access-s6mmz\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:40.739200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-root\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc85r\" (UniqueName: \"kubernetes.io/projected/9d49684e-bb37-4da5-8dc8-5f82b5305617-kube-api-access-nc85r\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739179    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-metrics-client-ca\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-tls\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-root\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-sys\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-textfile\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-wtmp\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-accelerators-collector-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739827 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-sys\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.739948 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.739928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-metrics-client-ca\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.740065 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.740039    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-accelerators-collector-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.740168 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.740078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-wtmp\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.740168 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.740117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-textfile\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.742694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.742656    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.742803 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.742762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9d49684e-bb37-4da5-8dc8-5f82b5305617-node-exporter-tls\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.769029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.768995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc85r\" (UniqueName: \"kubernetes.io/projected/9d49684e-bb37-4da5-8dc8-5f82b5305617-kube-api-access-nc85r\") pod \"node-exporter-htxkb\" (UID: \"9d49684e-bb37-4da5-8dc8-5f82b5305617\") " pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:40.817913 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:40.817875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-htxkb"
Jul 22 20:06:41.142495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:41.142457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:41.142689 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:41.142597    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 20:06:41.142689 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:41.142658    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls podName:38e09e18-8f96-4f57-9e08-1a975c7b6dab nodeName:}" failed. No retries permitted until 2026-07-22 20:06:42.14264277 +0000 UTC m=+295.873334636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-sz6jf" (UID: "38e09e18-8f96-4f57-9e08-1a975c7b6dab") : secret "openshift-state-metrics-tls" not found
Jul 22 20:06:42.152721 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.152676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:42.155193 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.155167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/38e09e18-8f96-4f57-9e08-1a975c7b6dab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-sz6jf\" (UID: \"38e09e18-8f96-4f57-9e08-1a975c7b6dab\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:42.307707 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.307666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"
Jul 22 20:06:42.467849 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.467758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf"]
Jul 22 20:06:42.652500 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:42.652462    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e09e18_8f96_4f57_9e08_1a975c7b6dab.slice/crio-ed42156caf6623f00a9e39281681b3c27afe44ddf258129475a23608d1dd4e20 WatchSource:0}: Error finding container ed42156caf6623f00a9e39281681b3c27afe44ddf258129475a23608d1dd4e20: Status 404 returned error can't find the container with id ed42156caf6623f00a9e39281681b3c27afe44ddf258129475a23608d1dd4e20
Jul 22 20:06:42.698082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.698047    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htxkb" event={"ID":"9d49684e-bb37-4da5-8dc8-5f82b5305617","Type":"ContainerStarted","Data":"ed3a90356e67ccb5cde43ca331c9acccd0b596e6f98199f89859bc6a714ab622"}
Jul 22 20:06:42.700612 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.700569    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6g7tx" event={"ID":"4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae","Type":"ContainerStarted","Data":"df65fc5abf20ce80edae1d582a1f15ce317add8e777448b424ecf67a03e83423"}
Jul 22 20:06:42.702164 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.702127    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf" event={"ID":"38e09e18-8f96-4f57-9e08-1a975c7b6dab","Type":"ContainerStarted","Data":"ed42156caf6623f00a9e39281681b3c27afe44ddf258129475a23608d1dd4e20"}
Jul 22 20:06:42.703726 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.703697    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69699874f4-7twjj" event={"ID":"5d4f0971-4e87-4793-b38a-26e3d96d1550","Type":"ContainerStarted","Data":"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"}
Jul 22 20:06:42.722558 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.722374    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6g7tx" podStartSLOduration=33.732261735 podStartE2EDuration="46.722359085s" totalImagesPullingTime="12.99009735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:05:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:42.721092613 +0000 UTC m=+296.451784499" watchObservedRunningTime="2026-07-22 20:06:42.722359085 +0000 UTC m=+296.453050988"
Jul 22 20:06:42.738997 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:42.738950    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69699874f4-7twjj" podStartSLOduration=2.6456374719999998 podStartE2EDuration="10.73893023s" totalImagesPullingTime="8.093292758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:42.737551488 +0000 UTC m=+296.468243375" watchObservedRunningTime="2026-07-22 20:06:42.73893023 +0000 UTC m=+296.469622117"
Jul 22 20:06:43.302855 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.302811    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:43.303321 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.302875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:43.307777 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.307748    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:43.709711 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.709673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf" event={"ID":"38e09e18-8f96-4f57-9e08-1a975c7b6dab","Type":"ContainerStarted","Data":"8b8ef0ea887cfa1aa2c2ca39c37ea59de8add6aaa5d1a622b08736f283fc8fd3"}
Jul 22 20:06:43.709910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.709760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf" event={"ID":"38e09e18-8f96-4f57-9e08-1a975c7b6dab","Type":"ContainerStarted","Data":"36f2558299f4f461189860aeccc58d28c998b51caee265a7d30d7acddf8ec2ed"}
Jul 22 20:06:43.711279 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.711254    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d49684e-bb37-4da5-8dc8-5f82b5305617" containerID="307c56c855817a92dcce9ff4c3a15c2e3e6e4032adc85028c1a1fd6cf6d68034" exitCode=0
Jul 22 20:06:43.711386 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.711339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htxkb" event={"ID":"9d49684e-bb37-4da5-8dc8-5f82b5305617","Type":"ContainerDied","Data":"307c56c855817a92dcce9ff4c3a15c2e3e6e4032adc85028c1a1fd6cf6d68034"}
Jul 22 20:06:43.716251 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:43.716226    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:06:44.597984 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.597936    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerName="registry" containerID="cri-o://830e3071aa5e8cf1c323ad0fb4567869023388073378e8ce350bf2071b0cb5b9" gracePeriod=30
Jul 22 20:06:44.716968 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.716926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htxkb" event={"ID":"9d49684e-bb37-4da5-8dc8-5f82b5305617","Type":"ContainerStarted","Data":"258adce9c20f7db278341e93cb72a6d83df5a832b83e971ae729999620893d2b"}
Jul 22 20:06:44.717110 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.717010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-htxkb" event={"ID":"9d49684e-bb37-4da5-8dc8-5f82b5305617","Type":"ContainerStarted","Data":"be15614051f98d75386bebccd9406bc96fc7af1f2a1c3fdbb35353c915d9a272"}
Jul 22 20:06:44.718481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.718457    2582 generic.go:356] "Generic (PLEG): container finished" podID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerID="830e3071aa5e8cf1c323ad0fb4567869023388073378e8ce350bf2071b0cb5b9" exitCode=0
Jul 22 20:06:44.718599 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.718543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" event={"ID":"3e40be46-938a-42bc-9112-42c25fc5ffe9","Type":"ContainerDied","Data":"830e3071aa5e8cf1c323ad0fb4567869023388073378e8ce350bf2071b0cb5b9"}
Jul 22 20:06:44.720819 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.720786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf" event={"ID":"38e09e18-8f96-4f57-9e08-1a975c7b6dab","Type":"ContainerStarted","Data":"4606be424065e20f046d21f196809132130f5054473c81ee92c247ae840ac30c"}
Jul 22 20:06:44.736204 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.736127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-htxkb" podStartSLOduration=3.669915658 podStartE2EDuration="4.736111372s" totalImagesPullingTime="995.512805ms" totalInitContainerRuntime="70.682909ms" isStatefulPod=true podCreationTimestamp="2026-07-22 20:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:44.735167623 +0000 UTC m=+298.465859502" watchObservedRunningTime="2026-07-22 20:06:44.736111372 +0000 UTC m=+298.466803284"
Jul 22 20:06:44.753422 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.753360    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-sz6jf" podStartSLOduration=3.237319712 podStartE2EDuration="4.753338758s" totalImagesPullingTime="1.516019046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:44.752879623 +0000 UTC m=+298.483571512" watchObservedRunningTime="2026-07-22 20:06:44.753338758 +0000 UTC m=+298.484030700"
Jul 22 20:06:44.844196 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.844168    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:44.976373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bvq7\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976330    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976351    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976627 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976380    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976637    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976722    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.976845 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets\") pod \"3e40be46-938a-42bc-9112-42c25fc5ffe9\" (UID: \"3e40be46-938a-42bc-9112-42c25fc5ffe9\") "
Jul 22 20:06:44.977049 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.976776    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:06:44.977162 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.977045    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:06:44.979066 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.979027    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:06:44.979272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.979038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:06:44.979272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.979140    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:06:44.979272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.979265    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7" (OuterVolumeSpecName: "kube-api-access-6bvq7") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "kube-api-access-6bvq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:06:44.979407 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.979380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:06:44.985641 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:44.985604    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3e40be46-938a-42bc-9112-42c25fc5ffe9" (UID: "3e40be46-938a-42bc-9112-42c25fc5ffe9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:06:45.077898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077857    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-certificates\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.077898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077888    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-registry-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.077898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077898    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-image-registry-private-configuration\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.077898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077908    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3e40be46-938a-42bc-9112-42c25fc5ffe9-installation-pull-secrets\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.078189 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077917    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvq7\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-kube-api-access-6bvq7\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.078189 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077926    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e40be46-938a-42bc-9112-42c25fc5ffe9-bound-sa-token\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.078189 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077935    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e40be46-938a-42bc-9112-42c25fc5ffe9-trusted-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.078189 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.077944    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3e40be46-938a-42bc-9112-42c25fc5ffe9-ca-trust-extracted\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:06:45.272931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.272816    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"]
Jul 22 20:06:45.273270 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.273248    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerName="registry"
Jul 22 20:06:45.273411 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.273399    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerName="registry"
Jul 22 20:06:45.273554 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.273544    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" containerName="registry"
Jul 22 20:06:45.278308 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.278284    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.280405 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.280380    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2nnfh\""
Jul 22 20:06:45.280520 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.280384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 22 20:06:45.282802 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.282771    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"]
Jul 22 20:06:45.380377 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.380339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.380571 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.380390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdqf\" (UniqueName: \"kubernetes.io/projected/0e208914-ba9b-4ce1-a17c-a1546197b929-kube-api-access-7zdqf\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.481493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.481451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.481493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.481500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdqf\" (UniqueName: \"kubernetes.io/projected/0e208914-ba9b-4ce1-a17c-a1546197b929-kube-api-access-7zdqf\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.481672 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:45.481601    2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 22 20:06:45.481672 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:06:45.481669    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert podName:0e208914-ba9b-4ce1-a17c-a1546197b929 nodeName:}" failed. No retries permitted until 2026-07-22 20:06:45.981653128 +0000 UTC m=+299.712344997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-5whwc" (UID: "0e208914-ba9b-4ce1-a17c-a1546197b929") : secret "monitoring-plugin-cert" not found
Jul 22 20:06:45.490273 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.490246    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdqf\" (UniqueName: \"kubernetes.io/projected/0e208914-ba9b-4ce1-a17c-a1546197b929-kube-api-access-7zdqf\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.714749 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.714711    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55df64ff76-8dzlg"]
Jul 22 20:06:45.717962 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.717942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.720294 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 20:06:45.720420 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720272    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 20:06:45.720420 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720372    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 20:06:45.720541 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 20:06:45.720541 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720490    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z2984\""
Jul 22 20:06:45.720629 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.720617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 20:06:45.726082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.725885    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 20:06:45.726082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.725924    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"
Jul 22 20:06:45.726082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.725958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dfb9c9fc-w2vz9" event={"ID":"3e40be46-938a-42bc-9112-42c25fc5ffe9","Type":"ContainerDied","Data":"ef65a7eca85a9303144a0df5297e825f568e299bec573f45af51b7c36dbb76f1"}
Jul 22 20:06:45.726310 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.726104    2582 scope.go:117] "RemoveContainer" containerID="830e3071aa5e8cf1c323ad0fb4567869023388073378e8ce350bf2071b0cb5b9"
Jul 22 20:06:45.733381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.733323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55df64ff76-8dzlg"]
Jul 22 20:06:45.757498 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.757457    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:06:45.765013 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.764985    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dfb9c9fc-w2vz9"]
Jul 22 20:06:45.784454 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784417    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-serving-certs-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784605 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784670 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784670 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv2vj\" (UniqueName: \"kubernetes.io/projected/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-kube-api-access-mv2vj\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784754 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-metrics-client-ca\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784850 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784896 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-federate-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.784985 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.784968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.885905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.885858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.885905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.885902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv2vj\" (UniqueName: \"kubernetes.io/projected/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-kube-api-access-mv2vj\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886132 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.885930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-metrics-client-ca\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886132 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.885966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886132 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.885993    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-federate-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886132 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.886021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886132 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.886124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-serving-certs-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.886187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.886873 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.886841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-serving-certs-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.887127 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.887108    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.887317 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.887289    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-metrics-client-ca\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.888697 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.888669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-federate-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.888881 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.888855    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.888964 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.888908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-telemeter-client-tls\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.889003 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.888966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-secret-telemeter-client\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.894069 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.894045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv2vj\" (UniqueName: \"kubernetes.io/projected/33cdaefb-86d4-4459-9fe2-2640a6b2d5f7-kube-api-access-mv2vj\") pod \"telemeter-client-55df64ff76-8dzlg\" (UID: \"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7\") " pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:45.987114 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.987021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:45.989464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:45.989439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e208914-ba9b-4ce1-a17c-a1546197b929-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-5whwc\" (UID: \"0e208914-ba9b-4ce1-a17c-a1546197b929\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:46.035950 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.035912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg"
Jul 22 20:06:46.175522 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.175490    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55df64ff76-8dzlg"]
Jul 22 20:06:46.179038 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:46.179008    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cdaefb_86d4_4459_9fe2_2640a6b2d5f7.slice/crio-fb3c099cd706edc66757761dd673a68925329b8e48963a3d486db3029b9dade5 WatchSource:0}: Error finding container fb3c099cd706edc66757761dd673a68925329b8e48963a3d486db3029b9dade5: Status 404 returned error can't find the container with id fb3c099cd706edc66757761dd673a68925329b8e48963a3d486db3029b9dade5
Jul 22 20:06:46.188802 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.188780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:46.322603 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.322569    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"]
Jul 22 20:06:46.325543 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:46.325520    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e208914_ba9b_4ce1_a17c_a1546197b929.slice/crio-3fd83c042520e7ab8cf5e26d23dd99d7b3e68098e42400081e7ad749a1a9c493 WatchSource:0}: Error finding container 3fd83c042520e7ab8cf5e26d23dd99d7b3e68098e42400081e7ad749a1a9c493: Status 404 returned error can't find the container with id 3fd83c042520e7ab8cf5e26d23dd99d7b3e68098e42400081e7ad749a1a9c493
Jul 22 20:06:46.624472 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.624440    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:06:46.626326 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.626301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:06:46.631229 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.631205    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 20:06:46.731958 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.731902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc" event={"ID":"0e208914-ba9b-4ce1-a17c-a1546197b929","Type":"ContainerStarted","Data":"3fd83c042520e7ab8cf5e26d23dd99d7b3e68098e42400081e7ad749a1a9c493"}
Jul 22 20:06:46.733378 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.733351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg" event={"ID":"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7","Type":"ContainerStarted","Data":"fb3c099cd706edc66757761dd673a68925329b8e48963a3d486db3029b9dade5"}
Jul 22 20:06:46.766356 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.766170    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.772834    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.778799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.778977    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e40be46-938a-42bc-9112-42c25fc5ffe9" path="/var/lib/kubelet/pods/3e40be46-938a-42bc-9112-42c25fc5ffe9/volumes"
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.779171    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.779361    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.779420    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780192    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780253    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780474    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780520    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780605    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hxrwd\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780776    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.780849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8atejamk5dcch\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.781002    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.781268    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.781710    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 20:06:46.796126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.787824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 20:06:46.896899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.896807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.896899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.896854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.896899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.896880    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.896943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config-out\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897030    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gbcb\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-kube-api-access-6gbcb\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897268    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.897817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.897595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-web-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998689 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998646    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998689 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gbcb\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-kube-api-access-6gbcb\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998835    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998859    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998895    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.998956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.998973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-web-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config-out\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:46.999364 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:46.999275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.000344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.000311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.000476 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.000457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.001640 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.000768    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.001640 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.001286    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.001640 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.001323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.005277 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.001741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.005277 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.004381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.005277 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.004763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.006776 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.006680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.007757 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.007715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config-out\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.010430 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.010188    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.010430 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.010380    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.011284 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.010972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.011284 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.011064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-web-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.011489 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.011445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.012422 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.012381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.013484 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.012873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.013484 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.013450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gbcb\" (UniqueName: \"kubernetes.io/projected/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-kube-api-access-6gbcb\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.014062 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.014006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.016623 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.016578    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4-config\") pod \"prometheus-k8s-0\" (UID: \"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.088635 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.088544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:06:47.278202 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.278041    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 20:06:47.282817 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:06:47.282779    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdfe3b1_226f_4cf2_8a4c_9346cda2cfe4.slice/crio-c1b860495e8919662e285b122b7890626f71619aeaaadab09d505713d9ce2ad6 WatchSource:0}: Error finding container c1b860495e8919662e285b122b7890626f71619aeaaadab09d505713d9ce2ad6: Status 404 returned error can't find the container with id c1b860495e8919662e285b122b7890626f71619aeaaadab09d505713d9ce2ad6
Jul 22 20:06:47.739022 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:47.738979    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"c1b860495e8919662e285b122b7890626f71619aeaaadab09d505713d9ce2ad6"}
Jul 22 20:06:48.688088 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:48.688055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s9nph"
Jul 22 20:06:48.746487 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:48.746448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc" event={"ID":"0e208914-ba9b-4ce1-a17c-a1546197b929","Type":"ContainerStarted","Data":"a0d8a44a31d3f48de21ca82956f87b3d4dc25daf4071cf8752d1737bb3169877"}
Jul 22 20:06:48.746963 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:48.746862    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:48.753679 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:48.753645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc"
Jul 22 20:06:48.763464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:48.763404    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-5whwc" podStartSLOduration=2.276464917 podStartE2EDuration="3.763381943s" totalImagesPullingTime="1.486917026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:48.762329363 +0000 UTC m=+302.493021263" watchObservedRunningTime="2026-07-22 20:06:48.763381943 +0000 UTC m=+302.494073833"
Jul 22 20:06:49.752466 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.752423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg" event={"ID":"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7","Type":"ContainerStarted","Data":"d59e63e47529173d3a44719be48f8f6358702d9abfe9aabe9e11cda6800caef6"}
Jul 22 20:06:49.752951 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.752546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg" event={"ID":"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7","Type":"ContainerStarted","Data":"1f08c4bc3145aa9a01a35301b0d824de6c70c0de197838542ae81868f162b16b"}
Jul 22 20:06:49.752951 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.752579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg" event={"ID":"33cdaefb-86d4-4459-9fe2-2640a6b2d5f7","Type":"ContainerStarted","Data":"525bba052e25c12ca41173d2d5064e5f06c27a03842a31fa6fb93c604a0351a7"}
Jul 22 20:06:49.753951 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.753926    2582 generic.go:356] "Generic (PLEG): container finished" podID="2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4" containerID="e6951349791f51c18bbfea8755fb875f7230bd4522f89b4bb70e04ca4f0c4220" exitCode=0
Jul 22 20:06:49.754047 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.753988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerDied","Data":"e6951349791f51c18bbfea8755fb875f7230bd4522f89b4bb70e04ca4f0c4220"}
Jul 22 20:06:49.755121 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.755106    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:06:49.774978 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:49.774940    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55df64ff76-8dzlg" podStartSLOduration=2.05590166 podStartE2EDuration="4.774926807s" totalImagesPullingTime="2.719025147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:49.774061234 +0000 UTC m=+303.504753122" watchObservedRunningTime="2026-07-22 20:06:49.774926807 +0000 UTC m=+303.505618693"
Jul 22 20:06:52.773671 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:52.773639    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:06:53.777838 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:53.777795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"34321cee41aa9319d0b81d4549fe41248ce2c41e9ba15e89194820ee163d0612"}
Jul 22 20:06:53.778309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:53.777860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"aba97d7c5e20be265add107aef3a6bfc16aca620d91a36ca814bfb7559b5ae7c"}
Jul 22 20:06:56.797446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:56.797410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"ea7c6c26ea16b27a1324a3043e83663e4890f459a3f186e7c4cfb13a1ecede10"}
Jul 22 20:06:56.797835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:56.797500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"8f9119baf17c08dd3938f6cac8daee389cb88751c0cdb321b5a7cc7fe547a454"}
Jul 22 20:06:56.797835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:56.797526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"70b58cbcf905251c52589c22d9615ca505a2415e693fda92e557f65e9549b7fd"}
Jul 22 20:06:56.797835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:56.797553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4","Type":"ContainerStarted","Data":"a8f9209fb473664dc6eac7baf7964667d1b3ea7da119aafde9de00e56c48631b"}
Jul 22 20:06:56.827222 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:56.827143    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.367769783 podStartE2EDuration="10.827127085s" totalImagesPullingTime="7.438729228s" totalInitContainerRuntime="20.628074ms" isStatefulPod=false podCreationTimestamp="2026-07-22 20:06:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:06:56.826080743 +0000 UTC m=+310.556772630" watchObservedRunningTime="2026-07-22 20:06:56.827127085 +0000 UTC m=+310.557818971"
Jul 22 20:06:57.089623 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:06:57.089539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:07:01.249382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:01.249348    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:07:12.860099 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:12.860065    2582 generic.go:356] "Generic (PLEG): container finished" podID="2844f29d-312c-4f84-9c68-748a1520fca7" containerID="afe41c62d018d3f77b1b30969f6543ee12bb6e85ed7f4d82eb672ba0e8416aab" exitCode=0
Jul 22 20:07:12.860531 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:12.860134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl" event={"ID":"2844f29d-312c-4f84-9c68-748a1520fca7","Type":"ContainerDied","Data":"afe41c62d018d3f77b1b30969f6543ee12bb6e85ed7f4d82eb672ba0e8416aab"}
Jul 22 20:07:12.860531 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:12.860494    2582 scope.go:117] "RemoveContainer" containerID="afe41c62d018d3f77b1b30969f6543ee12bb6e85ed7f4d82eb672ba0e8416aab"
Jul 22 20:07:13.868760 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:13.868721    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-2szpl" event={"ID":"2844f29d-312c-4f84-9c68-748a1520fca7","Type":"ContainerStarted","Data":"5978bdcbcb3ad8c2962594f1fae454ff27a82f7201032eb942bded72f646998b"}
Jul 22 20:07:17.888207 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:17.888139    2582 generic.go:356] "Generic (PLEG): container finished" podID="2c174d5e-eba2-421e-9065-3568b94f5de4" containerID="63410029eb5d23a01d7907dbcf7c91512cfe778187f063243caa5317ffb8147b" exitCode=0
Jul 22 20:07:17.888207 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:17.888209    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw" event={"ID":"2c174d5e-eba2-421e-9065-3568b94f5de4","Type":"ContainerDied","Data":"63410029eb5d23a01d7907dbcf7c91512cfe778187f063243caa5317ffb8147b"}
Jul 22 20:07:17.888774 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:17.888627    2582 scope.go:117] "RemoveContainer" containerID="63410029eb5d23a01d7907dbcf7c91512cfe778187f063243caa5317ffb8147b"
Jul 22 20:07:18.896720 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:18.896687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-n4njw" event={"ID":"2c174d5e-eba2-421e-9065-3568b94f5de4","Type":"ContainerStarted","Data":"739aa7309c1171b08bc0cbbd41321f83d910ba889a7e46f592820831ddfe5a46"}
Jul 22 20:07:26.269305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.269263    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69699874f4-7twjj" podUID="5d4f0971-4e87-4793-b38a-26e3d96d1550" containerName="console" containerID="cri-o://c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f" gracePeriod=15
Jul 22 20:07:26.526798 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.526733    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:07:26.664958 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.664900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.664958 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.664965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665001    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf6gf\" (UniqueName: \"kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665018    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665095    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert\") pod \"5d4f0971-4e87-4793-b38a-26e3d96d1550\" (UID: \"5d4f0971-4e87-4793-b38a-26e3d96d1550\") "
Jul 22 20:07:26.665573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:07:26.665573 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665550    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:07:26.665665 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665574    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config" (OuterVolumeSpecName: "console-config") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:07:26.665665 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665616    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:07:26.665801 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665781    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-trusted-ca-bundle\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.665861 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665802    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-config\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.665861 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665811    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-oauth-serving-cert\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.665861 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.665821    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4f0971-4e87-4793-b38a-26e3d96d1550-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.667436 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.667412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:07:26.667539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.667497    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:07:26.667539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.667528    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf" (OuterVolumeSpecName: "kube-api-access-lf6gf") pod "5d4f0971-4e87-4793-b38a-26e3d96d1550" (UID: "5d4f0971-4e87-4793-b38a-26e3d96d1550"). InnerVolumeSpecName "kube-api-access-lf6gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:07:26.766432 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.766397    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf6gf\" (UniqueName: \"kubernetes.io/projected/5d4f0971-4e87-4793-b38a-26e3d96d1550-kube-api-access-lf6gf\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.766432 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.766426    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-oauth-config\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.766432 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.766437    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4f0971-4e87-4793-b38a-26e3d96d1550-console-serving-cert\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:07:26.928311 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.928275    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d4f0971-4e87-4793-b38a-26e3d96d1550" containerID="c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f" exitCode=0
Jul 22 20:07:26.928493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.928322    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69699874f4-7twjj"
Jul 22 20:07:26.928493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.928355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69699874f4-7twjj" event={"ID":"5d4f0971-4e87-4793-b38a-26e3d96d1550","Type":"ContainerDied","Data":"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"}
Jul 22 20:07:26.928493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.928403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69699874f4-7twjj" event={"ID":"5d4f0971-4e87-4793-b38a-26e3d96d1550","Type":"ContainerDied","Data":"af6bbc6ec0306359deb9a83e668dec570b7533c62e32fb56277449477c6d96ed"}
Jul 22 20:07:26.928493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.928426    2582 scope.go:117] "RemoveContainer" containerID="c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"
Jul 22 20:07:26.937436 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.937413    2582 scope.go:117] "RemoveContainer" containerID="c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"
Jul 22 20:07:26.937720 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:07:26.937697    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f\": container with ID starting with c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f not found: ID does not exist" containerID="c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"
Jul 22 20:07:26.937769 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.937729    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f"} err="failed to get container status \"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f\": rpc error: code = NotFound desc = could not find container \"c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f\": container with ID starting with c936e8af8f1373af3d5a1d1aa7e7c0a8132bc2462bd853b3033e2f83c5901b2f not found: ID does not exist"
Jul 22 20:07:26.943317 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.943293    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:07:26.946905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:26.946879    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69699874f4-7twjj"]
Jul 22 20:07:28.778501 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:28.778470    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4f0971-4e87-4793-b38a-26e3d96d1550" path="/var/lib/kubelet/pods/5d4f0971-4e87-4793-b38a-26e3d96d1550/volumes"
Jul 22 20:07:47.089327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:47.089223    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:07:47.105804 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:47.105772    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:07:48.021432 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:07:48.021402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 20:08:00.650021 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:00.649980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:08:00.652197 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:00.652178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2daef6c5-3620-4336-8f5a-457787a6cf93-metrics-certs\") pod \"network-metrics-daemon-qqz6z\" (UID: \"2daef6c5-3620-4336-8f5a-457787a6cf93\") " pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:08:00.876836 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:00.876802    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l85mx\""
Jul 22 20:08:00.884651 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:00.884629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqz6z"
Jul 22 20:08:01.013700 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:01.013671    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqz6z"]
Jul 22 20:08:01.016701 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:08:01.016673    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daef6c5_3620_4336_8f5a_457787a6cf93.slice/crio-95bc1a2edfcff922cf05049d2cb17f77929135345a2d559f69b54b441a88a281 WatchSource:0}: Error finding container 95bc1a2edfcff922cf05049d2cb17f77929135345a2d559f69b54b441a88a281: Status 404 returned error can't find the container with id 95bc1a2edfcff922cf05049d2cb17f77929135345a2d559f69b54b441a88a281
Jul 22 20:08:01.056193 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:01.056142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqz6z" event={"ID":"2daef6c5-3620-4336-8f5a-457787a6cf93","Type":"ContainerStarted","Data":"95bc1a2edfcff922cf05049d2cb17f77929135345a2d559f69b54b441a88a281"}
Jul 22 20:08:03.065648 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:03.065610    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqz6z" event={"ID":"2daef6c5-3620-4336-8f5a-457787a6cf93","Type":"ContainerStarted","Data":"c6750380d097fe911cc44e028d2b644f44e8bd093d5f573ccbbc3d23169c22fb"}
Jul 22 20:08:03.066043 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:03.065665    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqz6z" event={"ID":"2daef6c5-3620-4336-8f5a-457787a6cf93","Type":"ContainerStarted","Data":"efa75190aa39fe1672cae7ac915f2e4feeec93eca0ec1ead6615c455e81af842"}
Jul 22 20:08:03.081746 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:08:03.081694    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qqz6z" podStartSLOduration=375.892018777 podStartE2EDuration="6m17.081678489s" totalImagesPullingTime="1.189659712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:08:03.079943755 +0000 UTC m=+376.810635644" watchObservedRunningTime="2026-07-22 20:08:03.081678489 +0000 UTC m=+376.812370385"
Jul 22 20:09:34.118693 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.118603    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"]
Jul 22 20:09:34.119188 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.118941    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4f0971-4e87-4793-b38a-26e3d96d1550" containerName="console"
Jul 22 20:09:34.119188 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.118953    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4f0971-4e87-4793-b38a-26e3d96d1550" containerName="console"
Jul 22 20:09:34.119188 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.119016    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4f0971-4e87-4793-b38a-26e3d96d1550" containerName="console"
Jul 22 20:09:34.122115 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.122099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.124591 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.124568    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 20:09:34.125281 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.125251    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wh4jc\""
Jul 22 20:09:34.125373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.125301    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 20:09:34.130767 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.130733    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"]
Jul 22 20:09:34.235672 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.235629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e1b7cf6-41eb-4620-9915-75438c36fcb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.235851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.235682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmqmr\" (UniqueName: \"kubernetes.io/projected/3e1b7cf6-41eb-4620-9915-75438c36fcb2-kube-api-access-bmqmr\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.336076 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.336035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e1b7cf6-41eb-4620-9915-75438c36fcb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.336076 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.336082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmqmr\" (UniqueName: \"kubernetes.io/projected/3e1b7cf6-41eb-4620-9915-75438c36fcb2-kube-api-access-bmqmr\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.336429 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.336410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e1b7cf6-41eb-4620-9915-75438c36fcb2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.345293 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.345259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmqmr\" (UniqueName: \"kubernetes.io/projected/3e1b7cf6-41eb-4620-9915-75438c36fcb2-kube-api-access-bmqmr\") pod \"openshift-lws-operator-fd8ccff4c-rlhrq\" (UID: \"3e1b7cf6-41eb-4620-9915-75438c36fcb2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.444406 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.444296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"
Jul 22 20:09:34.578093 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:34.577956    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq"]
Jul 22 20:09:34.580905 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:09:34.580868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e1b7cf6_41eb_4620_9915_75438c36fcb2.slice/crio-f2707cda6c0e9334dead88072ab177a24a83abb1485be8e4c0a1f9c858f36866 WatchSource:0}: Error finding container f2707cda6c0e9334dead88072ab177a24a83abb1485be8e4c0a1f9c858f36866: Status 404 returned error can't find the container with id f2707cda6c0e9334dead88072ab177a24a83abb1485be8e4c0a1f9c858f36866
Jul 22 20:09:35.422027 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:35.421993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq" event={"ID":"3e1b7cf6-41eb-4620-9915-75438c36fcb2","Type":"ContainerStarted","Data":"f2707cda6c0e9334dead88072ab177a24a83abb1485be8e4c0a1f9c858f36866"}
Jul 22 20:09:38.437418 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:38.437378    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq" event={"ID":"3e1b7cf6-41eb-4620-9915-75438c36fcb2","Type":"ContainerStarted","Data":"cfeef4a521e90e900690549a74f9bf4a76749cce1ba757a0f69e64d40745aadb"}
Jul 22 20:09:38.456484 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:38.456436    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rlhrq" podStartSLOduration=1.227807713 podStartE2EDuration="4.456399048s" totalImagesPullingTime="3.228591335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:09:38.455051858 +0000 UTC m=+472.185743769" watchObservedRunningTime="2026-07-22 20:09:38.456399048 +0000 UTC m=+472.187090933"
Jul 22 20:09:55.166945 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.166907    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"]
Jul 22 20:09:55.170462 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.170435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.173065 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.173038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 20:09:55.173846 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.173820    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 20:09:55.173957 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.173823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 20:09:55.173957 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.173908    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mzp9p\""
Jul 22 20:09:55.187211 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.187181    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"]
Jul 22 20:09:55.206019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.205985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-metrics-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.206019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.206020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.206265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.206047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ce611f0-f2ed-4783-896c-256dd8be3c4a-manager-config\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.206265 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.206142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5qgs\" (UniqueName: \"kubernetes.io/projected/6ce611f0-f2ed-4783-896c-256dd8be3c4a-kube-api-access-n5qgs\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.307006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.306967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5qgs\" (UniqueName: \"kubernetes.io/projected/6ce611f0-f2ed-4783-896c-256dd8be3c4a-kube-api-access-n5qgs\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.307006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.307016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-metrics-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.307298 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.307091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.307298 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.307164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ce611f0-f2ed-4783-896c-256dd8be3c4a-manager-config\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.307793 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.307771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6ce611f0-f2ed-4783-896c-256dd8be3c4a-manager-config\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.309465 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.309445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.309569 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.309475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6ce611f0-f2ed-4783-896c-256dd8be3c4a-metrics-cert\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.320746 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.320718    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5qgs\" (UniqueName: \"kubernetes.io/projected/6ce611f0-f2ed-4783-896c-256dd8be3c4a-kube-api-access-n5qgs\") pod \"lws-controller-manager-76bfc99684-xpgwf\" (UID: \"6ce611f0-f2ed-4783-896c-256dd8be3c4a\") " pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.479694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.479618    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:55.618025 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:55.617993    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"]
Jul 22 20:09:55.621211 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:09:55.621184    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce611f0_f2ed_4783_896c_256dd8be3c4a.slice/crio-d3fc13952d05cc8de4c3a184048c26262f3e5784c162104c8814085648cdc0e3 WatchSource:0}: Error finding container d3fc13952d05cc8de4c3a184048c26262f3e5784c162104c8814085648cdc0e3: Status 404 returned error can't find the container with id d3fc13952d05cc8de4c3a184048c26262f3e5784c162104c8814085648cdc0e3
Jul 22 20:09:56.512464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:56.512431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf" event={"ID":"6ce611f0-f2ed-4783-896c-256dd8be3c4a","Type":"ContainerStarted","Data":"d3fc13952d05cc8de4c3a184048c26262f3e5784c162104c8814085648cdc0e3"}
Jul 22 20:09:58.019261 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.019182    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"]
Jul 22 20:09:58.023590 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.023568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.027690 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027664    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 20:09:58.027840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2zr5\" (UniqueName: \"kubernetes.io/projected/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-kube-api-access-l2zr5\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.027840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-tmp\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.027840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.028017 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.028017 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.027914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-manifests\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.028111 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.028039    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zqsx9\""
Jul 22 20:09:58.028321 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.028305    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 20:09:58.028401 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.028348    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 20:09:58.028478 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.028460    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 20:09:58.042539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.042509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"]
Jul 22 20:09:58.128636 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.128588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-tmp\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.128812 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.128655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.128812 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.128715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.128891 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.128849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-manifests\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.128968 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.128946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2zr5\" (UniqueName: \"kubernetes.io/projected/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-kube-api-access-l2zr5\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.129356 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.129326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-manifests\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.131253 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.131219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-tmp\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.131389 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.131326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.131450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.131413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-webhook-cert\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.139728 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.139697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2zr5\" (UniqueName: \"kubernetes.io/projected/b5ff1f3a-ab8a-404a-b0ba-a57021f3f105-kube-api-access-l2zr5\") pod \"opendatahub-operator-controller-manager-9fc56f4f-2x7kn\" (UID: \"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105\") " pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.334062 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.333963    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:09:58.472577 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.472438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"]
Jul 22 20:09:58.478016 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:09:58.477983    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ff1f3a_ab8a_404a_b0ba_a57021f3f105.slice/crio-d3a63a3fea9be99c1ace48afe68443230df53d09f9641aa5a94d44035ef0f0f8 WatchSource:0}: Error finding container d3a63a3fea9be99c1ace48afe68443230df53d09f9641aa5a94d44035ef0f0f8: Status 404 returned error can't find the container with id d3a63a3fea9be99c1ace48afe68443230df53d09f9641aa5a94d44035ef0f0f8
Jul 22 20:09:58.522432 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.522385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf" event={"ID":"6ce611f0-f2ed-4783-896c-256dd8be3c4a","Type":"ContainerStarted","Data":"7b94eed58708c7b71c1f86c108d6feca1d54b0e36f58e22e584c67cfff9f4b3b"}
Jul 22 20:09:58.522578 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.522507    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:09:58.523754 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.523733    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn" event={"ID":"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105","Type":"ContainerStarted","Data":"d3a63a3fea9be99c1ace48afe68443230df53d09f9641aa5a94d44035ef0f0f8"}
Jul 22 20:09:58.539845 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:09:58.539765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf" podStartSLOduration=1.551821613 podStartE2EDuration="3.539750381s" totalImagesPullingTime="1.987928768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:09:58.53920698 +0000 UTC m=+492.269898866" watchObservedRunningTime="2026-07-22 20:09:58.539750381 +0000 UTC m=+492.270442266"
Jul 22 20:10:02.543652 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:02.543616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn" event={"ID":"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105","Type":"ContainerStarted","Data":"e965462c48b1caeb0a47d0fac8a970cec97893523810bdfa6fb798700a5652d1"}
Jul 22 20:10:03.549712 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:03.549680    2582 generic.go:356] "Generic (PLEG): container finished" podID="b5ff1f3a-ab8a-404a-b0ba-a57021f3f105" containerID="e965462c48b1caeb0a47d0fac8a970cec97893523810bdfa6fb798700a5652d1" exitCode=0
Jul 22 20:10:03.550136 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:03.549748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn" event={"ID":"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105","Type":"ContainerDied","Data":"e965462c48b1caeb0a47d0fac8a970cec97893523810bdfa6fb798700a5652d1"}
Jul 22 20:10:04.562928 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:04.562892    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn" event={"ID":"b5ff1f3a-ab8a-404a-b0ba-a57021f3f105","Type":"ContainerStarted","Data":"8a9b0aea38e1c46a3e1fec22a21032711e80c0af4658f3d7cca3f357886d66aa"}
Jul 22 20:10:04.563475 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:04.563040    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:10:04.623697 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:04.623631    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn" podStartSLOduration=2.788212547 podStartE2EDuration="7.623608269s" totalImagesPullingTime="3.785277593s" totalInitContainerRuntime="1.050118129s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:09:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:10:04.623485008 +0000 UTC m=+498.354176895" watchObservedRunningTime="2026-07-22 20:10:04.623608269 +0000 UTC m=+498.354300155"
Jul 22 20:10:09.530828 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:09.530799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76bfc99684-xpgwf"
Jul 22 20:10:15.569268 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:15.569232    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9fc56f4f-2x7kn"
Jul 22 20:10:20.083884 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.083848    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"]
Jul 22 20:10:20.089411 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.089391    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.097732 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.097703    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 20:10:20.097862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.097731    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 20:10:20.097862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.097774    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6gmbk\""
Jul 22 20:10:20.118512 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.118480    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"]
Jul 22 20:10:20.240299 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.240251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aa73c41-e757-49ca-b01a-f9cee2efd569-tmp\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.240299 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.240296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa73c41-e757-49ca-b01a-f9cee2efd569-tls-certs\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.240554 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.240332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lpn\" (UniqueName: \"kubernetes.io/projected/9aa73c41-e757-49ca-b01a-f9cee2efd569-kube-api-access-r6lpn\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.341050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.340953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aa73c41-e757-49ca-b01a-f9cee2efd569-tmp\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.341050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.340998    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa73c41-e757-49ca-b01a-f9cee2efd569-tls-certs\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.341050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.341032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lpn\" (UniqueName: \"kubernetes.io/projected/9aa73c41-e757-49ca-b01a-f9cee2efd569-kube-api-access-r6lpn\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.343381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.343353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9aa73c41-e757-49ca-b01a-f9cee2efd569-tmp\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.343650 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.343629    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9aa73c41-e757-49ca-b01a-f9cee2efd569-tls-certs\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.390731 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.390702    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lpn\" (UniqueName: \"kubernetes.io/projected/9aa73c41-e757-49ca-b01a-f9cee2efd569-kube-api-access-r6lpn\") pod \"kube-auth-proxy-787b995ffc-kz4js\" (UID: \"9aa73c41-e757-49ca-b01a-f9cee2efd569\") " pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.398462 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.398435    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"
Jul 22 20:10:20.573447 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.573404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-787b995ffc-kz4js"]
Jul 22 20:10:20.576241 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:10:20.576206    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa73c41_e757_49ca_b01a_f9cee2efd569.slice/crio-b7dd74a85c7ea35e16aeebc6a0c8b79722587d0d08fc9640c318d913058b8e66 WatchSource:0}: Error finding container b7dd74a85c7ea35e16aeebc6a0c8b79722587d0d08fc9640c318d913058b8e66: Status 404 returned error can't find the container with id b7dd74a85c7ea35e16aeebc6a0c8b79722587d0d08fc9640c318d913058b8e66
Jul 22 20:10:20.634596 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:20.634558    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js" event={"ID":"9aa73c41-e757-49ca-b01a-f9cee2efd569","Type":"ContainerStarted","Data":"b7dd74a85c7ea35e16aeebc6a0c8b79722587d0d08fc9640c318d913058b8e66"}
Jul 22 20:10:23.650186 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:23.650121    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js" event={"ID":"9aa73c41-e757-49ca-b01a-f9cee2efd569","Type":"ContainerStarted","Data":"86c875c7aa814a4925faddcdfbc30a6c0b73d7f234aa6854bfc186e3d9b3f45e"}
Jul 22 20:10:23.793913 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:10:23.793797    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-787b995ffc-kz4js" podStartSLOduration=0.839664578 podStartE2EDuration="3.793776546s" totalImagesPullingTime="2.954111968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:10:23.79194034 +0000 UTC m=+517.522632227" watchObservedRunningTime="2026-07-22 20:10:23.793776546 +0000 UTC m=+517.524468437"
Jul 22 20:11:46.659505 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:11:46.659471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:11:46.660108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:11:46.659609    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:12:27.847411 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.847324    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:12:27.850750 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.850734    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:27.856116 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.856093    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 20:12:27.856256 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.856183    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rjs97\""
Jul 22 20:12:27.856256 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.856161    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 20:12:27.869897 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.869869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:12:27.956440 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.956400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:27.956627 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:27.956452    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbp4c\" (UniqueName: \"kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.057429 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.057387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.057619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.057444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbp4c\" (UniqueName: \"kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.057826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.057795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.066419 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.066381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbp4c\" (UniqueName: \"kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c\") pod \"kuadrant-operator-controller-manager-86878c769f-6zvlh\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.160458 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.160364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:28.310536 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.310505    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:12:28.314340 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:12:28.314258    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6099993e_20ec_4d77_a6f0_c96948eb65d2.slice/crio-361eade3fa597b20ac65ea632593b60f8e2fbf1064b37d7da72e3114398f5c78 WatchSource:0}: Error finding container 361eade3fa597b20ac65ea632593b60f8e2fbf1064b37d7da72e3114398f5c78: Status 404 returned error can't find the container with id 361eade3fa597b20ac65ea632593b60f8e2fbf1064b37d7da72e3114398f5c78
Jul 22 20:12:28.317868 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:28.317845    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:12:29.204053 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:29.204020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" event={"ID":"6099993e-20ec-4d77-a6f0-c96948eb65d2","Type":"ContainerStarted","Data":"361eade3fa597b20ac65ea632593b60f8e2fbf1064b37d7da72e3114398f5c78"}
Jul 22 20:12:34.231439 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:34.231394    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" event={"ID":"6099993e-20ec-4d77-a6f0-c96948eb65d2","Type":"ContainerStarted","Data":"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"}
Jul 22 20:12:34.231880 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:34.231541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:12:34.253447 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:34.253379    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" podStartSLOduration=1.888466067 podStartE2EDuration="7.25336357s" totalImagesPullingTime="5.364897503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:12:34.251199724 +0000 UTC m=+647.981891607" watchObservedRunningTime="2026-07-22 20:12:34.25336357 +0000 UTC m=+647.984055456"
Jul 22 20:12:45.238063 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:12:45.238023    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:13:08.451943 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.451912    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:08.458429 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.458408    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:08.460774 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.460748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9qwmd\""
Jul 22 20:13:08.462139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.462115    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:08.525511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.525477    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsgnq\" (UniqueName: \"kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq\") pod \"authorino-75d556bd77-8pbrx\" (UID: \"e424b844-c815-4919-9868-a41969663f30\") " pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:08.626626 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.626592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsgnq\" (UniqueName: \"kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq\") pod \"authorino-75d556bd77-8pbrx\" (UID: \"e424b844-c815-4919-9868-a41969663f30\") " pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:08.634903 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.634875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsgnq\" (UniqueName: \"kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq\") pod \"authorino-75d556bd77-8pbrx\" (UID: \"e424b844-c815-4919-9868-a41969663f30\") " pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:08.768568 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.768492    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:08.904695 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:08.904672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:08.906980 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:13:08.906952    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode424b844_c815_4919_9868_a41969663f30.slice/crio-770dca85496d092d5b932f50d6c28759b59d7269c1e7f2865b496c010b8a6508 WatchSource:0}: Error finding container 770dca85496d092d5b932f50d6c28759b59d7269c1e7f2865b496c010b8a6508: Status 404 returned error can't find the container with id 770dca85496d092d5b932f50d6c28759b59d7269c1e7f2865b496c010b8a6508
Jul 22 20:13:09.387120 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:09.387078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8pbrx" event={"ID":"e424b844-c815-4919-9868-a41969663f30","Type":"ContainerStarted","Data":"770dca85496d092d5b932f50d6c28759b59d7269c1e7f2865b496c010b8a6508"}
Jul 22 20:13:12.405753 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:12.405661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8pbrx" event={"ID":"e424b844-c815-4919-9868-a41969663f30","Type":"ContainerStarted","Data":"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"}
Jul 22 20:13:12.420413 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:12.420363    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8pbrx" podStartSLOduration=1.173171026 podStartE2EDuration="4.42034757s" totalImagesPullingTime="3.247176544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:13:12.419236854 +0000 UTC m=+686.149928766" watchObservedRunningTime="2026-07-22 20:13:12.42034757 +0000 UTC m=+686.151039456"
Jul 22 20:13:37.080619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.080584    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:37.087384 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.087361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:37.091617 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.091588    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:37.184109 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.184074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvzvm\" (UniqueName: \"kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm\") pod \"authorino-5d4b67c446-szxlf\" (UID: \"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc\") " pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:37.285312 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.285277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvzvm\" (UniqueName: \"kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm\") pod \"authorino-5d4b67c446-szxlf\" (UID: \"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc\") " pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:37.293593 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.293560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvzvm\" (UniqueName: \"kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm\") pod \"authorino-5d4b67c446-szxlf\" (UID: \"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc\") " pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:37.320046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.320013    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:37.320314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.320300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:37.346287 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.346255    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59564f8c84-4j8ws"]
Jul 22 20:13:37.350817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.350793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.357032 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.357008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59564f8c84-4j8ws"]
Jul 22 20:13:37.377486 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.377458    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59564f8c84-4j8ws"]
Jul 22 20:13:37.377828 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:13:37.377800    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rnwg4], unattached volumes=[], failed to process volumes=[kube-api-access-rnwg4]: context canceled" pod="kuadrant-system/authorino-59564f8c84-4j8ws" podUID="fd1c79c4-2cd0-4c05-84af-f26655b3a456"
Jul 22 20:13:37.409488 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.409457    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:13:37.413361 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.413336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.415924 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.415902    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 20:13:37.422986 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.422050    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:13:37.458572 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.458546    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:37.461347 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:13:37.461317    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ef10c8a_61b6_4e52_ae7b_fc58bab20ffc.slice/crio-ecfa950f28cb364d0be0cb443ac4f7e62b8df9c350e8b7d6349f2d5adc532d79 WatchSource:0}: Error finding container ecfa950f28cb364d0be0cb443ac4f7e62b8df9c350e8b7d6349f2d5adc532d79: Status 404 returned error can't find the container with id ecfa950f28cb364d0be0cb443ac4f7e62b8df9c350e8b7d6349f2d5adc532d79
Jul 22 20:13:37.487844 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.487812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnwg4\" (UniqueName: \"kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4\") pod \"authorino-59564f8c84-4j8ws\" (UID: \"fd1c79c4-2cd0-4c05-84af-f26655b3a456\") " pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.518497 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.518470    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.518656 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.518469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-szxlf" event={"ID":"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc","Type":"ContainerStarted","Data":"ecfa950f28cb364d0be0cb443ac4f7e62b8df9c350e8b7d6349f2d5adc532d79"}
Jul 22 20:13:37.525951 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.525931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.589028 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.588943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl6ks\" (UniqueName: \"kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.589028 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.588985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnwg4\" (UniqueName: \"kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4\") pod \"authorino-59564f8c84-4j8ws\" (UID: \"fd1c79c4-2cd0-4c05-84af-f26655b3a456\") " pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.589028 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.589012    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.596561 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.596537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnwg4\" (UniqueName: \"kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4\") pod \"authorino-59564f8c84-4j8ws\" (UID: \"fd1c79c4-2cd0-4c05-84af-f26655b3a456\") " pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:37.689735 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.689702    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnwg4\" (UniqueName: \"kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4\") pod \"fd1c79c4-2cd0-4c05-84af-f26655b3a456\" (UID: \"fd1c79c4-2cd0-4c05-84af-f26655b3a456\") "
Jul 22 20:13:37.689910 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.689894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl6ks\" (UniqueName: \"kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.689964 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.689936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.691766 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.691737    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4" (OuterVolumeSpecName: "kube-api-access-rnwg4") pod "fd1c79c4-2cd0-4c05-84af-f26655b3a456" (UID: "fd1c79c4-2cd0-4c05-84af-f26655b3a456"). InnerVolumeSpecName "kube-api-access-rnwg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:13:37.692227 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.692209    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.697655 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.697635    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl6ks\" (UniqueName: \"kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks\") pod \"authorino-687b7996bd-vxpqp\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") " pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.726644 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.726618    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:13:37.790983 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.790958    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnwg4\" (UniqueName: \"kubernetes.io/projected/fd1c79c4-2cd0-4c05-84af-f26655b3a456-kube-api-access-rnwg4\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:13:37.859625 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:37.859395    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:13:37.861787 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:13:37.861761    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91df749b_f56b_42d3_8a32_a951e5689222.slice/crio-aa6805c576f75a81ed42e0c1017dca9bdf311630077b4e164c20c63f3f74e7de WatchSource:0}: Error finding container aa6805c576f75a81ed42e0c1017dca9bdf311630077b4e164c20c63f3f74e7de: Status 404 returned error can't find the container with id aa6805c576f75a81ed42e0c1017dca9bdf311630077b4e164c20c63f3f74e7de
Jul 22 20:13:38.524906 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.524780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-szxlf" event={"ID":"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc","Type":"ContainerStarted","Data":"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"}
Jul 22 20:13:38.524906 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.524851    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-szxlf" podUID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" containerName="authorino" containerID="cri-o://30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81" gracePeriod=30
Jul 22 20:13:38.526467 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.526443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687b7996bd-vxpqp" event={"ID":"91df749b-f56b-42d3-8a32-a951e5689222","Type":"ContainerStarted","Data":"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"}
Jul 22 20:13:38.526594 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.526473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687b7996bd-vxpqp" event={"ID":"91df749b-f56b-42d3-8a32-a951e5689222","Type":"ContainerStarted","Data":"aa6805c576f75a81ed42e0c1017dca9bdf311630077b4e164c20c63f3f74e7de"}
Jul 22 20:13:38.526594 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.526539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59564f8c84-4j8ws"
Jul 22 20:13:38.539574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.538749    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-szxlf" podStartSLOduration=1.084980271 podStartE2EDuration="1.538729216s" totalImagesPullingTime="453.748945ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:13:38.538268388 +0000 UTC m=+712.268960291" watchObservedRunningTime="2026-07-22 20:13:38.538729216 +0000 UTC m=+712.269421103"
Jul 22 20:13:38.557314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.557265    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-687b7996bd-vxpqp" podStartSLOduration=1.166839958 podStartE2EDuration="1.557249234s" totalImagesPullingTime="390.409276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:13:38.556279378 +0000 UTC m=+712.286971264" watchObservedRunningTime="2026-07-22 20:13:38.557249234 +0000 UTC m=+712.287941146"
Jul 22 20:13:38.581696 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.581664    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:38.581900 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.581871    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8pbrx" podUID="e424b844-c815-4919-9868-a41969663f30" containerName="authorino" containerID="cri-o://564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f" gracePeriod=30
Jul 22 20:13:38.620186 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.620141    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59564f8c84-4j8ws"]
Jul 22 20:13:38.623919 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.623895    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59564f8c84-4j8ws"]
Jul 22 20:13:38.780117 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.780027    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd1c79c4-2cd0-4c05-84af-f26655b3a456" path="/var/lib/kubelet/pods/fd1c79c4-2cd0-4c05-84af-f26655b3a456/volumes"
Jul 22 20:13:38.836669 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.836646    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:38.842468 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:38.842444    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:39.001585 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.001551    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvzvm\" (UniqueName: \"kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm\") pod \"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc\" (UID: \"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc\") "
Jul 22 20:13:39.001776 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.001614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsgnq\" (UniqueName: \"kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq\") pod \"e424b844-c815-4919-9868-a41969663f30\" (UID: \"e424b844-c815-4919-9868-a41969663f30\") "
Jul 22 20:13:39.003870 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.003842    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm" (OuterVolumeSpecName: "kube-api-access-pvzvm") pod "0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" (UID: "0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc"). InnerVolumeSpecName "kube-api-access-pvzvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:13:39.003870 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.003858    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq" (OuterVolumeSpecName: "kube-api-access-tsgnq") pod "e424b844-c815-4919-9868-a41969663f30" (UID: "e424b844-c815-4919-9868-a41969663f30"). InnerVolumeSpecName "kube-api-access-tsgnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:13:39.102457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.102423    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvzvm\" (UniqueName: \"kubernetes.io/projected/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc-kube-api-access-pvzvm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:13:39.102457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.102452    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsgnq\" (UniqueName: \"kubernetes.io/projected/e424b844-c815-4919-9868-a41969663f30-kube-api-access-tsgnq\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:13:39.532732 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.532648    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" containerID="30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81" exitCode=0
Jul 22 20:13:39.532732 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.532692    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-szxlf"
Jul 22 20:13:39.533201 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.532725    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-szxlf" event={"ID":"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc","Type":"ContainerDied","Data":"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"}
Jul 22 20:13:39.533201 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.532765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-szxlf" event={"ID":"0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc","Type":"ContainerDied","Data":"ecfa950f28cb364d0be0cb443ac4f7e62b8df9c350e8b7d6349f2d5adc532d79"}
Jul 22 20:13:39.533201 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.532778    2582 scope.go:117] "RemoveContainer" containerID="30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"
Jul 22 20:13:39.534159 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.533993    2582 generic.go:356] "Generic (PLEG): container finished" podID="e424b844-c815-4919-9868-a41969663f30" containerID="564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f" exitCode=0
Jul 22 20:13:39.534159 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.534034    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8pbrx"
Jul 22 20:13:39.534159 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.534083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8pbrx" event={"ID":"e424b844-c815-4919-9868-a41969663f30","Type":"ContainerDied","Data":"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"}
Jul 22 20:13:39.534159 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.534123    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8pbrx" event={"ID":"e424b844-c815-4919-9868-a41969663f30","Type":"ContainerDied","Data":"770dca85496d092d5b932f50d6c28759b59d7269c1e7f2865b496c010b8a6508"}
Jul 22 20:13:39.541137 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.541119    2582 scope.go:117] "RemoveContainer" containerID="30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"
Jul 22 20:13:39.541430 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:13:39.541411    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81\": container with ID starting with 30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81 not found: ID does not exist" containerID="30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"
Jul 22 20:13:39.541486 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.541438    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81"} err="failed to get container status \"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81\": rpc error: code = NotFound desc = could not find container \"30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81\": container with ID starting with 30da83037185cc21a67a30824290f648860d16133593aadd58d9ba41b3036e81 not found: ID does not exist"
Jul 22 20:13:39.541486 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.541457    2582 scope.go:117] "RemoveContainer" containerID="564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"
Jul 22 20:13:39.549066 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.549045    2582 scope.go:117] "RemoveContainer" containerID="564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"
Jul 22 20:13:39.549337 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:13:39.549316    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f\": container with ID starting with 564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f not found: ID does not exist" containerID="564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"
Jul 22 20:13:39.549402 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.549344    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f"} err="failed to get container status \"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f\": rpc error: code = NotFound desc = could not find container \"564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f\": container with ID starting with 564c3252aa2e4f0cb1822b0f03bf5d3d49ad04d3f41bc89a3655bc89f451485f not found: ID does not exist"
Jul 22 20:13:39.556238 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.556218    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:39.558226 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.558207    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8pbrx"]
Jul 22 20:13:39.567701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.567682    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:39.571474 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:39.571446    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-szxlf"]
Jul 22 20:13:40.778506 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:40.778474    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" path="/var/lib/kubelet/pods/0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc/volumes"
Jul 22 20:13:40.778867 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:13:40.778799    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e424b844-c815-4919-9868-a41969663f30" path="/var/lib/kubelet/pods/e424b844-c815-4919-9868-a41969663f30/volumes"
Jul 22 20:15:48.019608 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.019568    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"]
Jul 22 20:15:48.020224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020116    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e424b844-c815-4919-9868-a41969663f30" containerName="authorino"
Jul 22 20:15:48.020224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020137    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e424b844-c815-4919-9868-a41969663f30" containerName="authorino"
Jul 22 20:15:48.020224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020170    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" containerName="authorino"
Jul 22 20:15:48.020224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020179    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" containerName="authorino"
Jul 22 20:15:48.020442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020309    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ef10c8a-61b6-4e52-ae7b-fc58bab20ffc" containerName="authorino"
Jul 22 20:15:48.020442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.020322    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e424b844-c815-4919-9868-a41969663f30" containerName="authorino"
Jul 22 20:15:48.023857 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.023833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.027296 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.027270    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 20:15:48.027450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.027317    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 20:15:48.027450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.027388    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 20:15:48.027450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.027442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tvrjw\""
Jul 22 20:15:48.035784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.035757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"]
Jul 22 20:15:48.148703 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps84q\" (UniqueName: \"kubernetes.io/projected/3e283127-8193-42a3-a57d-6e951e58ebee-kube-api-access-ps84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.148703 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.148961 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.148961 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.149029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.149029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.148991    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e283127-8193-42a3-a57d-6e951e58ebee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.249840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.249840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249844    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e283127-8193-42a3-a57d-6e951e58ebee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps84q\" (UniqueName: \"kubernetes.io/projected/3e283127-8193-42a3-a57d-6e951e58ebee-kube-api-access-ps84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.249959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.250253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250386 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.250329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.250431 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.250396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.252286 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.252265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e283127-8193-42a3-a57d-6e951e58ebee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.252479 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.252462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e283127-8193-42a3-a57d-6e951e58ebee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.257718 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.257683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps84q\" (UniqueName: \"kubernetes.io/projected/3e283127-8193-42a3-a57d-6e951e58ebee-kube-api-access-ps84q\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc\" (UID: \"3e283127-8193-42a3-a57d-6e951e58ebee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.336170 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.336053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:48.475225 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:48.475199    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"]
Jul 22 20:15:48.477484 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:15:48.477459    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e283127_8193_42a3_a57d_6e951e58ebee.slice/crio-0d2e2cef27970cf5b841242b1f1228b2139683ac1af8f60e1291bc335d7f5f08 WatchSource:0}: Error finding container 0d2e2cef27970cf5b841242b1f1228b2139683ac1af8f60e1291bc335d7f5f08: Status 404 returned error can't find the container with id 0d2e2cef27970cf5b841242b1f1228b2139683ac1af8f60e1291bc335d7f5f08
Jul 22 20:15:49.107023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:49.106978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc" event={"ID":"3e283127-8193-42a3-a57d-6e951e58ebee","Type":"ContainerStarted","Data":"0d2e2cef27970cf5b841242b1f1228b2139683ac1af8f60e1291bc335d7f5f08"}
Jul 22 20:15:50.113944 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:50.113906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc" event={"ID":"3e283127-8193-42a3-a57d-6e951e58ebee","Type":"ContainerStarted","Data":"db308ed4680d9418dc1ec61a596ec4f6f341c3c0fabd581a6cac25d16d77cb58"}
Jul 22 20:15:50.130924 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:50.130869    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc" podStartSLOduration=1.8600954010000001 podStartE2EDuration="3.130850475s" totalImagesPullingTime="1.270755074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:15:50.129515999 +0000 UTC m=+843.860207887" watchObservedRunningTime="2026-07-22 20:15:50.130850475 +0000 UTC m=+843.861542362"
Jul 22 20:15:58.336893 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:58.336856    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:58.337315 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:58.336924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:58.349316 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:58.349290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:15:59.170218 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:15:59.170186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc"
Jul 22 20:16:35.810217 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.810187    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"]
Jul 22 20:16:35.815716 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.815697    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.818204 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.818175    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 20:16:35.828686 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.828663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"]
Jul 22 20:16:35.856091 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.856251 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.856251 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.856251 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg59p\" (UniqueName: \"kubernetes.io/projected/4be67446-bd58-4346-a7f7-f3009c8329cf-kube-api-access-zg59p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.856438 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.856438 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.856355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be67446-bd58-4346-a7f7-f3009c8329cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957409 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg59p\" (UniqueName: \"kubernetes.io/projected/4be67446-bd58-4346-a7f7-f3009c8329cf-kube-api-access-zg59p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957799 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be67446-bd58-4346-a7f7-f3009c8329cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957965 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.957965 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.957934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.959688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.959668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4be67446-bd58-4346-a7f7-f3009c8329cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.959828 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.959810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4be67446-bd58-4346-a7f7-f3009c8329cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:35.966089 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:35.966063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg59p\" (UniqueName: \"kubernetes.io/projected/4be67446-bd58-4346-a7f7-f3009c8329cf-kube-api-access-zg59p\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm\" (UID: \"4be67446-bd58-4346-a7f7-f3009c8329cf\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:36.149815 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:36.149777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:36.293784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:36.293758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"]
Jul 22 20:16:36.296651 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:16:36.296626    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4be67446_bd58_4346_a7f7_f3009c8329cf.slice/crio-66dd8d38325994dbe6ef52e171c7f2bc444d8527c87c050b089276f76632273a WatchSource:0}: Error finding container 66dd8d38325994dbe6ef52e171c7f2bc444d8527c87c050b089276f76632273a: Status 404 returned error can't find the container with id 66dd8d38325994dbe6ef52e171c7f2bc444d8527c87c050b089276f76632273a
Jul 22 20:16:36.322397 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:36.322365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm" event={"ID":"4be67446-bd58-4346-a7f7-f3009c8329cf","Type":"ContainerStarted","Data":"66dd8d38325994dbe6ef52e171c7f2bc444d8527c87c050b089276f76632273a"}
Jul 22 20:16:37.329367 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:37.329327    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm" event={"ID":"4be67446-bd58-4346-a7f7-f3009c8329cf","Type":"ContainerStarted","Data":"482f3bea8408e9711b3781dca7920aad75adeb2d9204ecd750a62244907541b5"}
Jul 22 20:16:37.348888 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:37.348836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm" podStartSLOduration=2.1425404710000002 podStartE2EDuration="2.348818381s" totalImagesPullingTime="206.27791ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:16:37.346918363 +0000 UTC m=+891.077610250" watchObservedRunningTime="2026-07-22 20:16:37.348818381 +0000 UTC m=+891.079510302"
Jul 22 20:16:46.150421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.150376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:46.150892 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.150456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:46.162862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.162839    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:46.381694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.381668    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm"
Jul 22 20:16:46.692435 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.692404    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:16:46.693094 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:16:46.693071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:17:18.431200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.431168    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-577dc5b845-q4xqg"]
Jul 22 20:17:18.434446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.434422    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.444799 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.444772    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577dc5b845-q4xqg"]
Jul 22 20:17:18.546272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.546234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx4jj\" (UniqueName: \"kubernetes.io/projected/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-kube-api-access-sx4jj\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.546446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.546332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-tls-cert\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.647676 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.647637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-tls-cert\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.647843 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.647707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx4jj\" (UniqueName: \"kubernetes.io/projected/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-kube-api-access-sx4jj\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.650073 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.650043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-tls-cert\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.656629 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.656601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx4jj\" (UniqueName: \"kubernetes.io/projected/3ee44b2e-b4f5-433e-8d48-5ac296ffd67e-kube-api-access-sx4jj\") pod \"authorino-577dc5b845-q4xqg\" (UID: \"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e\") " pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.744953 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.744875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-577dc5b845-q4xqg"
Jul 22 20:17:18.885101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:18.885078    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-577dc5b845-q4xqg"]
Jul 22 20:17:18.887470 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:17:18.887437    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ee44b2e_b4f5_433e_8d48_5ac296ffd67e.slice/crio-69adf7b7603f5c3f95716684b4b64ad207004d22610d47d593735f7988bf6907 WatchSource:0}: Error finding container 69adf7b7603f5c3f95716684b4b64ad207004d22610d47d593735f7988bf6907: Status 404 returned error can't find the container with id 69adf7b7603f5c3f95716684b4b64ad207004d22610d47d593735f7988bf6907
Jul 22 20:17:19.517625 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:19.517584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577dc5b845-q4xqg" event={"ID":"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e","Type":"ContainerStarted","Data":"69adf7b7603f5c3f95716684b4b64ad207004d22610d47d593735f7988bf6907"}
Jul 22 20:17:21.534699 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.534659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-577dc5b845-q4xqg" event={"ID":"3ee44b2e-b4f5-433e-8d48-5ac296ffd67e","Type":"ContainerStarted","Data":"b4216511105294aac72261e855381d2196d5c91cd45519abc5e6ed04a1a5c854"}
Jul 22 20:17:21.562372 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.562315    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-577dc5b845-q4xqg" podStartSLOduration=1.9507711300000001 podStartE2EDuration="3.562295667s" totalImagesPullingTime="1.611524537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:17:21.562258601 +0000 UTC m=+935.292950488" watchObservedRunningTime="2026-07-22 20:17:21.562295667 +0000 UTC m=+935.292987553"
Jul 22 20:17:21.599305 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.599269    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:17:21.599519 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.599491    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-687b7996bd-vxpqp" podUID="91df749b-f56b-42d3-8a32-a951e5689222" containerName="authorino" containerID="cri-o://3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506" gracePeriod=30
Jul 22 20:17:21.871120 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.871096    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:17:21.979547 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.979518    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert\") pod \"91df749b-f56b-42d3-8a32-a951e5689222\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") "
Jul 22 20:17:21.979547 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.979553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl6ks\" (UniqueName: \"kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks\") pod \"91df749b-f56b-42d3-8a32-a951e5689222\" (UID: \"91df749b-f56b-42d3-8a32-a951e5689222\") "
Jul 22 20:17:21.981585 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.981548    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks" (OuterVolumeSpecName: "kube-api-access-hl6ks") pod "91df749b-f56b-42d3-8a32-a951e5689222" (UID: "91df749b-f56b-42d3-8a32-a951e5689222"). InnerVolumeSpecName "kube-api-access-hl6ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:17:21.991764 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:21.991735    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "91df749b-f56b-42d3-8a32-a951e5689222" (UID: "91df749b-f56b-42d3-8a32-a951e5689222"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:17:22.080304 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.080264    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/91df749b-f56b-42d3-8a32-a951e5689222-tls-cert\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:17:22.080304 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.080301    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl6ks\" (UniqueName: \"kubernetes.io/projected/91df749b-f56b-42d3-8a32-a951e5689222-kube-api-access-hl6ks\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:17:22.542060 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.542020    2582 generic.go:356] "Generic (PLEG): container finished" podID="91df749b-f56b-42d3-8a32-a951e5689222" containerID="3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506" exitCode=0
Jul 22 20:17:22.542060 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.542061    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687b7996bd-vxpqp"
Jul 22 20:17:22.542579 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.542100    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687b7996bd-vxpqp" event={"ID":"91df749b-f56b-42d3-8a32-a951e5689222","Type":"ContainerDied","Data":"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"}
Jul 22 20:17:22.542579 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.542142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687b7996bd-vxpqp" event={"ID":"91df749b-f56b-42d3-8a32-a951e5689222","Type":"ContainerDied","Data":"aa6805c576f75a81ed42e0c1017dca9bdf311630077b4e164c20c63f3f74e7de"}
Jul 22 20:17:22.542579 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.542178    2582 scope.go:117] "RemoveContainer" containerID="3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"
Jul 22 20:17:22.551514 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.551490    2582 scope.go:117] "RemoveContainer" containerID="3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"
Jul 22 20:17:22.551798 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:17:22.551782    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506\": container with ID starting with 3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506 not found: ID does not exist" containerID="3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"
Jul 22 20:17:22.551852 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.551805    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506"} err="failed to get container status \"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506\": rpc error: code = NotFound desc = could not find container \"3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506\": container with ID starting with 3dc553ac4ee4938ca32e9a5238097912e496709f07d391c5a5eb5b9c30841506 not found: ID does not exist"
Jul 22 20:17:22.565421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.565389    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:17:22.569126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.569096    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687b7996bd-vxpqp"]
Jul 22 20:17:22.779474 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:17:22.779442    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91df749b-f56b-42d3-8a32-a951e5689222" path="/var/lib/kubelet/pods/91df749b-f56b-42d3-8a32-a951e5689222/volumes"
Jul 22 20:21:46.719743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:21:46.719712    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:21:46.721998 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:21:46.721972    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:24:27.912129 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:27.912032    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:24:27.912789 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:27.912280    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" podUID="6099993e-20ec-4d77-a6f0-c96948eb65d2" containerName="manager" containerID="cri-o://5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83" gracePeriod=10
Jul 22 20:24:30.867941 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.867916    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:24:30.874549 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.874525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume\") pod \"6099993e-20ec-4d77-a6f0-c96948eb65d2\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") "
Jul 22 20:24:30.874669 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.874569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbp4c\" (UniqueName: \"kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c\") pod \"6099993e-20ec-4d77-a6f0-c96948eb65d2\" (UID: \"6099993e-20ec-4d77-a6f0-c96948eb65d2\") "
Jul 22 20:24:30.874816 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.874794    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6099993e-20ec-4d77-a6f0-c96948eb65d2" (UID: "6099993e-20ec-4d77-a6f0-c96948eb65d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:24:30.874881 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.874867    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6099993e-20ec-4d77-a6f0-c96948eb65d2-extensions-socket-volume\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:24:30.876676 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.876652    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c" (OuterVolumeSpecName: "kube-api-access-xbp4c") pod "6099993e-20ec-4d77-a6f0-c96948eb65d2" (UID: "6099993e-20ec-4d77-a6f0-c96948eb65d2"). InnerVolumeSpecName "kube-api-access-xbp4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:24:30.975456 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:30.975365    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbp4c\" (UniqueName: \"kubernetes.io/projected/6099993e-20ec-4d77-a6f0-c96948eb65d2-kube-api-access-xbp4c\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:24:31.533909 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.533875    2582 generic.go:356] "Generic (PLEG): container finished" podID="6099993e-20ec-4d77-a6f0-c96948eb65d2" containerID="5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83" exitCode=0
Jul 22 20:24:31.534083 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.533921    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"
Jul 22 20:24:31.534083 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.533937    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" event={"ID":"6099993e-20ec-4d77-a6f0-c96948eb65d2","Type":"ContainerDied","Data":"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"}
Jul 22 20:24:31.534083 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.533989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh" event={"ID":"6099993e-20ec-4d77-a6f0-c96948eb65d2","Type":"ContainerDied","Data":"361eade3fa597b20ac65ea632593b60f8e2fbf1064b37d7da72e3114398f5c78"}
Jul 22 20:24:31.534083 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.534019    2582 scope.go:117] "RemoveContainer" containerID="5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"
Jul 22 20:24:31.543968 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.543949    2582 scope.go:117] "RemoveContainer" containerID="5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"
Jul 22 20:24:31.544221 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:24:31.544201    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83\": container with ID starting with 5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83 not found: ID does not exist" containerID="5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"
Jul 22 20:24:31.544314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.544229    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83"} err="failed to get container status \"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83\": rpc error: code = NotFound desc = could not find container \"5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83\": container with ID starting with 5b3e16d163dd216d4297e2aa71d24c37b2bf7f42f0dce8693c604f7c798f5e83 not found: ID does not exist"
Jul 22 20:24:31.556516 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.556482    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:24:31.561941 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:31.561917    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6zvlh"]
Jul 22 20:24:32.778742 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:24:32.778712    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6099993e-20ec-4d77-a6f0-c96948eb65d2" path="/var/lib/kubelet/pods/6099993e-20ec-4d77-a6f0-c96948eb65d2/volumes"
Jul 22 20:25:29.114542 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114501    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"]
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114851    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91df749b-f56b-42d3-8a32-a951e5689222" containerName="authorino"
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114863    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91df749b-f56b-42d3-8a32-a951e5689222" containerName="authorino"
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114889    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6099993e-20ec-4d77-a6f0-c96948eb65d2" containerName="manager"
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114898    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6099993e-20ec-4d77-a6f0-c96948eb65d2" containerName="manager"
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114953    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6099993e-20ec-4d77-a6f0-c96948eb65d2" containerName="manager"
Jul 22 20:25:29.115023 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.114963    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="91df749b-f56b-42d3-8a32-a951e5689222" containerName="authorino"
Jul 22 20:25:29.117944 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.117927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.121651 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.121633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rjs97\""
Jul 22 20:25:29.133480 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.133453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"]
Jul 22 20:25:29.175721 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.175686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.175921 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.175739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrgs\" (UniqueName: \"kubernetes.io/projected/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-kube-api-access-5wrgs\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.277244 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.277204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrgs\" (UniqueName: \"kubernetes.io/projected/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-kube-api-access-5wrgs\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.277440 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.277313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.277685 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.277664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.289608 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.289579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrgs\" (UniqueName: \"kubernetes.io/projected/18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df-kube-api-access-5wrgs\") pod \"kuadrant-operator-controller-manager-86878c769f-vg2mx\" (UID: \"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.427640 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.427539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.574849 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.574817    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"]
Jul 22 20:25:29.576667 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:25:29.576631    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ba5f9d_da9b_4f3f_a526_7cfec2a0d7df.slice/crio-61f9c986b92840705f860d408d318bc941391451c1fb1d9423fb167acc80e261 WatchSource:0}: Error finding container 61f9c986b92840705f860d408d318bc941391451c1fb1d9423fb167acc80e261: Status 404 returned error can't find the container with id 61f9c986b92840705f860d408d318bc941391451c1fb1d9423fb167acc80e261
Jul 22 20:25:29.796879 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.796775    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx" event={"ID":"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df","Type":"ContainerStarted","Data":"b02fed59c6fd717fb3f9f7c0c0a209c9eb7ef639f543767739b6ddf822e94b17"}
Jul 22 20:25:29.796879 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.796840    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx" event={"ID":"18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df","Type":"ContainerStarted","Data":"61f9c986b92840705f860d408d318bc941391451c1fb1d9423fb167acc80e261"}
Jul 22 20:25:29.797059 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.796962    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:25:29.817767 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:29.817701    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx" podStartSLOduration=0.817679685 podStartE2EDuration="817.679685ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:25:29.815659968 +0000 UTC m=+1423.546351865" watchObservedRunningTime="2026-07-22 20:25:29.817679685 +0000 UTC m=+1423.548371573"
Jul 22 20:25:40.806096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:25:40.806067    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vg2mx"
Jul 22 20:26:46.745837 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:26:46.745807    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:26:46.749077 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:26:46.749055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:28:32.321972 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.321936    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:28:32.325835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.325811    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.328209 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.328184    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-55acace8-kserve-self-signed-certs\""
Jul 22 20:28:32.334796 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.334770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:28:32.413934 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.413889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.413934 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.413938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.414179 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.413962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.414179 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.414009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.414179 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.414044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.414179 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.414098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpl57\" (UniqueName: \"kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515314 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515475 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpl57\" (UniqueName: \"kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515533 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515478    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515565    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.515637 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.515628    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.517796 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.517764    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.517796 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.517766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.524139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.524117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpl57\" (UniqueName: \"kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57\") pod \"e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") " pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.636508 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.636469    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:32.799898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:32.799877    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:28:32.802629 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:28:32.802606    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41c3a1df_f82a_45e7_858f_a43cfec82d99.slice/crio-e3ef21e68f4bd9295a8115592eff2195557bdc90d8447a44e011e352d4e5cffd WatchSource:0}: Error finding container e3ef21e68f4bd9295a8115592eff2195557bdc90d8447a44e011e352d4e5cffd: Status 404 returned error can't find the container with id e3ef21e68f4bd9295a8115592eff2195557bdc90d8447a44e011e352d4e5cffd
Jul 22 20:28:33.662925 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:33.662876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" event={"ID":"41c3a1df-f82a-45e7-858f-a43cfec82d99","Type":"ContainerStarted","Data":"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"}
Jul 22 20:28:33.662925 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:33.662931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" event={"ID":"41c3a1df-f82a-45e7-858f-a43cfec82d99","Type":"ContainerStarted","Data":"e3ef21e68f4bd9295a8115592eff2195557bdc90d8447a44e011e352d4e5cffd"}
Jul 22 20:28:33.680079 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:33.680023    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" podStartSLOduration=1.6800072369999999 podStartE2EDuration="1.680007237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:28:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:28:33.678422718 +0000 UTC m=+1607.409114605" watchObservedRunningTime="2026-07-22 20:28:33.680007237 +0000 UTC m=+1607.410699122"
Jul 22 20:28:42.636576 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:42.636541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:42.636978 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:42.636608    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:42.648779 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:42.648753    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:42.723698 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:42.723666    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:28:54.317096 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:28:54.317053    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:29:09.337720 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.337656    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" podUID="41c3a1df-f82a-45e7-858f-a43cfec82d99" containerName="main" containerID="cri-o://036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7" gracePeriod=45
Jul 22 20:29:09.584620 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.584596    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:29:09.668736 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668691    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpl57\" (UniqueName: \"kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.668736 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.668996 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668754    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.668996 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668816    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.668996 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.668996 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.668846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir\") pod \"41c3a1df-f82a-45e7-858f-a43cfec82d99\" (UID: \"41c3a1df-f82a-45e7-858f-a43cfec82d99\") "
Jul 22 20:29:09.669257 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.669041    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache" (OuterVolumeSpecName: "model-cache") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:29:09.669257 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.669074    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home" (OuterVolumeSpecName: "home") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:29:09.669257 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.669131    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-model-cache\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.669257 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.669219    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:29:09.671046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.671022    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:29:09.671046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.671028    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57" (OuterVolumeSpecName: "kube-api-access-cpl57") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "kube-api-access-cpl57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:29:09.671231 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.671027    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm" (OuterVolumeSpecName: "dshm") pod "41c3a1df-f82a-45e7-858f-a43cfec82d99" (UID: "41c3a1df-f82a-45e7-858f-a43cfec82d99"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:29:09.770344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.770310    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-home\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.770344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.770339    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-dshm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.770344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.770347    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c3a1df-f82a-45e7-858f-a43cfec82d99-tmp-dir\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.770583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.770358    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpl57\" (UniqueName: \"kubernetes.io/projected/41c3a1df-f82a-45e7-858f-a43cfec82d99-kube-api-access-cpl57\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.770583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.770367    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41c3a1df-f82a-45e7-858f-a43cfec82d99-tls-certs\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:29:09.843018 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.842982    2582 generic.go:356] "Generic (PLEG): container finished" podID="41c3a1df-f82a-45e7-858f-a43cfec82d99" containerID="036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7" exitCode=0
Jul 22 20:29:09.843214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.843024    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"
Jul 22 20:29:09.843214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.843023    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" event={"ID":"41c3a1df-f82a-45e7-858f-a43cfec82d99","Type":"ContainerDied","Data":"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"}
Jul 22 20:29:09.843214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.843161    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq" event={"ID":"41c3a1df-f82a-45e7-858f-a43cfec82d99","Type":"ContainerDied","Data":"e3ef21e68f4bd9295a8115592eff2195557bdc90d8447a44e011e352d4e5cffd"}
Jul 22 20:29:09.843214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.843185    2582 scope.go:117] "RemoveContainer" containerID="036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"
Jul 22 20:29:09.854277 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.854257    2582 scope.go:117] "RemoveContainer" containerID="036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"
Jul 22 20:29:09.854558 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:29:09.854542    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7\": container with ID starting with 036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7 not found: ID does not exist" containerID="036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"
Jul 22 20:29:09.854614 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.854567    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7"} err="failed to get container status \"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7\": rpc error: code = NotFound desc = could not find container \"036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7\": container with ID starting with 036fda280b7aee58c6d672a37ce0ca06788c0783fb4479d10ac1c617d187deb7 not found: ID does not exist"
Jul 22 20:29:09.867348 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.867320    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:29:09.868757 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:09.868737    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-55acace8-kserve-696bb67d67-lc9qq"]
Jul 22 20:29:10.779442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:29:10.779410    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41c3a1df-f82a-45e7-858f-a43cfec82d99" path="/var/lib/kubelet/pods/41c3a1df-f82a-45e7-858f-a43cfec82d99/volumes"
Jul 22 20:31:46.773927 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:31:46.773898    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:31:46.778246 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:31:46.778216    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:34:07.671300 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.671265    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:07.671763 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.671748    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41c3a1df-f82a-45e7-858f-a43cfec82d99" containerName="main"
Jul 22 20:34:07.671833 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.671766    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="41c3a1df-f82a-45e7-858f-a43cfec82d99" containerName="main"
Jul 22 20:34:07.671881 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.671870    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="41c3a1df-f82a-45e7-858f-a43cfec82d99" containerName="main"
Jul 22 20:34:07.675396 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.675376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.678093 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.678065    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4722ebb8-serving-cert\""
Jul 22 20:34:07.678254 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.678225    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:34:07.678354 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.678335    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:34:07.678464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.678447    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:34:07.694784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.694755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:07.757564 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.757530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn6vz\" (UniqueName: \"kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.757748 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.757575    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.757748 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.757639    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.858600 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.858556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn6vz\" (UniqueName: \"kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.858811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.858612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.858811 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.858660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.859335 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.859310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.861091 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.861059    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.867126 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.867101    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn6vz\" (UniqueName: \"kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz\") pod \"maas-api-e2e-ait-4722ebb8-748c869874-95t9k\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:07.986789 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:07.986695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:08.115895 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:08.115870    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:08.119317 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:34:08.119287    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c0cb89_c3d4_4ccd_ac6f_ed6a9d2b4f51.slice/crio-f3c83b741117d4075d37ce5b168b8fbf3fb1bd32010e9b1126c6486d24154c09 WatchSource:0}: Error finding container f3c83b741117d4075d37ce5b168b8fbf3fb1bd32010e9b1126c6486d24154c09: Status 404 returned error can't find the container with id f3c83b741117d4075d37ce5b168b8fbf3fb1bd32010e9b1126c6486d24154c09
Jul 22 20:34:08.120646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:08.120626    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:34:08.264342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:08.264254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" event={"ID":"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51","Type":"ContainerStarted","Data":"f3c83b741117d4075d37ce5b168b8fbf3fb1bd32010e9b1126c6486d24154c09"}
Jul 22 20:34:12.289716 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:12.289680    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" event={"ID":"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51","Type":"ContainerStarted","Data":"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"}
Jul 22 20:34:12.290408 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:12.289781    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:12.306701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:12.306650    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" podStartSLOduration=1.626705765 podStartE2EDuration="5.306633737s" totalImagesPullingTime="3.679927972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:34:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:34:12.304284393 +0000 UTC m=+1946.034976279" watchObservedRunningTime="2026-07-22 20:34:12.306633737 +0000 UTC m=+1946.037325622"
Jul 22 20:34:18.301086 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:18.301055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:43.793891 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:43.793856    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:43.794332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:43.794221    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" podUID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" containerName="maas-api" containerID="cri-o://4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b" gracePeriod=30
Jul 22 20:34:44.049552 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.049484    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:44.187234 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.187198    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn6vz\" (UniqueName: \"kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz\") pod \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") "
Jul 22 20:34:44.187234 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.187244    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls\") pod \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") "
Jul 22 20:34:44.187456 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.187288    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca\") pod \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\" (UID: \"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51\") "
Jul 22 20:34:44.187673 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.187645    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" (UID: "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:34:44.189555 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.189523    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" (UID: "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:34:44.189673 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.189552    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz" (OuterVolumeSpecName: "kube-api-access-mn6vz") pod "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" (UID: "05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51"). InnerVolumeSpecName "kube-api-access-mn6vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:34:44.287981 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.287939    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn6vz\" (UniqueName: \"kubernetes.io/projected/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-kube-api-access-mn6vz\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:34:44.287981 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.287974    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:34:44.287981 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.287986    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:34:44.442799 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.442762    2582 generic.go:356] "Generic (PLEG): container finished" podID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" containerID="4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b" exitCode=0
Jul 22 20:34:44.442974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.442812    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"
Jul 22 20:34:44.442974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.442820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" event={"ID":"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51","Type":"ContainerDied","Data":"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"}
Jul 22 20:34:44.442974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.442873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k" event={"ID":"05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51","Type":"ContainerDied","Data":"f3c83b741117d4075d37ce5b168b8fbf3fb1bd32010e9b1126c6486d24154c09"}
Jul 22 20:34:44.442974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.442905    2582 scope.go:117] "RemoveContainer" containerID="4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"
Jul 22 20:34:44.452100 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.452076    2582 scope.go:117] "RemoveContainer" containerID="4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"
Jul 22 20:34:44.452420 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:34:44.452399    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b\": container with ID starting with 4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b not found: ID does not exist" containerID="4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"
Jul 22 20:34:44.452499 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.452428    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b"} err="failed to get container status \"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b\": rpc error: code = NotFound desc = could not find container \"4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b\": container with ID starting with 4f09bd7be3d8f6a15eb1f6d7b25f31ae5bae98bb6f3e3b3d8707360a57c7ed8b not found: ID does not exist"
Jul 22 20:34:44.463737 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.463708    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:44.467722 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.467698    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4722ebb8-748c869874-95t9k"]
Jul 22 20:34:44.779653 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:44.779571    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" path="/var/lib/kubelet/pods/05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51/volumes"
Jul 22 20:34:52.846042 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.845998    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:34:52.846680 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.846387    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" containerName="maas-api"
Jul 22 20:34:52.846680 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.846400    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" containerName="maas-api"
Jul 22 20:34:52.846680 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.846485    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="05c0cb89-c3d4-4ccd-ac6f-ed6a9d2b4f51" containerName="maas-api"
Jul 22 20:34:52.849266 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.849244    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.851884 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.851862    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6627cefd-serving-cert\""
Jul 22 20:34:52.852268 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.852250    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:34:52.852363 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.852299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:34:52.852638 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.852623    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:34:52.859258 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.859234    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:34:52.860679 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.860657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.860772 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.860700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.860772 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.860751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr9dx\" (UniqueName: \"kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.961566 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.961530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.961745 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.961582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.961745 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.961629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr9dx\" (UniqueName: \"kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.961745 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:34:52.961725    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-serving-cert: secret "maas-api-e2e-derive-6627cefd-serving-cert" not found
Jul 22 20:34:52.961849 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:34:52.961810    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls podName:0452f827-b78a-40bf-a2a5-de036359d189 nodeName:}" failed. No retries permitted until 2026-07-22 20:34:53.461793444 +0000 UTC m=+1987.192485309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls") pod "maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" (UID: "0452f827-b78a-40bf-a2a5-de036359d189") : secret "maas-api-e2e-derive-6627cefd-serving-cert" not found
Jul 22 20:34:52.962160 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.962128    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:52.978539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:52.978510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr9dx\" (UniqueName: \"kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:53.465210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:53.465163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:53.467547 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:53.467523    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") pod \"maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:53.760936 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:53.760847    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:53.895058 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:53.895027    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:34:53.897659 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:34:53.897630    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0452f827_b78a_40bf_a2a5_de036359d189.slice/crio-6c824c8cc83a5d47a888afee84854a8d2ccaf9fba6802bc25258c2341f04c1c2 WatchSource:0}: Error finding container 6c824c8cc83a5d47a888afee84854a8d2ccaf9fba6802bc25258c2341f04c1c2: Status 404 returned error can't find the container with id 6c824c8cc83a5d47a888afee84854a8d2ccaf9fba6802bc25258c2341f04c1c2
Jul 22 20:34:54.492655 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:54.492624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" event={"ID":"0452f827-b78a-40bf-a2a5-de036359d189","Type":"ContainerStarted","Data":"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"}
Jul 22 20:34:54.492851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:54.492672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" event={"ID":"0452f827-b78a-40bf-a2a5-de036359d189","Type":"ContainerStarted","Data":"6c824c8cc83a5d47a888afee84854a8d2ccaf9fba6802bc25258c2341f04c1c2"}
Jul 22 20:34:54.492851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:54.492767    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:34:54.510013 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:34:54.509892    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" podStartSLOduration=2.144152619 podStartE2EDuration="2.50987498s" totalImagesPullingTime="365.722361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:34:54.508811792 +0000 UTC m=+1988.239503678" watchObservedRunningTime="2026-07-22 20:34:54.50987498 +0000 UTC m=+1988.240566867"
Jul 22 20:35:00.503680 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:00.503650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:35:28.115349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.115312    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:35:28.115918 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.115585    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" podUID="0452f827-b78a-40bf-a2a5-de036359d189" containerName="maas-api" containerID="cri-o://febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7" gracePeriod=30
Jul 22 20:35:28.359601 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.359576    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:35:28.477395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.477302    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr9dx\" (UniqueName: \"kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx\") pod \"0452f827-b78a-40bf-a2a5-de036359d189\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") "
Jul 22 20:35:28.477395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.477379    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca\") pod \"0452f827-b78a-40bf-a2a5-de036359d189\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") "
Jul 22 20:35:28.477627 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.477478    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") pod \"0452f827-b78a-40bf-a2a5-de036359d189\" (UID: \"0452f827-b78a-40bf-a2a5-de036359d189\") "
Jul 22 20:35:28.477743 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.477713    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0452f827-b78a-40bf-a2a5-de036359d189" (UID: "0452f827-b78a-40bf-a2a5-de036359d189"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:35:28.479495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.479468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0452f827-b78a-40bf-a2a5-de036359d189" (UID: "0452f827-b78a-40bf-a2a5-de036359d189"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:35:28.479661 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.479641    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx" (OuterVolumeSpecName: "kube-api-access-jr9dx") pod "0452f827-b78a-40bf-a2a5-de036359d189" (UID: "0452f827-b78a-40bf-a2a5-de036359d189"). InnerVolumeSpecName "kube-api-access-jr9dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:35:28.578597 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.578555    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0452f827-b78a-40bf-a2a5-de036359d189-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:35:28.578597 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.578592    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr9dx\" (UniqueName: \"kubernetes.io/projected/0452f827-b78a-40bf-a2a5-de036359d189-kube-api-access-jr9dx\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:35:28.578597 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.578604    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0452f827-b78a-40bf-a2a5-de036359d189-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:35:28.652349 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.652317    2582 generic.go:356] "Generic (PLEG): container finished" podID="0452f827-b78a-40bf-a2a5-de036359d189" containerID="febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7" exitCode=0
Jul 22 20:35:28.652519 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.652361    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"
Jul 22 20:35:28.652519 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.652373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" event={"ID":"0452f827-b78a-40bf-a2a5-de036359d189","Type":"ContainerDied","Data":"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"}
Jul 22 20:35:28.652519 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.652417    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm" event={"ID":"0452f827-b78a-40bf-a2a5-de036359d189","Type":"ContainerDied","Data":"6c824c8cc83a5d47a888afee84854a8d2ccaf9fba6802bc25258c2341f04c1c2"}
Jul 22 20:35:28.652519 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.652443    2582 scope.go:117] "RemoveContainer" containerID="febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"
Jul 22 20:35:28.661029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.661011    2582 scope.go:117] "RemoveContainer" containerID="febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"
Jul 22 20:35:28.661340 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:35:28.661321    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7\": container with ID starting with febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7 not found: ID does not exist" containerID="febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"
Jul 22 20:35:28.661410 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.661350    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7"} err="failed to get container status \"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7\": rpc error: code = NotFound desc = could not find container \"febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7\": container with ID starting with febcde5acca439f87174a06782dc9b2cc010e25a171a7413e366d3abef87c9c7 not found: ID does not exist"
Jul 22 20:35:28.682553 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.682530    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:35:28.695366 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.695340    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6627cefd-78b8b9d454-x45gm"]
Jul 22 20:35:28.779398 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:35:28.779316    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0452f827-b78a-40bf-a2a5-de036359d189" path="/var/lib/kubelet/pods/0452f827-b78a-40bf-a2a5-de036359d189/volumes"
Jul 22 20:36:46.802131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:36:46.802103    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:36:46.806183 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:36:46.806164    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:37:13.015731 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.015674    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:13.016288 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.016266    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0452f827-b78a-40bf-a2a5-de036359d189" containerName="maas-api"
Jul 22 20:37:13.016387 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.016295    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0452f827-b78a-40bf-a2a5-de036359d189" containerName="maas-api"
Jul 22 20:37:13.016437 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.016399    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0452f827-b78a-40bf-a2a5-de036359d189" containerName="maas-api"
Jul 22 20:37:13.020071 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.020048    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.022495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.022474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c6819716-serving-cert\""
Jul 22 20:37:13.022495 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.022485    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:37:13.023247 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.023226    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:37:13.023392 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.023231    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:37:13.032255 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.032225    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:13.128345 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.128306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.128542 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.128443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.128542 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.128529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5pz\" (UniqueName: \"kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.229574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.229528    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.229759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.229611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5pz\" (UniqueName: \"kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.229759 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.229663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.230587 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.230557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.232563 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.232537    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.240684 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.240658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5pz\" (UniqueName: \"kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz\") pod \"maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.334876 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.334779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:13.481923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:13.481890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:13.484426 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:37:13.484389    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eebf398_7611_40fe_a91a_a165ee381f00.slice/crio-fe080776a1f96df4c906ea399d7f3941cf1e3fc321e5b92aa4fa96e8f952c9f1 WatchSource:0}: Error finding container fe080776a1f96df4c906ea399d7f3941cf1e3fc321e5b92aa4fa96e8f952c9f1: Status 404 returned error can't find the container with id fe080776a1f96df4c906ea399d7f3941cf1e3fc321e5b92aa4fa96e8f952c9f1
Jul 22 20:37:14.147280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:14.147184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" event={"ID":"1eebf398-7611-40fe-a91a-a165ee381f00","Type":"ContainerStarted","Data":"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"}
Jul 22 20:37:14.147280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:14.147244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" event={"ID":"1eebf398-7611-40fe-a91a-a165ee381f00","Type":"ContainerStarted","Data":"fe080776a1f96df4c906ea399d7f3941cf1e3fc321e5b92aa4fa96e8f952c9f1"}
Jul 22 20:37:14.147788 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:14.147342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:14.165885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:14.165826    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" podStartSLOduration=1.789333363 podStartE2EDuration="2.165810311s" totalImagesPullingTime="376.476948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:37:14.164516386 +0000 UTC m=+2127.895208276" watchObservedRunningTime="2026-07-22 20:37:14.165810311 +0000 UTC m=+2127.896502198"
Jul 22 20:37:20.157415 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:20.157378    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:35.237392 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.237344    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:35.237861 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.237599    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" podUID="1eebf398-7611-40fe-a91a-a165ee381f00" containerName="maas-api" containerID="cri-o://b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b" gracePeriod=30
Jul 22 20:37:35.483200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.483171    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:35.640400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.640359    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca\") pod \"1eebf398-7611-40fe-a91a-a165ee381f00\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") "
Jul 22 20:37:35.640400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.640403    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g5pz\" (UniqueName: \"kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz\") pod \"1eebf398-7611-40fe-a91a-a165ee381f00\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") "
Jul 22 20:37:35.640622 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.640450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls\") pod \"1eebf398-7611-40fe-a91a-a165ee381f00\" (UID: \"1eebf398-7611-40fe-a91a-a165ee381f00\") "
Jul 22 20:37:35.640836 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.640806    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1eebf398-7611-40fe-a91a-a165ee381f00" (UID: "1eebf398-7611-40fe-a91a-a165ee381f00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:37:35.642602 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.642577    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz" (OuterVolumeSpecName: "kube-api-access-4g5pz") pod "1eebf398-7611-40fe-a91a-a165ee381f00" (UID: "1eebf398-7611-40fe-a91a-a165ee381f00"). InnerVolumeSpecName "kube-api-access-4g5pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:37:35.642701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.642590    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1eebf398-7611-40fe-a91a-a165ee381f00" (UID: "1eebf398-7611-40fe-a91a-a165ee381f00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:37:35.741391 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.741351    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1eebf398-7611-40fe-a91a-a165ee381f00-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:37:35.741391 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.741381    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g5pz\" (UniqueName: \"kubernetes.io/projected/1eebf398-7611-40fe-a91a-a165ee381f00-kube-api-access-4g5pz\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:37:35.741391 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:35.741391    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1eebf398-7611-40fe-a91a-a165ee381f00-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:37:36.251864 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.251833    2582 generic.go:356] "Generic (PLEG): container finished" podID="1eebf398-7611-40fe-a91a-a165ee381f00" containerID="b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b" exitCode=0
Jul 22 20:37:36.252297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.251877    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"
Jul 22 20:37:36.252297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.251921    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" event={"ID":"1eebf398-7611-40fe-a91a-a165ee381f00","Type":"ContainerDied","Data":"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"}
Jul 22 20:37:36.252297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.251974    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9" event={"ID":"1eebf398-7611-40fe-a91a-a165ee381f00","Type":"ContainerDied","Data":"fe080776a1f96df4c906ea399d7f3941cf1e3fc321e5b92aa4fa96e8f952c9f1"}
Jul 22 20:37:36.252297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.251997    2582 scope.go:117] "RemoveContainer" containerID="b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"
Jul 22 20:37:36.260956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.260939    2582 scope.go:117] "RemoveContainer" containerID="b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"
Jul 22 20:37:36.261324 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:37:36.261306    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b\": container with ID starting with b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b not found: ID does not exist" containerID="b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"
Jul 22 20:37:36.261381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.261331    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b"} err="failed to get container status \"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b\": rpc error: code = NotFound desc = could not find container \"b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b\": container with ID starting with b1307d644a5b0d3bc5754c8fc23125f18550c4955f7b57923ba7015bd9678f9b not found: ID does not exist"
Jul 22 20:37:36.271558 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.271536    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:36.275321 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.275296    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6819716-f7cb4f9c6-nwzl9"]
Jul 22 20:37:36.779387 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:37:36.779354    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eebf398-7611-40fe-a91a-a165ee381f00" path="/var/lib/kubelet/pods/1eebf398-7611-40fe-a91a-a165ee381f00/volumes"
Jul 22 20:38:09.345346 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.345311    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:09.345802 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.345649    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eebf398-7611-40fe-a91a-a165ee381f00" containerName="maas-api"
Jul 22 20:38:09.345802 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.345660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eebf398-7611-40fe-a91a-a165ee381f00" containerName="maas-api"
Jul 22 20:38:09.345802 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.345727    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eebf398-7611-40fe-a91a-a165ee381f00" containerName="maas-api"
Jul 22 20:38:09.348688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.348667    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.351005 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.350986    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e950683d-serving-cert\""
Jul 22 20:38:09.351108 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.351080    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:38:09.351209 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.351187    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:38:09.351821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.351805    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:38:09.357829 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.357804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:09.443869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.443837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.443869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.443878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4kmm\" (UniqueName: \"kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.444251 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.443987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.545002 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.544961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.545002 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.545006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4kmm\" (UniqueName: \"kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.545252 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.545078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.545791 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.545766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.547457 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.547433    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.558035 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.558005    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4kmm\" (UniqueName: \"kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm\") pod \"maas-api-e2e-mt-e950683d-7bd879d94c-4scf8\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.660982 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.660941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:09.801664 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:09.801626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:09.804076 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:38:09.804048    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd307efb_bace_4c1d_b83e_cf7d98473d08.slice/crio-a566450d8c5dae45dbf5733b86319d19b678878faf0575afaa54280dacc09b3e WatchSource:0}: Error finding container a566450d8c5dae45dbf5733b86319d19b678878faf0575afaa54280dacc09b3e: Status 404 returned error can't find the container with id a566450d8c5dae45dbf5733b86319d19b678878faf0575afaa54280dacc09b3e
Jul 22 20:38:10.410199 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:10.410140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" event={"ID":"fd307efb-bace-4c1d-b83e-cf7d98473d08","Type":"ContainerStarted","Data":"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"}
Jul 22 20:38:10.410580 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:10.410215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" event={"ID":"fd307efb-bace-4c1d-b83e-cf7d98473d08","Type":"ContainerStarted","Data":"a566450d8c5dae45dbf5733b86319d19b678878faf0575afaa54280dacc09b3e"}
Jul 22 20:38:10.410580 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:10.410272    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:10.427490 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:10.427435    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" podStartSLOduration=1.028198129 podStartE2EDuration="1.427418852s" totalImagesPullingTime="399.220723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:38:10.426616196 +0000 UTC m=+2184.157308084" watchObservedRunningTime="2026-07-22 20:38:10.427418852 +0000 UTC m=+2184.158110738"
Jul 22 20:38:16.420839 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:16.420808    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:57.653019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.652982    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:57.655638 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.653263    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" podUID="fd307efb-bace-4c1d-b83e-cf7d98473d08" containerName="maas-api" containerID="cri-o://47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630" gracePeriod=30
Jul 22 20:38:57.902430 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.902397    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:57.986780 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.986674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4kmm\" (UniqueName: \"kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm\") pod \"fd307efb-bace-4c1d-b83e-cf7d98473d08\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") "
Jul 22 20:38:57.986780 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.986760    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca\") pod \"fd307efb-bace-4c1d-b83e-cf7d98473d08\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") "
Jul 22 20:38:57.987011 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.986850    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls\") pod \"fd307efb-bace-4c1d-b83e-cf7d98473d08\" (UID: \"fd307efb-bace-4c1d-b83e-cf7d98473d08\") "
Jul 22 20:38:57.987123 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.987092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fd307efb-bace-4c1d-b83e-cf7d98473d08" (UID: "fd307efb-bace-4c1d-b83e-cf7d98473d08"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:38:57.988885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.988859    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm" (OuterVolumeSpecName: "kube-api-access-s4kmm") pod "fd307efb-bace-4c1d-b83e-cf7d98473d08" (UID: "fd307efb-bace-4c1d-b83e-cf7d98473d08"). InnerVolumeSpecName "kube-api-access-s4kmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:38:57.988970 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:57.988890    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fd307efb-bace-4c1d-b83e-cf7d98473d08" (UID: "fd307efb-bace-4c1d-b83e-cf7d98473d08"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:38:58.087846 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.087801    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd307efb-bace-4c1d-b83e-cf7d98473d08-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:38:58.087846 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.087837    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4kmm\" (UniqueName: \"kubernetes.io/projected/fd307efb-bace-4c1d-b83e-cf7d98473d08-kube-api-access-s4kmm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:38:58.087846 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.087848    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd307efb-bace-4c1d-b83e-cf7d98473d08-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:38:58.636180 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.636128    2582 generic.go:356] "Generic (PLEG): container finished" podID="fd307efb-bace-4c1d-b83e-cf7d98473d08" containerID="47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630" exitCode=0
Jul 22 20:38:58.636352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.636193    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"
Jul 22 20:38:58.636352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.636217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" event={"ID":"fd307efb-bace-4c1d-b83e-cf7d98473d08","Type":"ContainerDied","Data":"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"}
Jul 22 20:38:58.636352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.636273    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8" event={"ID":"fd307efb-bace-4c1d-b83e-cf7d98473d08","Type":"ContainerDied","Data":"a566450d8c5dae45dbf5733b86319d19b678878faf0575afaa54280dacc09b3e"}
Jul 22 20:38:58.636352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.636306    2582 scope.go:117] "RemoveContainer" containerID="47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"
Jul 22 20:38:58.645470 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.645455    2582 scope.go:117] "RemoveContainer" containerID="47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"
Jul 22 20:38:58.645703 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:38:58.645685    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630\": container with ID starting with 47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630 not found: ID does not exist" containerID="47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"
Jul 22 20:38:58.645785 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.645712    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630"} err="failed to get container status \"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630\": rpc error: code = NotFound desc = could not find container \"47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630\": container with ID starting with 47a2c40a0335ab4efee391a95a95bbd44224ea9c27b5a27dd2221f42abb79630 not found: ID does not exist"
Jul 22 20:38:58.657001 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.656978    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:58.660868 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.660845    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e950683d-7bd879d94c-4scf8"]
Jul 22 20:38:58.779396 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:38:58.779362    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd307efb-bace-4c1d-b83e-cf7d98473d08" path="/var/lib/kubelet/pods/fd307efb-bace-4c1d-b83e-cf7d98473d08/volumes"
Jul 22 20:40:51.144129 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.144087    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:40:51.144660 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.144638    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd307efb-bace-4c1d-b83e-cf7d98473d08" containerName="maas-api"
Jul 22 20:40:51.144707 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.144664    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd307efb-bace-4c1d-b83e-cf7d98473d08" containerName="maas-api"
Jul 22 20:40:51.144773 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.144762    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd307efb-bace-4c1d-b83e-cf7d98473d08" containerName="maas-api"
Jul 22 20:40:51.148217 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.148197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.150578 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.150545    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ba38bd-serving-cert\""
Jul 22 20:40:51.150712 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.150622    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:40:51.151465 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.151440    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:40:51.151683 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.151664    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:40:51.161976 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.161951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:40:51.194448 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.194409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.194614 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.194469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.194614 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.194513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86hwj\" (UniqueName: \"kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.295328 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.295289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.295517 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.295349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.295517 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.295368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86hwj\" (UniqueName: \"kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.295517 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:40:51.295437    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-serving-cert: secret "maas-api-e2e-inf-a-ba38bd-serving-cert" not found
Jul 22 20:40:51.295517 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:40:51.295513    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls podName:1b47413f-e860-47e9-94ad-87dd8d9a850f nodeName:}" failed. No retries permitted until 2026-07-22 20:40:51.795490929 +0000 UTC m=+2345.526182804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls") pod "maas-api-e2e-inf-a-ba38bd-87f849467-85grh" (UID: "1b47413f-e860-47e9-94ad-87dd8d9a850f") : secret "maas-api-e2e-inf-a-ba38bd-serving-cert" not found
Jul 22 20:40:51.296058 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.296034    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.305638 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.305610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86hwj\" (UniqueName: \"kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.799602 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.799566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:51.802044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:51.802022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") pod \"maas-api-e2e-inf-a-ba38bd-87f849467-85grh\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:52.066671 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:52.066584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:52.198459 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:52.198396    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:40:52.200738 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:40:52.200707    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b47413f_e860_47e9_94ad_87dd8d9a850f.slice/crio-ace38d7432299973b917265fda56aea1cd13db245921948e6ced12a7fff800d6 WatchSource:0}: Error finding container ace38d7432299973b917265fda56aea1cd13db245921948e6ced12a7fff800d6: Status 404 returned error can't find the container with id ace38d7432299973b917265fda56aea1cd13db245921948e6ced12a7fff800d6
Jul 22 20:40:52.201992 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:52.201972    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:40:53.184955 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:53.184918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" event={"ID":"1b47413f-e860-47e9-94ad-87dd8d9a850f","Type":"ContainerStarted","Data":"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"}
Jul 22 20:40:53.185160 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:53.184970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" event={"ID":"1b47413f-e860-47e9-94ad-87dd8d9a850f","Type":"ContainerStarted","Data":"ace38d7432299973b917265fda56aea1cd13db245921948e6ced12a7fff800d6"}
Jul 22 20:40:53.185160 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:53.185025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:53.204633 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:53.204583    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" podStartSLOduration=1.786327395 podStartE2EDuration="2.204566384s" totalImagesPullingTime="418.238989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:40:53.20312974 +0000 UTC m=+2346.933821628" watchObservedRunningTime="2026-07-22 20:40:53.204566384 +0000 UTC m=+2346.935258270"
Jul 22 20:40:59.171470 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.171439    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:40:59.175073 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.175055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.176912 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.176891    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-614db5-serving-cert\""
Jul 22 20:40:59.183715 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.183694    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:40:59.195614 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.195590    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:40:59.269761 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.269727    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.269925 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.269838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm9hv\" (UniqueName: \"kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.269925 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.269912    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.371284 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.371243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.371464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.371320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm9hv\" (UniqueName: \"kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.371464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.371361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.372014 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.371991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.373741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.373722    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.378419 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.378399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm9hv\" (UniqueName: \"kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv\") pod \"maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.486336 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.486250    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:40:59.624840 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:40:59.624812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:40:59.627280 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:40:59.627244    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaad4292_ed49_4179_97f1_b48847124c0f.slice/crio-89648bc3e34f295b1953cece8aae570a4748e1eb591b32013ad9b478e238eecb WatchSource:0}: Error finding container 89648bc3e34f295b1953cece8aae570a4748e1eb591b32013ad9b478e238eecb: Status 404 returned error can't find the container with id 89648bc3e34f295b1953cece8aae570a4748e1eb591b32013ad9b478e238eecb
Jul 22 20:41:00.218621 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:00.218584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" event={"ID":"caad4292-ed49-4179-97f1-b48847124c0f","Type":"ContainerStarted","Data":"89648bc3e34f295b1953cece8aae570a4748e1eb591b32013ad9b478e238eecb"}
Jul 22 20:41:01.226563 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:01.226526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" event={"ID":"caad4292-ed49-4179-97f1-b48847124c0f","Type":"ContainerStarted","Data":"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"}
Jul 22 20:41:01.227038 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:01.226647    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:41:01.241909 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:01.241862    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" podStartSLOduration=1.6331067620000002 podStartE2EDuration="2.24181119s" totalImagesPullingTime="608.704428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:41:01.240892636 +0000 UTC m=+2354.971584525" watchObservedRunningTime="2026-07-22 20:41:01.24181119 +0000 UTC m=+2354.972503107"
Jul 22 20:41:07.236123 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:07.236089    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:41:08.117670 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.117639    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:41:08.121289 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.121270    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.124224 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.124197    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ba38bd\"/\"openshift-service-ca.crt\""
Jul 22 20:41:08.124344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.124228    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ba38bd\"/\"kube-root-ca.crt\""
Jul 22 20:41:08.124344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.124243    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ba38bd\"/\"test-model-ba38bd-kserve-self-signed-certs\""
Jul 22 20:41:08.124344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.124202    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ba38bd\"/\"default-dockercfg-6969j\""
Jul 22 20:41:08.130028 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.130011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:41:08.251842 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.251809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.252260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.251857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.252260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.251940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.252260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.251966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.252260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.252029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6ghr\" (UniqueName: \"kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.252260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.252064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352527 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6ghr\" (UniqueName: \"kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352694 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.352853 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.352705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.353059 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.353035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.353101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.353073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.353131 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.353123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.354928 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.354907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.355228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.355212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.360384 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.360360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6ghr\" (UniqueName: \"kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr\") pod \"test-model-ba38bd-kserve-57b48b9c7c-4dkhq\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") " pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.432188 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.432095    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:08.567597 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:08.567573    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:41:08.570071 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:41:08.570041    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7cb5706_530d_42dc_b7b9_169cb70533c8.slice/crio-f6da612e2428406e68de462fed561f971f7d4a974fc278b72bcf18f1c789126d WatchSource:0}: Error finding container f6da612e2428406e68de462fed561f971f7d4a974fc278b72bcf18f1c789126d: Status 404 returned error can't find the container with id f6da612e2428406e68de462fed561f971f7d4a974fc278b72bcf18f1c789126d
Jul 22 20:41:09.264778 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:09.264740    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" event={"ID":"d7cb5706-530d-42dc-b7b9-169cb70533c8","Type":"ContainerStarted","Data":"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"}
Jul 22 20:41:09.264778 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:09.264780    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" event={"ID":"d7cb5706-530d-42dc-b7b9-169cb70533c8","Type":"ContainerStarted","Data":"f6da612e2428406e68de462fed561f971f7d4a974fc278b72bcf18f1c789126d"}
Jul 22 20:41:09.283488 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:09.283422    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" podStartSLOduration=1.283404682 podStartE2EDuration="1.283404682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:41:09.28306432 +0000 UTC m=+2363.013756217" watchObservedRunningTime="2026-07-22 20:41:09.283404682 +0000 UTC m=+2363.014096570"
Jul 22 20:41:18.432340 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:18.432307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:18.432771 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:18.432612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:18.445891 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:18.445864    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:19.322228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:19.322197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:41:46.831784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:46.831753    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:41:46.840196 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:41:46.840172    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:42:02.464848 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:02.464812    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:42:14.053232 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.053110    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:42:14.053700 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.053490    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerName="maas-api" containerID="cri-o://8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107" gracePeriod=30
Jul 22 20:42:14.190044 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.189993    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.40:8443/health\": dial tcp 10.134.0.40:8443: connect: connection refused"
Jul 22 20:42:14.502982 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.502951    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:42:14.576729 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.576695    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerID="8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107" exitCode=0
Jul 22 20:42:14.576923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.576761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"
Jul 22 20:42:14.576923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.576778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" event={"ID":"1b47413f-e860-47e9-94ad-87dd8d9a850f","Type":"ContainerDied","Data":"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"}
Jul 22 20:42:14.576923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.576857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh" event={"ID":"1b47413f-e860-47e9-94ad-87dd8d9a850f","Type":"ContainerDied","Data":"ace38d7432299973b917265fda56aea1cd13db245921948e6ced12a7fff800d6"}
Jul 22 20:42:14.576923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.576879    2582 scope.go:117] "RemoveContainer" containerID="8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"
Jul 22 20:42:14.585279 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.585260    2582 scope.go:117] "RemoveContainer" containerID="8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"
Jul 22 20:42:14.585575 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:42:14.585534    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107\": container with ID starting with 8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107 not found: ID does not exist" containerID="8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"
Jul 22 20:42:14.585575 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.585559    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107"} err="failed to get container status \"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107\": rpc error: code = NotFound desc = could not find container \"8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107\": container with ID starting with 8994d97c2f8d4b2804ca109f06b5c0a24761b805341439bfd47b67d69453c107 not found: ID does not exist"
Jul 22 20:42:14.667949 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.667914    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86hwj\" (UniqueName: \"kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj\") pod \"1b47413f-e860-47e9-94ad-87dd8d9a850f\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") "
Jul 22 20:42:14.668174 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.667981    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") pod \"1b47413f-e860-47e9-94ad-87dd8d9a850f\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") "
Jul 22 20:42:14.668262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.668175    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca\") pod \"1b47413f-e860-47e9-94ad-87dd8d9a850f\" (UID: \"1b47413f-e860-47e9-94ad-87dd8d9a850f\") "
Jul 22 20:42:14.668521 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.668497    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b47413f-e860-47e9-94ad-87dd8d9a850f" (UID: "1b47413f-e860-47e9-94ad-87dd8d9a850f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:42:14.670101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.670078    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b47413f-e860-47e9-94ad-87dd8d9a850f" (UID: "1b47413f-e860-47e9-94ad-87dd8d9a850f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:42:14.670196 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.670090    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj" (OuterVolumeSpecName: "kube-api-access-86hwj") pod "1b47413f-e860-47e9-94ad-87dd8d9a850f" (UID: "1b47413f-e860-47e9-94ad-87dd8d9a850f"). InnerVolumeSpecName "kube-api-access-86hwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:42:14.769552 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.769509    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86hwj\" (UniqueName: \"kubernetes.io/projected/1b47413f-e860-47e9-94ad-87dd8d9a850f-kube-api-access-86hwj\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:14.769552 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.769543    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b47413f-e860-47e9-94ad-87dd8d9a850f-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:14.769552 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.769552    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b47413f-e860-47e9-94ad-87dd8d9a850f-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:14.891048 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.891008    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:42:14.894723 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:14.894696    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ba38bd-87f849467-85grh"]
Jul 22 20:42:16.779214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:16.779175    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" path="/var/lib/kubelet/pods/1b47413f-e860-47e9-94ad-87dd8d9a850f/volumes"
Jul 22 20:42:17.484678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.484629    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" podUID="d7cb5706-530d-42dc-b7b9-169cb70533c8" containerName="main" containerID="cri-o://c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2" gracePeriod=45
Jul 22 20:42:17.731564 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.731529    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:42:17.795537 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795434    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.795537 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795484    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795549    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795571    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6ghr\" (UniqueName: \"kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795650    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home\") pod \"d7cb5706-530d-42dc-b7b9-169cb70533c8\" (UID: \"d7cb5706-530d-42dc-b7b9-169cb70533c8\") "
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795845    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.795854    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:42:17.796054 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.796005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home" (OuterVolumeSpecName: "home") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:42:17.797773 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.797752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:42:17.797854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.797796    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr" (OuterVolumeSpecName: "kube-api-access-q6ghr") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "kube-api-access-q6ghr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:42:17.797854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.797827    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm" (OuterVolumeSpecName: "dshm") pod "d7cb5706-530d-42dc-b7b9-169cb70533c8" (UID: "d7cb5706-530d-42dc-b7b9-169cb70533c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:42:17.896283 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896249    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-dshm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:17.896283 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896276    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7cb5706-530d-42dc-b7b9-169cb70533c8-tls-certs\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:17.896283 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896286    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-model-cache\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:17.896283 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896293    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-tmp-dir\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:17.896541 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896302    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6ghr\" (UniqueName: \"kubernetes.io/projected/d7cb5706-530d-42dc-b7b9-169cb70533c8-kube-api-access-q6ghr\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:17.896541 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:17.896310    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7cb5706-530d-42dc-b7b9-169cb70533c8-home\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:18.596798 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.596759    2582 generic.go:356] "Generic (PLEG): container finished" podID="d7cb5706-530d-42dc-b7b9-169cb70533c8" containerID="c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2" exitCode=0
Jul 22 20:42:18.596969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.596807    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"
Jul 22 20:42:18.596969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.596847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" event={"ID":"d7cb5706-530d-42dc-b7b9-169cb70533c8","Type":"ContainerDied","Data":"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"}
Jul 22 20:42:18.596969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.596898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq" event={"ID":"d7cb5706-530d-42dc-b7b9-169cb70533c8","Type":"ContainerDied","Data":"f6da612e2428406e68de462fed561f971f7d4a974fc278b72bcf18f1c789126d"}
Jul 22 20:42:18.596969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.596919    2582 scope.go:117] "RemoveContainer" containerID="c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"
Jul 22 20:42:18.606214 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.606194    2582 scope.go:117] "RemoveContainer" containerID="c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"
Jul 22 20:42:18.606465 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:42:18.606441    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2\": container with ID starting with c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2 not found: ID does not exist" containerID="c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"
Jul 22 20:42:18.606539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.606480    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2"} err="failed to get container status \"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2\": rpc error: code = NotFound desc = could not find container \"c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2\": container with ID starting with c5ff8aeff69681c531f460fb796d2125e27f6039b09cd54fb9d40e29f0b2b0e2 not found: ID does not exist"
Jul 22 20:42:18.618065 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.618035    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:42:18.621041 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.621017    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ba38bd/test-model-ba38bd-kserve-57b48b9c7c-4dkhq"]
Jul 22 20:42:18.779926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:18.779892    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7cb5706-530d-42dc-b7b9-169cb70533c8" path="/var/lib/kubelet/pods/d7cb5706-530d-42dc-b7b9-169cb70533c8/volumes"
Jul 22 20:42:25.361010 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.360978    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"]
Jul 22 20:42:25.361416 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361364    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerName="maas-api"
Jul 22 20:42:25.361416 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361377    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerName="maas-api"
Jul 22 20:42:25.361416 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361386    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7cb5706-530d-42dc-b7b9-169cb70533c8" containerName="main"
Jul 22 20:42:25.361416 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361392    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7cb5706-530d-42dc-b7b9-169cb70533c8" containerName="main"
Jul 22 20:42:25.361557 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361464    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b47413f-e860-47e9-94ad-87dd8d9a850f" containerName="maas-api"
Jul 22 20:42:25.361557 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.361478    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7cb5706-530d-42dc-b7b9-169cb70533c8" containerName="main"
Jul 22 20:42:25.364382 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.364364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:25.366793 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.366767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hjqt7\""
Jul 22 20:42:25.372201 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.372177    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"]
Jul 22 20:42:25.457663 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.457628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n\" (UID: \"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:25.558721 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.558684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n\" (UID: \"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:25.559348 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.559330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n\" (UID: \"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:25.674782 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.674695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:25.808327 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:25.808301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"]
Jul 22 20:42:25.811231 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:42:25.811205    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f01013_e02c_4cdd_b7cb_4e2917c69eb2.slice/crio-115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03 WatchSource:0}: Error finding container 115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03: Status 404 returned error can't find the container with id 115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03
Jul 22 20:42:26.639467 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:26.639415    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n" event={"ID":"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2","Type":"ContainerStarted","Data":"115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03"}
Jul 22 20:42:28.653785 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:28.653747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n" event={"ID":"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2","Type":"ContainerStarted","Data":"f3089935608e1447575dc2de7bf3422af5c3d4299c23a9b760fae9e5263680c0"}
Jul 22 20:42:28.669254 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:28.669186    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n" podStartSLOduration=1.478962111 podStartE2EDuration="3.669169076s" totalImagesPullingTime="2.190206965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:42:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:42:28.667097686 +0000 UTC m=+2442.397789574" watchObservedRunningTime="2026-07-22 20:42:28.669169076 +0000 UTC m=+2442.399860953"
Jul 22 20:42:29.660050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:29.660012    2582 generic.go:356] "Generic (PLEG): container finished" podID="d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" containerID="f3089935608e1447575dc2de7bf3422af5c3d4299c23a9b760fae9e5263680c0" exitCode=0
Jul 22 20:42:29.660499 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:29.660074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n" event={"ID":"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2","Type":"ContainerDied","Data":"f3089935608e1447575dc2de7bf3422af5c3d4299c23a9b760fae9e5263680c0"}
Jul 22 20:42:30.797252 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:30.797223    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:30.912611 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:30.912573    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca\") pod \"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2\" (UID: \"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2\") "
Jul 22 20:42:30.912948 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:30.912923    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" (UID: "d4f01013-e02c-4cdd-b7cb-4e2917c69eb2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:42:31.013939 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:31.013848    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2-maas-api-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:31.670421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:31.670386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n" event={"ID":"d4f01013-e02c-4cdd-b7cb-4e2917c69eb2","Type":"ContainerDied","Data":"115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03"}
Jul 22 20:42:31.670421 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:31.670403    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"
Jul 22 20:42:31.670638 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:31.670434    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="115dffa23578af7ffce97dc961d31b7d680b4aac16925b3bac03a6a58154df03"
Jul 22 20:42:35.995233 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:35.995192    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:42:35.995762 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:35.995457    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" podUID="caad4292-ed49-4179-97f1-b48847124c0f" containerName="maas-api" containerID="cri-o://2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6" gracePeriod=30
Jul 22 20:42:36.247479 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.247418    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:42:36.364101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.364059    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm9hv\" (UniqueName: \"kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv\") pod \"caad4292-ed49-4179-97f1-b48847124c0f\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") "
Jul 22 20:42:36.364101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.364112    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca\") pod \"caad4292-ed49-4179-97f1-b48847124c0f\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") "
Jul 22 20:42:36.364389 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.364292    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls\") pod \"caad4292-ed49-4179-97f1-b48847124c0f\" (UID: \"caad4292-ed49-4179-97f1-b48847124c0f\") "
Jul 22 20:42:36.364550 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.364526    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "caad4292-ed49-4179-97f1-b48847124c0f" (UID: "caad4292-ed49-4179-97f1-b48847124c0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:42:36.366285 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.366260    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv" (OuterVolumeSpecName: "kube-api-access-hm9hv") pod "caad4292-ed49-4179-97f1-b48847124c0f" (UID: "caad4292-ed49-4179-97f1-b48847124c0f"). InnerVolumeSpecName "kube-api-access-hm9hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:42:36.366369 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.366278    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "caad4292-ed49-4179-97f1-b48847124c0f" (UID: "caad4292-ed49-4179-97f1-b48847124c0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:42:36.465367 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.465322    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caad4292-ed49-4179-97f1-b48847124c0f-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:36.465367 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.465362    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm9hv\" (UniqueName: \"kubernetes.io/projected/caad4292-ed49-4179-97f1-b48847124c0f-kube-api-access-hm9hv\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:36.465367 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.465377    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caad4292-ed49-4179-97f1-b48847124c0f-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:42:36.695200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.695133    2582 generic.go:356] "Generic (PLEG): container finished" podID="caad4292-ed49-4179-97f1-b48847124c0f" containerID="2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6" exitCode=0
Jul 22 20:42:36.695200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.695194    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"
Jul 22 20:42:36.695453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.695213    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" event={"ID":"caad4292-ed49-4179-97f1-b48847124c0f","Type":"ContainerDied","Data":"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"}
Jul 22 20:42:36.695453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.695269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw" event={"ID":"caad4292-ed49-4179-97f1-b48847124c0f","Type":"ContainerDied","Data":"89648bc3e34f295b1953cece8aae570a4748e1eb591b32013ad9b478e238eecb"}
Jul 22 20:42:36.695453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.695291    2582 scope.go:117] "RemoveContainer" containerID="2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"
Jul 22 20:42:36.704717 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.704698    2582 scope.go:117] "RemoveContainer" containerID="2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"
Jul 22 20:42:36.705014 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:42:36.704990    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6\": container with ID starting with 2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6 not found: ID does not exist" containerID="2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"
Jul 22 20:42:36.705063 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.705022    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6"} err="failed to get container status \"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6\": rpc error: code = NotFound desc = could not find container \"2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6\": container with ID starting with 2d02e3f071ea12e3ce5f8e693343a06fd3598c8ab48c831b5dc2f09bd53c70b6 not found: ID does not exist"
Jul 22 20:42:36.721082 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.721049    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:42:36.731183 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.727217    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-614db5-6b9f69d6cb-fjrlw"]
Jul 22 20:42:36.780458 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:36.780419    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caad4292-ed49-4179-97f1-b48847124c0f" path="/var/lib/kubelet/pods/caad4292-ed49-4179-97f1-b48847124c0f/volumes"
Jul 22 20:42:40.464575 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:40.464525    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"]
Jul 22 20:42:40.466097 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:40.466073    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-614db5-p6l7n"]
Jul 22 20:42:40.779784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:40.779686    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" path="/var/lib/kubelet/pods/d4f01013-e02c-4cdd-b7cb-4e2917c69eb2/volumes"
Jul 22 20:42:51.538796 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.538760    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539134    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caad4292-ed49-4179-97f1-b48847124c0f" containerName="maas-api"
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539189    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="caad4292-ed49-4179-97f1-b48847124c0f" containerName="maas-api"
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539199    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" containerName="revoke-keys"
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539207    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" containerName="revoke-keys"
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539271    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="caad4292-ed49-4179-97f1-b48847124c0f" containerName="maas-api"
Jul 22 20:42:51.539332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.539280    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f01013-e02c-4cdd-b7cb-4e2917c69eb2" containerName="revoke-keys"
Jul 22 20:42:51.552335 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.552113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:42:51.552335 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.552170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.554900 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.554858    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-83c37c-serving-cert\""
Jul 22 20:42:51.555032 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.555013    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:42:51.555400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.555376    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:42:51.555505 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.555403    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:42:51.708373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.708322    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.708557 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.708396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.708557 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.708426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz5dp\" (UniqueName: \"kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.809442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.809343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.809442 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.809422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.809679 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.809461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz5dp\" (UniqueName: \"kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.809679 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:42:51.809565    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-serving-cert: secret "maas-api-e2e-api-a-83c37c-serving-cert" not found
Jul 22 20:42:51.809679 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:42:51.809630    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls podName:c93e1d84-2c2a-4f9b-bdef-c67d4ac87014 nodeName:}" failed. No retries permitted until 2026-07-22 20:42:52.309614046 +0000 UTC m=+2466.040305911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls") pod "maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" (UID: "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014") : secret "maas-api-e2e-api-a-83c37c-serving-cert" not found
Jul 22 20:42:51.809983 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.809964    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:51.819986 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:51.819960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz5dp\" (UniqueName: \"kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:52.315828 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:52.315782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:52.318583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:52.318547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") pod \"maas-api-e2e-api-a-83c37c-859dbb7c95-875vt\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:52.464790 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:52.464745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:52.608486 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:52.608459    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:42:52.610713 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:42:52.610684    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93e1d84_2c2a_4f9b_bdef_c67d4ac87014.slice/crio-7692c2f14581cacbbf8eaf108570e27bfdb0b53869d723a700142b37345b0644 WatchSource:0}: Error finding container 7692c2f14581cacbbf8eaf108570e27bfdb0b53869d723a700142b37345b0644: Status 404 returned error can't find the container with id 7692c2f14581cacbbf8eaf108570e27bfdb0b53869d723a700142b37345b0644
Jul 22 20:42:52.772342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:52.772305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" event={"ID":"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014","Type":"ContainerStarted","Data":"7692c2f14581cacbbf8eaf108570e27bfdb0b53869d723a700142b37345b0644"}
Jul 22 20:42:53.778075 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:53.778039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" event={"ID":"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014","Type":"ContainerStarted","Data":"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"}
Jul 22 20:42:53.778517 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:53.778128    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:53.795429 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:53.795377    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" podStartSLOduration=2.390973771 podStartE2EDuration="2.795360865s" totalImagesPullingTime="404.387094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:42:53.793912182 +0000 UTC m=+2467.524604071" watchObservedRunningTime="2026-07-22 20:42:53.795360865 +0000 UTC m=+2467.526052752"
Jul 22 20:42:59.680566 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.680519    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:42:59.685050 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.685025    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.687352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.687327    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3f3d31-serving-cert\""
Jul 22 20:42:59.695974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.695945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:42:59.785064 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.785025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmpg\" (UniqueName: \"kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.785309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.785077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.785309 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.785194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.787539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.787513    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:42:59.886262 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.886219    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmpg\" (UniqueName: \"kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.886477 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.886275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.886477 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.886390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.887139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.887116    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.888780 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.888753    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.893789 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.893763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmpg\" (UniqueName: \"kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg\") pod \"maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:42:59.996133 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:42:59.996047    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:43:00.164675 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:00.164636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:43:00.168442 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:43:00.168399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6341bd8_c5b4_4e58_a1e2_227919c4d2b7.slice/crio-362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222 WatchSource:0}: Error finding container 362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222: Status 404 returned error can't find the container with id 362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222
Jul 22 20:43:00.810321 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:00.810224    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" event={"ID":"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7","Type":"ContainerStarted","Data":"77cc9935eb083e54d694ca59e7dd54e5b1ee3cad570f93deb492504d0aab1f8e"}
Jul 22 20:43:00.810321 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:00.810276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" event={"ID":"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7","Type":"ContainerStarted","Data":"362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222"}
Jul 22 20:43:00.810727 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:00.810343    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:43:00.848381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:00.848315    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" podStartSLOduration=1.4740193750000001 podStartE2EDuration="1.848298185s" totalImagesPullingTime="374.27881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:42:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:43:00.847552646 +0000 UTC m=+2474.578244562" watchObservedRunningTime="2026-07-22 20:43:00.848298185 +0000 UTC m=+2474.578990071"
Jul 22 20:43:06.820859 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:06.820826    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:43:28.038135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.038097    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:43:28.039080 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.039041    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" podUID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" containerName="maas-api" containerID="cri-o://86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f" gracePeriod=30
Jul 22 20:43:28.290584 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.290519    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:43:28.429509 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.429470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") pod \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") "
Jul 22 20:43:28.429668 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.429529    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz5dp\" (UniqueName: \"kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp\") pod \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") "
Jul 22 20:43:28.429668 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.429612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca\") pod \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\" (UID: \"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014\") "
Jul 22 20:43:28.430001 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.429970    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" (UID: "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:43:28.431615 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.431584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp" (OuterVolumeSpecName: "kube-api-access-pz5dp") pod "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" (UID: "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014"). InnerVolumeSpecName "kube-api-access-pz5dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:43:28.431720 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.431633    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" (UID: "c93e1d84-2c2a-4f9b-bdef-c67d4ac87014"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:43:28.530574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.530532    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz5dp\" (UniqueName: \"kubernetes.io/projected/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-kube-api-access-pz5dp\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:28.530574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.530567    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:28.530574 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.530578    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:28.938424 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.938387    2582 generic.go:356] "Generic (PLEG): container finished" podID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" containerID="86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f" exitCode=0
Jul 22 20:43:28.938424 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.938427    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"
Jul 22 20:43:28.938648 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.938451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" event={"ID":"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014","Type":"ContainerDied","Data":"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"}
Jul 22 20:43:28.938648 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.938500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt" event={"ID":"c93e1d84-2c2a-4f9b-bdef-c67d4ac87014","Type":"ContainerDied","Data":"7692c2f14581cacbbf8eaf108570e27bfdb0b53869d723a700142b37345b0644"}
Jul 22 20:43:28.938648 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.938523    2582 scope.go:117] "RemoveContainer" containerID="86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"
Jul 22 20:43:28.946912 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.946893    2582 scope.go:117] "RemoveContainer" containerID="86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"
Jul 22 20:43:28.947284 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:43:28.947263    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f\": container with ID starting with 86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f not found: ID does not exist" containerID="86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"
Jul 22 20:43:28.947363 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.947294    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f"} err="failed to get container status \"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f\": rpc error: code = NotFound desc = could not find container \"86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f\": container with ID starting with 86b5e500e1f224353bd870eb448d40be6a0a9cb27332237dfd9859d835d1042f not found: ID does not exist"
Jul 22 20:43:28.954042 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.954017    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:43:28.957445 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:28.957421    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-83c37c-859dbb7c95-875vt"]
Jul 22 20:43:30.779489 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:30.779452    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" path="/var/lib/kubelet/pods/c93e1d84-2c2a-4f9b-bdef-c67d4ac87014/volumes"
Jul 22 20:43:39.189221 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.189117    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"]
Jul 22 20:43:39.189591 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.189544    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" containerName="maas-api"
Jul 22 20:43:39.189591 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.189560    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" containerName="maas-api"
Jul 22 20:43:39.189664 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.189638    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c93e1d84-2c2a-4f9b-bdef-c67d4ac87014" containerName="maas-api"
Jul 22 20:43:39.194098 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.194080    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:39.196575 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.196552    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hjqt7\""
Jul 22 20:43:39.199618 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.199592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"]
Jul 22 20:43:39.325498 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.325460    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt\" (UID: \"4e860618-7e56-41ba-8c91-4503603a3c7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:39.426789 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.426750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt\" (UID: \"4e860618-7e56-41ba-8c91-4503603a3c7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:39.427524 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.427502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt\" (UID: \"4e860618-7e56-41ba-8c91-4503603a3c7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:39.505556 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.505466    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:39.642946 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.642920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"]
Jul 22 20:43:39.645315 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:43:39.645271    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e860618_7e56_41ba_8c91_4503603a3c7c.slice/crio-d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee WatchSource:0}: Error finding container d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee: Status 404 returned error can't find the container with id d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee
Jul 22 20:43:39.990433 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.990398    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt" event={"ID":"4e860618-7e56-41ba-8c91-4503603a3c7c","Type":"ContainerStarted","Data":"f6fd1cb33dcc9c60ba68473acfd5bcccb4e1cf0fdad70da5841025fb82667ecf"}
Jul 22 20:43:39.990615 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:39.990451    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt" event={"ID":"4e860618-7e56-41ba-8c91-4503603a3c7c","Type":"ContainerStarted","Data":"d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee"}
Jul 22 20:43:40.003511 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:40.003453    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt" podStartSLOduration=1.003433878 podStartE2EDuration="1.003433878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:43:40.003025753 +0000 UTC m=+2513.733717640" watchObservedRunningTime="2026-07-22 20:43:40.003433878 +0000 UTC m=+2513.734125765"
Jul 22 20:43:40.996249 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:40.996209    2582 generic.go:356] "Generic (PLEG): container finished" podID="4e860618-7e56-41ba-8c91-4503603a3c7c" containerID="f6fd1cb33dcc9c60ba68473acfd5bcccb4e1cf0fdad70da5841025fb82667ecf" exitCode=0
Jul 22 20:43:40.996645 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:40.996300    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt" event={"ID":"4e860618-7e56-41ba-8c91-4503603a3c7c","Type":"ContainerDied","Data":"f6fd1cb33dcc9c60ba68473acfd5bcccb4e1cf0fdad70da5841025fb82667ecf"}
Jul 22 20:43:42.132183 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:42.132158    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:42.249929 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:42.249891    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca\") pod \"4e860618-7e56-41ba-8c91-4503603a3c7c\" (UID: \"4e860618-7e56-41ba-8c91-4503603a3c7c\") "
Jul 22 20:43:42.250288 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:42.250263    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e860618-7e56-41ba-8c91-4503603a3c7c" (UID: "4e860618-7e56-41ba-8c91-4503603a3c7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:43:42.350642 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:42.350617    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e860618-7e56-41ba-8c91-4503603a3c7c-maas-api-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:43.007487 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:43.007460    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"
Jul 22 20:43:43.007664 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:43.007516    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt" event={"ID":"4e860618-7e56-41ba-8c91-4503603a3c7c","Type":"ContainerDied","Data":"d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee"}
Jul 22 20:43:43.007664 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:43.007581    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1225f7a8ab4f0b6e38c62f879f6707a7dd9516eb9da6b7a63917f08c4b6feee"
Jul 22 20:43:54.822177 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:54.822123    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:43:54.822688 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:54.822387    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" podUID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" containerName="maas-api" containerID="cri-o://77cc9935eb083e54d694ca59e7dd54e5b1ee3cad570f93deb492504d0aab1f8e" gracePeriod=30
Jul 22 20:43:55.065715 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.065687    2582 generic.go:356] "Generic (PLEG): container finished" podID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" containerID="77cc9935eb083e54d694ca59e7dd54e5b1ee3cad570f93deb492504d0aab1f8e" exitCode=0
Jul 22 20:43:55.065836 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.065768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" event={"ID":"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7","Type":"ContainerDied","Data":"77cc9935eb083e54d694ca59e7dd54e5b1ee3cad570f93deb492504d0aab1f8e"}
Jul 22 20:43:55.065836 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.065831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k" event={"ID":"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7","Type":"ContainerDied","Data":"362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222"}
Jul 22 20:43:55.065940 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.065855    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="362c30a9241e087e0772cc91fb6c67415ec40cf66afc84536875155884c7f222"
Jul 22 20:43:55.073679 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.073623    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:43:55.165819 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.165783    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjmpg\" (UniqueName: \"kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg\") pod \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") "
Jul 22 20:43:55.166017 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.165883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca\") pod \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") "
Jul 22 20:43:55.166017 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.165926    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls\") pod \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\" (UID: \"a6341bd8-c5b4-4e58-a1e2-227919c4d2b7\") "
Jul 22 20:43:55.166332 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.166300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" (UID: "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:43:55.167902 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.167878    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" (UID: "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:43:55.167994 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.167981    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg" (OuterVolumeSpecName: "kube-api-access-fjmpg") pod "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" (UID: "a6341bd8-c5b4-4e58-a1e2-227919c4d2b7"). InnerVolumeSpecName "kube-api-access-fjmpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:43:55.266835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.266802    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:55.266835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.266832    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:55.266835 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:55.266843    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjmpg\" (UniqueName: \"kubernetes.io/projected/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7-kube-api-access-fjmpg\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:43:56.071311 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:56.071274    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"
Jul 22 20:43:56.092159 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:56.092108    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:43:56.095673 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:56.095648    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3d31-77974b7675-gfk4k"]
Jul 22 20:43:56.778642 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:56.778606    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" path="/var/lib/kubelet/pods/a6341bd8-c5b4-4e58-a1e2-227919c4d2b7/volumes"
Jul 22 20:43:59.262373 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:59.262327    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"]
Jul 22 20:43:59.264930 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:43:59.264091    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-3f3d31-pcbgt"]
Jul 22 20:44:00.779294 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:00.779258    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e860618-7e56-41ba-8c91-4503603a3c7c" path="/var/lib/kubelet/pods/4e860618-7e56-41ba-8c91-4503603a3c7c/volumes"
Jul 22 20:44:10.029829 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.029797    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:44:10.030228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030196    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" containerName="maas-api"
Jul 22 20:44:10.030228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030208    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" containerName="maas-api"
Jul 22 20:44:10.030228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030229    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e860618-7e56-41ba-8c91-4503603a3c7c" containerName="revoke-keys"
Jul 22 20:44:10.030342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030235    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e860618-7e56-41ba-8c91-4503603a3c7c" containerName="revoke-keys"
Jul 22 20:44:10.030342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030291    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6341bd8-c5b4-4e58-a1e2-227919c4d2b7" containerName="maas-api"
Jul 22 20:44:10.030342 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.030301    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e860618-7e56-41ba-8c91-4503603a3c7c" containerName="revoke-keys"
Jul 22 20:44:10.033498 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.033482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.035821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.035802    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 20:44:10.036010 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.035994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b0cd1b-serving-cert\""
Jul 22 20:44:10.036653 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.036634    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 20:44:10.036750 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.036712    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mw4f6\""
Jul 22 20:44:10.041851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.041789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:44:10.099926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.099882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtfw\" (UniqueName: \"kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.100113 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.099949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.100113 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.100006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.201506 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.201465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtfw\" (UniqueName: \"kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.201682 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.201522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.201682 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.201567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.201764 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:44:10.201695    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-serving-cert: secret "maas-api-e2e-shared-a-b0cd1b-serving-cert" not found
Jul 22 20:44:10.201800 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:44:10.201774    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls podName:766bc6d3-b789-44d7-a251-2a34375b3e65 nodeName:}" failed. No retries permitted until 2026-07-22 20:44:10.7017573 +0000 UTC m=+2544.432449166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls") pod "maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" (UID: "766bc6d3-b789-44d7-a251-2a34375b3e65") : secret "maas-api-e2e-shared-a-b0cd1b-serving-cert" not found
Jul 22 20:44:10.202193 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.202176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.209363 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.209332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtfw\" (UniqueName: \"kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.706795 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.706738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.709197 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.709176    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") pod \"maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:10.945279 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:10.945239    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:11.083905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:11.083876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:44:11.086239 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:44:11.086207    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod766bc6d3_b789_44d7_a251_2a34375b3e65.slice/crio-0508dd2c6e868c1f81eb0edc34056d0b536dbe8ca65b315a3a475f0bac7ce4ad WatchSource:0}: Error finding container 0508dd2c6e868c1f81eb0edc34056d0b536dbe8ca65b315a3a475f0bac7ce4ad: Status 404 returned error can't find the container with id 0508dd2c6e868c1f81eb0edc34056d0b536dbe8ca65b315a3a475f0bac7ce4ad
Jul 22 20:44:11.152388 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:11.152347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" event={"ID":"766bc6d3-b789-44d7-a251-2a34375b3e65","Type":"ContainerStarted","Data":"0508dd2c6e868c1f81eb0edc34056d0b536dbe8ca65b315a3a475f0bac7ce4ad"}
Jul 22 20:44:12.159297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:12.159251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" event={"ID":"766bc6d3-b789-44d7-a251-2a34375b3e65","Type":"ContainerStarted","Data":"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"}
Jul 22 20:44:12.159713 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:12.159329    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:12.175716 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:12.175667    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" podStartSLOduration=1.7702109579999998 podStartE2EDuration="2.175650934s" totalImagesPullingTime="405.439976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:44:12.175388134 +0000 UTC m=+2545.906080016" watchObservedRunningTime="2026-07-22 20:44:12.175650934 +0000 UTC m=+2545.906342820"
Jul 22 20:44:18.133629 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.133586    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:44:18.138794 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.138770    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.140947 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.140922    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-198019-serving-cert\""
Jul 22 20:44:18.145891 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.145860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:44:18.169512 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.169484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:44:18.278080 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.278037    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.278280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.278098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88t8v\" (UniqueName: \"kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.278280 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.278202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.378692 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.378650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.378899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.378741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.378899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.378773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88t8v\" (UniqueName: \"kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.379362 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.379339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.381375 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.381356    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.387545 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.387475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88t8v\" (UniqueName: \"kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v\") pod \"maas-api-e2e-shared-b-198019-596db4785b-v2cl8\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.451459 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.451428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:18.592851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:18.592823    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:44:18.595648 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:44:18.595617    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56977111_bd3f_4641_835a_17594a2917b4.slice/crio-a237fb716c027aeeae9f8518bf6212b32f2560992278c49b3844825103889b8e WatchSource:0}: Error finding container a237fb716c027aeeae9f8518bf6212b32f2560992278c49b3844825103889b8e: Status 404 returned error can't find the container with id a237fb716c027aeeae9f8518bf6212b32f2560992278c49b3844825103889b8e
Jul 22 20:44:19.193430 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:19.193391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" event={"ID":"56977111-bd3f-4641-835a-17594a2917b4","Type":"ContainerStarted","Data":"4c98ea3fc5ff6970d6fd3214148156fe879e1ed0d914034ea69a39f6211b4151"}
Jul 22 20:44:19.193833 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:19.193448    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" event={"ID":"56977111-bd3f-4641-835a-17594a2917b4","Type":"ContainerStarted","Data":"a237fb716c027aeeae9f8518bf6212b32f2560992278c49b3844825103889b8e"}
Jul 22 20:44:19.193833 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:19.193470    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:19.226230 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:19.226106    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" podStartSLOduration=0.865179016 podStartE2EDuration="1.226090044s" totalImagesPullingTime="360.911028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:44:19.225273331 +0000 UTC m=+2552.955965220" watchObservedRunningTime="2026-07-22 20:44:19.226090044 +0000 UTC m=+2552.956781930"
Jul 22 20:44:25.204876 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:25.204845    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:44:32.318260 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.318222    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:44:32.321800 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.321779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.324176 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.324136    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b0cd1b\"/\"openshift-service-ca.crt\""
Jul 22 20:44:32.324912 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.324884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-b0cd1b\"/\"kube-root-ca.crt\""
Jul 22 20:44:32.324993 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.324888    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b0cd1b\"/\"default-dockercfg-9m5bv\""
Jul 22 20:44:32.324993 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.324886    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b0cd1b\"/\"auth-test-model-b0cd1b-kserve-self-signed-certs\""
Jul 22 20:44:32.331804 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.331781    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:44:32.412708 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412674    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.412908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.412908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.412908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.412908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.412908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.412898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f64k\" (UniqueName: \"kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.513783 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.513783 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f64k\" (UniqueName: \"kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513881    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513928    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.513992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514405 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.514365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514405 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.514395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.514572 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.514457    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.516073 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.516053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.516583 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.516563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.521344 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.521322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f64k\" (UniqueName: \"kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k\") pod \"auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") " pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.633046 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.633007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:32.772079 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:32.772053    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:44:32.775184 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:44:32.775111    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac3b046e_f7f5_4413_9d35_62268662383f.slice/crio-66991ffe076d21d52476d53be9087dd921011a75556ad5cb025fdc2e73bc9d5b WatchSource:0}: Error finding container 66991ffe076d21d52476d53be9087dd921011a75556ad5cb025fdc2e73bc9d5b: Status 404 returned error can't find the container with id 66991ffe076d21d52476d53be9087dd921011a75556ad5cb025fdc2e73bc9d5b
Jul 22 20:44:33.268669 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:33.268620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" event={"ID":"ac3b046e-f7f5-4413-9d35-62268662383f","Type":"ContainerStarted","Data":"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"}
Jul 22 20:44:33.268669 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:33.268672    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" event={"ID":"ac3b046e-f7f5-4413-9d35-62268662383f","Type":"ContainerStarted","Data":"66991ffe076d21d52476d53be9087dd921011a75556ad5cb025fdc2e73bc9d5b"}
Jul 22 20:44:33.285823 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:33.285761    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" podStartSLOduration=1.285743903 podStartE2EDuration="1.285743903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:44:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:44:33.284215919 +0000 UTC m=+2567.014907807" watchObservedRunningTime="2026-07-22 20:44:33.285743903 +0000 UTC m=+2567.016435789"
Jul 22 20:44:42.633291 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:42.633256    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:42.633744 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:42.633476    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:42.645874 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:42.645852    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:44:43.328703 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:44:43.328665    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:45:00.135257 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.135222    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"]
Jul 22 20:45:00.139097 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.139072    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"]
Jul 22 20:45:00.139272 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.139208    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"
Jul 22 20:45:00.141539 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.141517    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hjqt7\""
Jul 22 20:45:00.142316 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.142297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"
Jul 22 20:45:00.148390 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.148131    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"]
Jul 22 20:45:00.150920 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.150894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"]
Jul 22 20:45:00.154566 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.153762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"
Jul 22 20:45:00.165712 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.165693    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"
Jul 22 20:45:00.310847 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.310770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"]
Jul 22 20:45:00.314583 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:45:00.314542    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f95af3_8880_4217_99f9_8e73e96fe775.slice/crio-d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c WatchSource:0}: Error finding container d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c: Status 404 returned error can't find the container with id d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c
Jul 22 20:45:00.334972 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.334946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"]
Jul 22 20:45:00.337294 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:45:00.337270    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2129bdda_d86a_4ad1_b83b_f9d060377e04.slice/crio-5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f WatchSource:0}: Error finding container 5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f: Status 404 returned error can't find the container with id 5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f
Jul 22 20:45:00.396899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.396823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz" event={"ID":"2129bdda-d86a-4ad1-b83b-f9d060377e04","Type":"ContainerStarted","Data":"5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f"}
Jul 22 20:45:00.397929 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:00.397908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8" event={"ID":"c1f95af3-8880-4217-99f9-8e73e96fe775","Type":"ContainerStarted","Data":"d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c"}
Jul 22 20:45:01.404258 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:01.404220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz" event={"ID":"2129bdda-d86a-4ad1-b83b-f9d060377e04","Type":"ContainerStarted","Data":"987bda766249ae44d169953936b2683bc370af351f04e7bffd3ca4eec7540c4a"}
Jul 22 20:45:01.405793 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:01.405761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8" event={"ID":"c1f95af3-8880-4217-99f9-8e73e96fe775","Type":"ContainerStarted","Data":"222295e87be403be4dbd2849ac80334984a3970099af6fc9bab56a5365cd0f11"}
Jul 22 20:45:01.419405 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:01.419348    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz" podStartSLOduration=1.419331458 podStartE2EDuration="1.419331458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:45:01.417120938 +0000 UTC m=+2595.147812840" watchObservedRunningTime="2026-07-22 20:45:01.419331458 +0000 UTC m=+2595.150023383"
Jul 22 20:45:01.430782 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:01.430723    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8" podStartSLOduration=1.430703914 podStartE2EDuration="1.430703914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:45:01.429295987 +0000 UTC m=+2595.159987874" watchObservedRunningTime="2026-07-22 20:45:01.430703914 +0000 UTC m=+2595.161395802"
Jul 22 20:45:02.411923 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:02.411881    2582 generic.go:356] "Generic (PLEG): container finished" podID="c1f95af3-8880-4217-99f9-8e73e96fe775" containerID="222295e87be403be4dbd2849ac80334984a3970099af6fc9bab56a5365cd0f11" exitCode=0
Jul 22 20:45:02.412440 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:02.411926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8" event={"ID":"c1f95af3-8880-4217-99f9-8e73e96fe775","Type":"ContainerDied","Data":"222295e87be403be4dbd2849ac80334984a3970099af6fc9bab56a5365cd0f11"}
Jul 22 20:45:02.413662 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:02.413635    2582 generic.go:356] "Generic (PLEG): container finished" podID="2129bdda-d86a-4ad1-b83b-f9d060377e04" containerID="987bda766249ae44d169953936b2683bc370af351f04e7bffd3ca4eec7540c4a" exitCode=0
Jul 22 20:45:02.413777 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:02.413716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz" event={"ID":"2129bdda-d86a-4ad1-b83b-f9d060377e04","Type":"ContainerDied","Data":"987bda766249ae44d169953936b2683bc370af351f04e7bffd3ca4eec7540c4a"}
Jul 22 20:45:03.560348 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:03.560324    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"
Jul 22 20:45:03.563499 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:03.563482    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"
Jul 22 20:45:04.426080 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.426050    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"
Jul 22 20:45:04.426303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.426080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz" event={"ID":"2129bdda-d86a-4ad1-b83b-f9d060377e04","Type":"ContainerDied","Data":"5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f"}
Jul 22 20:45:04.426303 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.426125    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ab403371794587b54696b08557d8c1cf041fd312db82b657b6fc2c464e7522f"
Jul 22 20:45:04.427352 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.427335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8" event={"ID":"c1f95af3-8880-4217-99f9-8e73e96fe775","Type":"ContainerDied","Data":"d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c"}
Jul 22 20:45:04.427453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.427362    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745885-5lvg8"
Jul 22 20:45:04.427453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:45:04.427366    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d342aab96a4e451311421b83de9f64858017929f8ba32514c94cfa0ad95b6a3c"
Jul 22 20:46:46.866381 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:46:46.866340    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:46:46.872810 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:46:46.872789    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xncsx_b78bcc6a-a479-4eb3-af5a-6fe92426af2a/ovn-acl-logging/0.log"
Jul 22 20:46:56.431014 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:46:56.430978    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:47:08.921883 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.921847    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:47:08.922302 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922248    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2129bdda-d86a-4ad1-b83b-f9d060377e04" containerName="cleanup"
Jul 22 20:47:08.922302 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922259    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2129bdda-d86a-4ad1-b83b-f9d060377e04" containerName="cleanup"
Jul 22 20:47:08.922302 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922275    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f95af3-8880-4217-99f9-8e73e96fe775" containerName="cleanup"
Jul 22 20:47:08.922302 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922281    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f95af3-8880-4217-99f9-8e73e96fe775" containerName="cleanup"
Jul 22 20:47:08.922450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922345    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1f95af3-8880-4217-99f9-8e73e96fe775" containerName="cleanup"
Jul 22 20:47:08.922450 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.922357    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2129bdda-d86a-4ad1-b83b-f9d060377e04" containerName="cleanup"
Jul 22 20:47:08.925507 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.925491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:08.927809 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.927789    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-b0cd1b\"/\"sub-test-model-b0cd1b-kserve-self-signed-certs\""
Jul 22 20:47:08.934338 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:08.934314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:47:09.052435 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.052435 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.052646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.052646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.052646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.052646 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.052637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js8j8\" (UniqueName: \"kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153137 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js8j8\" (UniqueName: \"kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153489 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153665 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153633    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.153741 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.153713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.155623 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.155601    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.155808 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.155789    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.162380 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.162354    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js8j8\" (UniqueName: \"kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8\") pod \"sub-test-model-b0cd1b-kserve-868868944c-k65pk\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") " pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.235496 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.235402    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:09.369917 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:09.369892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:47:09.371910 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:47:09.371881    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf82af1b6_eb80_4be7_93f2_8dd819818b48.slice/crio-49319b1906594a31a5909cfb42343d03e99d6bb079a3a75cc076a9d477ab7148 WatchSource:0}: Error finding container 49319b1906594a31a5909cfb42343d03e99d6bb079a3a75cc076a9d477ab7148: Status 404 returned error can't find the container with id 49319b1906594a31a5909cfb42343d03e99d6bb079a3a75cc076a9d477ab7148
Jul 22 20:47:10.067750 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:10.067711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" event={"ID":"f82af1b6-eb80-4be7-93f2-8dd819818b48","Type":"ContainerStarted","Data":"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"}
Jul 22 20:47:10.067750 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:10.067754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" event={"ID":"f82af1b6-eb80-4be7-93f2-8dd819818b48","Type":"ContainerStarted","Data":"49319b1906594a31a5909cfb42343d03e99d6bb079a3a75cc076a9d477ab7148"}
Jul 22 20:47:10.086888 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:10.086836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" podStartSLOduration=2.086818044 podStartE2EDuration="2.086818044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:47:10.085849544 +0000 UTC m=+2723.816541432" watchObservedRunningTime="2026-07-22 20:47:10.086818044 +0000 UTC m=+2723.817509931"
Jul 22 20:47:11.450908 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.450869    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" podUID="ac3b046e-f7f5-4413-9d35-62268662383f" containerName="main" containerID="cri-o://ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3" gracePeriod=45
Jul 22 20:47:11.701584 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.701524    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:47:11.775613 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775578    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f64k\" (UniqueName: \"kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.775826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775649    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.775826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.775826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775732    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.775826 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775753    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.776031 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.775837    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home\") pod \"ac3b046e-f7f5-4413-9d35-62268662383f\" (UID: \"ac3b046e-f7f5-4413-9d35-62268662383f\") "
Jul 22 20:47:11.776080 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.776025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache" (OuterVolumeSpecName: "model-cache") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:47:11.776080 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.776037    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:47:11.776210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.776137    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-model-cache\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:11.776210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.776172    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-tmp-dir\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:11.776210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.776185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home" (OuterVolumeSpecName: "home") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:47:11.778005 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.777979    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm" (OuterVolumeSpecName: "dshm") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:47:11.778356 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.778335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:47:11.778356 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.778342    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k" (OuterVolumeSpecName: "kube-api-access-6f64k") pod "ac3b046e-f7f5-4413-9d35-62268662383f" (UID: "ac3b046e-f7f5-4413-9d35-62268662383f"). InnerVolumeSpecName "kube-api-access-6f64k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:47:11.877678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.877625    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac3b046e-f7f5-4413-9d35-62268662383f-tls-certs\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:11.877678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.877670    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-dshm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:11.877678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.877680    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac3b046e-f7f5-4413-9d35-62268662383f-home\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:11.877678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:11.877688    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f64k\" (UniqueName: \"kubernetes.io/projected/ac3b046e-f7f5-4413-9d35-62268662383f-kube-api-access-6f64k\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:47:12.078689 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.078603    2582 generic.go:356] "Generic (PLEG): container finished" podID="ac3b046e-f7f5-4413-9d35-62268662383f" containerID="ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3" exitCode=0
Jul 22 20:47:12.078689 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.078650    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"
Jul 22 20:47:12.078869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.078687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" event={"ID":"ac3b046e-f7f5-4413-9d35-62268662383f","Type":"ContainerDied","Data":"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"}
Jul 22 20:47:12.078869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.078734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv" event={"ID":"ac3b046e-f7f5-4413-9d35-62268662383f","Type":"ContainerDied","Data":"66991ffe076d21d52476d53be9087dd921011a75556ad5cb025fdc2e73bc9d5b"}
Jul 22 20:47:12.078869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.078757    2582 scope.go:117] "RemoveContainer" containerID="ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"
Jul 22 20:47:12.088264 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.088242    2582 scope.go:117] "RemoveContainer" containerID="ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"
Jul 22 20:47:12.088567 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:47:12.088548    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3\": container with ID starting with ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3 not found: ID does not exist" containerID="ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"
Jul 22 20:47:12.088617 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.088576    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3"} err="failed to get container status \"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3\": rpc error: code = NotFound desc = could not find container \"ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3\": container with ID starting with ed34c9748f56af082317e30ad98af633c9a40bac9adc1c74de3ebe6f5c5b51f3 not found: ID does not exist"
Jul 22 20:47:12.099297 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.099260    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:47:12.102534 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.102507    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/auth-test-model-b0cd1b-kserve-6484b59bb7-gm4lv"]
Jul 22 20:47:12.779281 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:12.779252    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3b046e-f7f5-4413-9d35-62268662383f" path="/var/lib/kubelet/pods/ac3b046e-f7f5-4413-9d35-62268662383f/volumes"
Jul 22 20:47:19.236590 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:19.236552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:19.237086 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:19.236607    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:19.249249 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:19.249215    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:47:20.133240 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:47:20.133208    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:48:21.837333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:21.835592    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:48:36.858885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:36.858825    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" podUID="f82af1b6-eb80-4be7-93f2-8dd819818b48" containerName="main" containerID="cri-o://c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6" gracePeriod=45
Jul 22 20:48:37.123524 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.123439    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:48:37.255702 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255670    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.255702 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255752    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255782    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255816    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js8j8\" (UniqueName: \"kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8\") pod \"f82af1b6-eb80-4be7-93f2-8dd819818b48\" (UID: \"f82af1b6-eb80-4be7-93f2-8dd819818b48\") "
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.255942    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache" (OuterVolumeSpecName: "model-cache") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:48:37.256019 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.256007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home" (OuterVolumeSpecName: "home") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:48:37.256383 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.256193    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-model-cache\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.256383 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.256213    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-home\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.256383 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.256309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:48:37.257973 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.257947    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm" (OuterVolumeSpecName: "dshm") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:48:37.258061 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.258029    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:48:37.258102 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.258070    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8" (OuterVolumeSpecName: "kube-api-access-js8j8") pod "f82af1b6-eb80-4be7-93f2-8dd819818b48" (UID: "f82af1b6-eb80-4be7-93f2-8dd819818b48"). InnerVolumeSpecName "kube-api-access-js8j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:48:37.357024 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.356976    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f82af1b6-eb80-4be7-93f2-8dd819818b48-tls-certs\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.357024 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.357015    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-dshm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.357024 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.357026    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f82af1b6-eb80-4be7-93f2-8dd819818b48-tmp-dir\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.357392 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.357037    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js8j8\" (UniqueName: \"kubernetes.io/projected/f82af1b6-eb80-4be7-93f2-8dd819818b48-kube-api-access-js8j8\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:48:37.507514 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.507424    2582 generic.go:356] "Generic (PLEG): container finished" podID="f82af1b6-eb80-4be7-93f2-8dd819818b48" containerID="c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6" exitCode=0
Jul 22 20:48:37.507514 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.507458    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" event={"ID":"f82af1b6-eb80-4be7-93f2-8dd819818b48","Type":"ContainerDied","Data":"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"}
Jul 22 20:48:37.507514 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.507468    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"
Jul 22 20:48:37.507514 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.507502    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk" event={"ID":"f82af1b6-eb80-4be7-93f2-8dd819818b48","Type":"ContainerDied","Data":"49319b1906594a31a5909cfb42343d03e99d6bb079a3a75cc076a9d477ab7148"}
Jul 22 20:48:37.507785 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.507523    2582 scope.go:117] "RemoveContainer" containerID="c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"
Jul 22 20:48:37.519657 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.519625    2582 scope.go:117] "RemoveContainer" containerID="c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"
Jul 22 20:48:37.520173 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:48:37.520117    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6\": container with ID starting with c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6 not found: ID does not exist" containerID="c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"
Jul 22 20:48:37.520281 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.520178    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6"} err="failed to get container status \"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6\": rpc error: code = NotFound desc = could not find container \"c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6\": container with ID starting with c5bc496397ba587fc19dc024f38f9354c3a6719cb87c5429720c06c33cefaed6 not found: ID does not exist"
Jul 22 20:48:37.529578 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.529552    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:48:37.534869 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:37.534846    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-b0cd1b/sub-test-model-b0cd1b-kserve-868868944c-k65pk"]
Jul 22 20:48:38.779493 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:38.779430    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82af1b6-eb80-4be7-93f2-8dd819818b48" path="/var/lib/kubelet/pods/f82af1b6-eb80-4be7-93f2-8dd819818b48/volumes"
Jul 22 20:48:46.976129 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:46.976097    2582 scope.go:117] "RemoveContainer" containerID="f3089935608e1447575dc2de7bf3422af5c3d4299c23a9b760fae9e5263680c0"
Jul 22 20:48:59.520918 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.520881    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521285    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82af1b6-eb80-4be7-93f2-8dd819818b48" containerName="main"
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82af1b6-eb80-4be7-93f2-8dd819818b48" containerName="main"
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521308    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3b046e-f7f5-4413-9d35-62268662383f" containerName="main"
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521314    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3b046e-f7f5-4413-9d35-62268662383f" containerName="main"
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521369    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3b046e-f7f5-4413-9d35-62268662383f" containerName="main"
Jul 22 20:48:59.523333 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.521382    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82af1b6-eb80-4be7-93f2-8dd819818b48" containerName="main"
Jul 22 20:48:59.524225 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.524210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.527031 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.527007    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-198019\"/\"openshift-service-ca.crt\""
Jul 22 20:48:59.527263 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.527248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-198019\"/\"kube-root-ca.crt\""
Jul 22 20:48:59.527913 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.527897    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-198019\"/\"default-dockercfg-fcqr6\""
Jul 22 20:48:59.528002 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.527950    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-198019\"/\"rate-test-model-198019-kserve-self-signed-certs\""
Jul 22 20:48:59.536410 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.536388    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:48:59.654440 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.654440 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x4j9\" (UniqueName: \"kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.654657 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.654657 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.654657 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.654657 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.654619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755155 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755340 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x4j9\" (UniqueName: \"kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755340 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755340 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755340 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755546 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755709 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755681    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755794 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.755857 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.755791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.757551 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.757526    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.757803 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.757787    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.763507 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.763487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x4j9\" (UniqueName: \"kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9\") pod \"rate-test-model-198019-kserve-766855bf67-kdckw\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") " pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.833881 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.833793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:48:59.969684 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:48:59.969655    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:48:59.972113 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:48:59.972072    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6f47921_3773_4370_9b05_ec894a247692.slice/crio-01a170acad38c5cbc831cc4e6b1e2002c2f819a8bfd39ba7c259ddb709fb0cc5 WatchSource:0}: Error finding container 01a170acad38c5cbc831cc4e6b1e2002c2f819a8bfd39ba7c259ddb709fb0cc5: Status 404 returned error can't find the container with id 01a170acad38c5cbc831cc4e6b1e2002c2f819a8bfd39ba7c259ddb709fb0cc5
Jul 22 20:49:00.623550 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:00.623510    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" event={"ID":"d6f47921-3773-4370-9b05-ec894a247692","Type":"ContainerStarted","Data":"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"}
Jul 22 20:49:00.623956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:00.623563    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" event={"ID":"d6f47921-3773-4370-9b05-ec894a247692","Type":"ContainerStarted","Data":"01a170acad38c5cbc831cc4e6b1e2002c2f819a8bfd39ba7c259ddb709fb0cc5"}
Jul 22 20:49:00.641817 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:00.641765    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" podStartSLOduration=1.641748099 podStartE2EDuration="1.641748099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:48:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:49:00.639955159 +0000 UTC m=+2834.370647047" watchObservedRunningTime="2026-07-22 20:49:00.641748099 +0000 UTC m=+2834.372440014"
Jul 22 20:49:09.833965 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:09.833922    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:49:09.834505 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:09.833983    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:49:09.846269 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:09.846247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:49:10.683938 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:10.683909    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:49:45.528420 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:45.528379    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:49:46.999401 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:46.999363    2582 scope.go:117] "RemoveContainer" containerID="f6fd1cb33dcc9c60ba68473acfd5bcccb4e1cf0fdad70da5841025fb82667ecf"
Jul 22 20:49:47.008055 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:49:47.008034    2582 scope.go:117] "RemoveContainer" containerID="77cc9935eb083e54d694ca59e7dd54e5b1ee3cad570f93deb492504d0aab1f8e"
Jul 22 20:50:00.551124 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.551052    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" podUID="d6f47921-3773-4370-9b05-ec894a247692" containerName="main" containerID="cri-o://33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2" gracePeriod=45
Jul 22 20:50:00.674032 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.673996    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" podUID="d6f47921-3773-4370-9b05-ec894a247692" containerName="main" probeResult="failure" output="Get \"https://10.134.0.53:8000/ready\": dial tcp 10.134.0.53:8000: connect: connection refused"
Jul 22 20:50:00.809528 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.809465    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:50:00.915956 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.915919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x4j9\" (UniqueName: \"kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.915971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916073    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916173 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache\") pod \"d6f47921-3773-4370-9b05-ec894a247692\" (UID: \"d6f47921-3773-4370-9b05-ec894a247692\") "
Jul 22 20:50:00.916582 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home" (OuterVolumeSpecName: "home") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:50:00.916709 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:50:00.916709 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.916662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:50:00.918659 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918591    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm" (OuterVolumeSpecName: "dshm") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 20:50:00.918850 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918816    2582 generic.go:356] "Generic (PLEG): container finished" podID="d6f47921-3773-4370-9b05-ec894a247692" containerID="33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2" exitCode=0
Jul 22 20:50:00.918850 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918841    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:50:00.918976 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918867    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"
Jul 22 20:50:00.918976 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" event={"ID":"d6f47921-3773-4370-9b05-ec894a247692","Type":"ContainerDied","Data":"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"}
Jul 22 20:50:00.918976 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918909    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9" (OuterVolumeSpecName: "kube-api-access-2x4j9") pod "d6f47921-3773-4370-9b05-ec894a247692" (UID: "d6f47921-3773-4370-9b05-ec894a247692"). InnerVolumeSpecName "kube-api-access-2x4j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:50:00.918976 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw" event={"ID":"d6f47921-3773-4370-9b05-ec894a247692","Type":"ContainerDied","Data":"01a170acad38c5cbc831cc4e6b1e2002c2f819a8bfd39ba7c259ddb709fb0cc5"}
Jul 22 20:50:00.919771 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.918945    2582 scope.go:117] "RemoveContainer" containerID="33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"
Jul 22 20:50:00.936937 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.936912    2582 scope.go:117] "RemoveContainer" containerID="33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"
Jul 22 20:50:00.937271 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:50:00.937253    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2\": container with ID starting with 33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2 not found: ID does not exist" containerID="33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"
Jul 22 20:50:00.937334 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.937282    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2"} err="failed to get container status \"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2\": rpc error: code = NotFound desc = could not find container \"33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2\": container with ID starting with 33b7698445e9460744a71adaf80da29b00c2104d335e1cb8e00136c1e12167a2 not found: ID does not exist"
Jul 22 20:50:00.949241 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.949209    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:50:00.955313 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:00.955287    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-198019/rate-test-model-198019-kserve-766855bf67-kdckw"]
Jul 22 20:50:01.017544 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017511    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-model-cache\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.017544 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017541    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x4j9\" (UniqueName: \"kubernetes.io/projected/d6f47921-3773-4370-9b05-ec894a247692-kube-api-access-2x4j9\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.017544 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017552    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-dshm\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.017781 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017563    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-tmp-dir\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.017781 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017572    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6f47921-3773-4370-9b05-ec894a247692-tls-certs\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.017781 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.017579    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6f47921-3773-4370-9b05-ec894a247692-home\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:01.897659 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.897622    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7838-139711889467264"]
Jul 22 20:50:01.898186 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.898166    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6f47921-3773-4370-9b05-ec894a247692" containerName="main"
Jul 22 20:50:01.898299 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.898189    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6f47921-3773-4370-9b05-ec894a247692" containerName="main"
Jul 22 20:50:01.898299 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.898277    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6f47921-3773-4370-9b05-ec894a247692" containerName="main"
Jul 22 20:50:01.902401 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.902366    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:01.904989 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.904970    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nd6mq\""
Jul 22 20:50:01.911937 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:01.911911    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-139711889467264"]
Jul 22 20:50:02.027125 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.027092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjmc\" (UniqueName: \"kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc\") pod \"test-curl-7838-139711889467264\" (UID: \"bdc58b71-2500-4759-bb7c-58fe12cf8165\") " pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:02.127725 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.127692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjmc\" (UniqueName: \"kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc\") pod \"test-curl-7838-139711889467264\" (UID: \"bdc58b71-2500-4759-bb7c-58fe12cf8165\") " pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:02.137868 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.137837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjmc\" (UniqueName: \"kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc\") pod \"test-curl-7838-139711889467264\" (UID: \"bdc58b71-2500-4759-bb7c-58fe12cf8165\") " pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:02.212962 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.212867    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:02.347619 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.347592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7838-139711889467264"]
Jul 22 20:50:02.349823 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:50:02.349795    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdc58b71_2500_4759_bb7c_58fe12cf8165.slice/crio-9ca1a1d7242d826b7dad18b107af33a070f5bae6e28f5c0cc8b36ee910c3be81 WatchSource:0}: Error finding container 9ca1a1d7242d826b7dad18b107af33a070f5bae6e28f5c0cc8b36ee910c3be81: Status 404 returned error can't find the container with id 9ca1a1d7242d826b7dad18b107af33a070f5bae6e28f5c0cc8b36ee910c3be81
Jul 22 20:50:02.351135 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.351115    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 20:50:02.781029 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.780993    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6f47921-3773-4370-9b05-ec894a247692" path="/var/lib/kubelet/pods/d6f47921-3773-4370-9b05-ec894a247692/volumes"
Jul 22 20:50:02.933969 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:02.933930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-139711889467264" event={"ID":"bdc58b71-2500-4759-bb7c-58fe12cf8165","Type":"ContainerStarted","Data":"9ca1a1d7242d826b7dad18b107af33a070f5bae6e28f5c0cc8b36ee910c3be81"}
Jul 22 20:50:03.939491 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:03.939451    2582 generic.go:356] "Generic (PLEG): container finished" podID="bdc58b71-2500-4759-bb7c-58fe12cf8165" containerID="83e1d3390ad34233e711fccf730ae23feddfc962e9a997bbf26fe16299957f75" exitCode=0
Jul 22 20:50:03.939924 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:03.939523    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7838-139711889467264" event={"ID":"bdc58b71-2500-4759-bb7c-58fe12cf8165","Type":"ContainerDied","Data":"83e1d3390ad34233e711fccf730ae23feddfc962e9a997bbf26fe16299957f75"}
Jul 22 20:50:05.077065 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.077041    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:05.114270 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.114221    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7838-139711889467264_bdc58b71-2500-4759-bb7c-58fe12cf8165/test-curl-7838-139711889467264/0.log"
Jul 22 20:50:05.138139 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.138104    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7838-139711889467264"]
Jul 22 20:50:05.141931 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.141900    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7838-139711889467264"]
Jul 22 20:50:05.153318 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.153298    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwjmc\" (UniqueName: \"kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc\") pod \"bdc58b71-2500-4759-bb7c-58fe12cf8165\" (UID: \"bdc58b71-2500-4759-bb7c-58fe12cf8165\") "
Jul 22 20:50:05.155407 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.155380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc" (OuterVolumeSpecName: "kube-api-access-wwjmc") pod "bdc58b71-2500-4759-bb7c-58fe12cf8165" (UID: "bdc58b71-2500-4759-bb7c-58fe12cf8165"). InnerVolumeSpecName "kube-api-access-wwjmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:50:05.254898 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.254814    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwjmc\" (UniqueName: \"kubernetes.io/projected/bdc58b71-2500-4759-bb7c-58fe12cf8165-kube-api-access-wwjmc\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:05.951200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.951174    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ca1a1d7242d826b7dad18b107af33a070f5bae6e28f5c0cc8b36ee910c3be81"
Jul 22 20:50:05.951200 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:05.951205    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:05.961309 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:50:05.961276    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-139711889467264\" is forbidden: User \"system:node:ip-10-0-133-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-202.ec2.internal' and this object" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:06.777921 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:50:06.777823    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7838-139711889467264\" is forbidden: User \"system:node:ip-10-0-133-202.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-202.ec2.internal' and this object" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" pod="opendatahub/test-curl-7838-139711889467264"
Jul 22 20:50:06.779742 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:06.779714    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" path="/var/lib/kubelet/pods/bdc58b71-2500-4759-bb7c-58fe12cf8165/volumes"
Jul 22 20:50:16.167935 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.167902    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:50:16.168420 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.168100    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" podUID="766bc6d3-b789-44d7-a251-2a34375b3e65" containerName="maas-api" containerID="cri-o://9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a" gracePeriod=30
Jul 22 20:50:16.196993 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.196961    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"]
Jul 22 20:50:16.204905 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.204873    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-b0cd1b-29745885-wn2vz"]
Jul 22 20:50:16.418749 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.418681    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:50:16.554587 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.554550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") pod \"766bc6d3-b789-44d7-a251-2a34375b3e65\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") "
Jul 22 20:50:16.554784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.554620    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca\") pod \"766bc6d3-b789-44d7-a251-2a34375b3e65\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") "
Jul 22 20:50:16.554784 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.554669    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxtfw\" (UniqueName: \"kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw\") pod \"766bc6d3-b789-44d7-a251-2a34375b3e65\" (UID: \"766bc6d3-b789-44d7-a251-2a34375b3e65\") "
Jul 22 20:50:16.554982 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.554957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "766bc6d3-b789-44d7-a251-2a34375b3e65" (UID: "766bc6d3-b789-44d7-a251-2a34375b3e65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:50:16.555049 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.555024    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/766bc6d3-b789-44d7-a251-2a34375b3e65-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:16.556746 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.556713    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "766bc6d3-b789-44d7-a251-2a34375b3e65" (UID: "766bc6d3-b789-44d7-a251-2a34375b3e65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:50:16.556841 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.556793    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw" (OuterVolumeSpecName: "kube-api-access-rxtfw") pod "766bc6d3-b789-44d7-a251-2a34375b3e65" (UID: "766bc6d3-b789-44d7-a251-2a34375b3e65"). InnerVolumeSpecName "kube-api-access-rxtfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:50:16.656053 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.656024    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxtfw\" (UniqueName: \"kubernetes.io/projected/766bc6d3-b789-44d7-a251-2a34375b3e65-kube-api-access-rxtfw\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:16.656053 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.656051    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/766bc6d3-b789-44d7-a251-2a34375b3e65-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:16.778940 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:16.778856    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2129bdda-d86a-4ad1-b83b-f9d060377e04" path="/var/lib/kubelet/pods/2129bdda-d86a-4ad1-b83b-f9d060377e04/volumes"
Jul 22 20:50:17.002941 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.002910    2582 generic.go:356] "Generic (PLEG): container finished" podID="766bc6d3-b789-44d7-a251-2a34375b3e65" containerID="9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a" exitCode=0
Jul 22 20:50:17.003101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.002954    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"
Jul 22 20:50:17.003101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.002985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" event={"ID":"766bc6d3-b789-44d7-a251-2a34375b3e65","Type":"ContainerDied","Data":"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"}
Jul 22 20:50:17.003101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.003033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs" event={"ID":"766bc6d3-b789-44d7-a251-2a34375b3e65","Type":"ContainerDied","Data":"0508dd2c6e868c1f81eb0edc34056d0b536dbe8ca65b315a3a475f0bac7ce4ad"}
Jul 22 20:50:17.003101 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.003055    2582 scope.go:117] "RemoveContainer" containerID="9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"
Jul 22 20:50:17.011453 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.011435    2582 scope.go:117] "RemoveContainer" containerID="9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"
Jul 22 20:50:17.011703 ip-10-0-133-202 kubenswrapper[2582]: E0722 20:50:17.011687    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a\": container with ID starting with 9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a not found: ID does not exist" containerID="9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"
Jul 22 20:50:17.011752 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.011712    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a"} err="failed to get container status \"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a\": rpc error: code = NotFound desc = could not find container \"9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a\": container with ID starting with 9af6f47ec776b5341fd6d01978d4c17ba5fecd3052cc3eeefe9919800209a72a not found: ID does not exist"
Jul 22 20:50:17.022516 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.022494    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:50:17.025541 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:17.025519    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b0cd1b-7c6478fdb5-vs7bs"]
Jul 22 20:50:18.778740 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:18.778708    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766bc6d3-b789-44d7-a251-2a34375b3e65" path="/var/lib/kubelet/pods/766bc6d3-b789-44d7-a251-2a34375b3e65/volumes"
Jul 22 20:50:27.286972 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.286932    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"]
Jul 22 20:50:27.287395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287335    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" containerName="test-curl-7838-139711889467264"
Jul 22 20:50:27.287395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287349    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" containerName="test-curl-7838-139711889467264"
Jul 22 20:50:27.287395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287359    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766bc6d3-b789-44d7-a251-2a34375b3e65" containerName="maas-api"
Jul 22 20:50:27.287395 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287365    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="766bc6d3-b789-44d7-a251-2a34375b3e65" containerName="maas-api"
Jul 22 20:50:27.287532 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287428    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="766bc6d3-b789-44d7-a251-2a34375b3e65" containerName="maas-api"
Jul 22 20:50:27.287532 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.287441    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc58b71-2500-4759-bb7c-58fe12cf8165" containerName="test-curl-7838-139711889467264"
Jul 22 20:50:27.290482 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.290464    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:27.293490 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.293468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hjqt7\""
Jul 22 20:50:27.299612 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.299589    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"]
Jul 22 20:50:27.455463 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.455429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-198019-v2lcv\" (UID: \"427fdbdc-6b21-4449-8fb1-ff59a1837d19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:27.556397 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.556304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-198019-v2lcv\" (UID: \"427fdbdc-6b21-4449-8fb1-ff59a1837d19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:27.556979 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.556955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-198019-v2lcv\" (UID: \"427fdbdc-6b21-4449-8fb1-ff59a1837d19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:27.600496 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.600462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:27.738678 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:27.738648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"]
Jul 22 20:50:27.741101 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:50:27.741076    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427fdbdc_6b21_4449_8fb1_ff59a1837d19.slice/crio-b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7 WatchSource:0}: Error finding container b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7: Status 404 returned error can't find the container with id b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7
Jul 22 20:50:28.058878 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:28.058837    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv" event={"ID":"427fdbdc-6b21-4449-8fb1-ff59a1837d19","Type":"ContainerStarted","Data":"a1b38f5644f440da1f852515d6e67951308c60b8079c88650605abf9c6631bd0"}
Jul 22 20:50:28.059043 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:28.058901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv" event={"ID":"427fdbdc-6b21-4449-8fb1-ff59a1837d19","Type":"ContainerStarted","Data":"b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7"}
Jul 22 20:50:28.077624 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:28.077571    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv" podStartSLOduration=1.077556212 podStartE2EDuration="1.077556212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 20:50:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:50:28.07579199 +0000 UTC m=+2921.806483877" watchObservedRunningTime="2026-07-22 20:50:28.077556212 +0000 UTC m=+2921.808248099"
Jul 22 20:50:29.064952 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:29.064915    2582 generic.go:356] "Generic (PLEG): container finished" podID="427fdbdc-6b21-4449-8fb1-ff59a1837d19" containerID="a1b38f5644f440da1f852515d6e67951308c60b8079c88650605abf9c6631bd0" exitCode=0
Jul 22 20:50:29.065463 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:29.065001    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv" event={"ID":"427fdbdc-6b21-4449-8fb1-ff59a1837d19","Type":"ContainerDied","Data":"a1b38f5644f440da1f852515d6e67951308c60b8079c88650605abf9c6631bd0"}
Jul 22 20:50:30.204974 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:30.204947    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:30.383642 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:30.383607    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca\") pod \"427fdbdc-6b21-4449-8fb1-ff59a1837d19\" (UID: \"427fdbdc-6b21-4449-8fb1-ff59a1837d19\") "
Jul 22 20:50:30.383955 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:30.383932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "427fdbdc-6b21-4449-8fb1-ff59a1837d19" (UID: "427fdbdc-6b21-4449-8fb1-ff59a1837d19"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:50:30.485243 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:30.485185    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427fdbdc-6b21-4449-8fb1-ff59a1837d19-maas-api-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:31.075446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:31.075360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv" event={"ID":"427fdbdc-6b21-4449-8fb1-ff59a1837d19","Type":"ContainerDied","Data":"b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7"}
Jul 22 20:50:31.075446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:31.075399    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"
Jul 22 20:50:31.075446 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:31.075410    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7efed5e713ada09cf8aec0ab840afc72f5537bfd48418be3b9caafb428701a7"
Jul 22 20:50:37.944998 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:37.944963    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:50:37.945464 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:37.945292    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" podUID="56977111-bd3f-4641-835a-17594a2917b4" containerName="maas-api" containerID="cri-o://4c98ea3fc5ff6970d6fd3214148156fe879e1ed0d914034ea69a39f6211b4151" gracePeriod=30
Jul 22 20:50:38.110618 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.110588    2582 generic.go:356] "Generic (PLEG): container finished" podID="56977111-bd3f-4641-835a-17594a2917b4" containerID="4c98ea3fc5ff6970d6fd3214148156fe879e1ed0d914034ea69a39f6211b4151" exitCode=0
Jul 22 20:50:38.110746 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.110696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" event={"ID":"56977111-bd3f-4641-835a-17594a2917b4","Type":"ContainerDied","Data":"4c98ea3fc5ff6970d6fd3214148156fe879e1ed0d914034ea69a39f6211b4151"}
Jul 22 20:50:38.186763 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.186738    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:50:38.251085 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.250997    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88t8v\" (UniqueName: \"kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v\") pod \"56977111-bd3f-4641-835a-17594a2917b4\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") "
Jul 22 20:50:38.251285 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.251090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls\") pod \"56977111-bd3f-4641-835a-17594a2917b4\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") "
Jul 22 20:50:38.251285 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.251138    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca\") pod \"56977111-bd3f-4641-835a-17594a2917b4\" (UID: \"56977111-bd3f-4641-835a-17594a2917b4\") "
Jul 22 20:50:38.251568 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.251542    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56977111-bd3f-4641-835a-17594a2917b4" (UID: "56977111-bd3f-4641-835a-17594a2917b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 20:50:38.253248 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.253222    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56977111-bd3f-4641-835a-17594a2917b4" (UID: "56977111-bd3f-4641-835a-17594a2917b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 20:50:38.253326 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.253222    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v" (OuterVolumeSpecName: "kube-api-access-88t8v") pod "56977111-bd3f-4641-835a-17594a2917b4" (UID: "56977111-bd3f-4641-835a-17594a2917b4"). InnerVolumeSpecName "kube-api-access-88t8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 20:50:38.352398 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.352361    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56977111-bd3f-4641-835a-17594a2917b4-openshift-service-ca\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:38.352398 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.352387    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88t8v\" (UniqueName: \"kubernetes.io/projected/56977111-bd3f-4641-835a-17594a2917b4-kube-api-access-88t8v\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:38.352398 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:38.352397    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56977111-bd3f-4641-835a-17594a2917b4-maas-api-tls\") on node \"ip-10-0-133-202.ec2.internal\" DevicePath \"\""
Jul 22 20:50:39.118267 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:39.118237    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"
Jul 22 20:50:39.118267 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:39.118252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8" event={"ID":"56977111-bd3f-4641-835a-17594a2917b4","Type":"ContainerDied","Data":"a237fb716c027aeeae9f8518bf6212b32f2560992278c49b3844825103889b8e"}
Jul 22 20:50:39.118814 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:39.118338    2582 scope.go:117] "RemoveContainer" containerID="4c98ea3fc5ff6970d6fd3214148156fe879e1ed0d914034ea69a39f6211b4151"
Jul 22 20:50:39.140119 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:39.140093    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:50:39.145006 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:39.144981    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-198019-596db4785b-v2cl8"]
Jul 22 20:50:40.779069 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:40.779038    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56977111-bd3f-4641-835a-17594a2917b4" path="/var/lib/kubelet/pods/56977111-bd3f-4641-835a-17594a2917b4/volumes"
Jul 22 20:50:42.364932 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:42.364898    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"]
Jul 22 20:50:42.369926 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:42.369896    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-198019-v2lcv"]
Jul 22 20:50:42.779001 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:42.778917    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427fdbdc-6b21-4449-8fb1-ff59a1837d19" path="/var/lib/kubelet/pods/427fdbdc-6b21-4449-8fb1-ff59a1837d19/volumes"
Jul 22 20:50:50.045647 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:50.045617    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-577dc5b845-q4xqg_3ee44b2e-b4f5-433e-8d48-5ac296ffd67e/authorino/0.log"
Jul 22 20:50:56.194599 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:56.194559    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fc56f4f-2x7kn_b5ff1f3a-ab8a-404a-b0ba-a57021f3f105/copy-manifests/0.log"
Jul 22 20:50:56.213963 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:56.213939    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fc56f4f-2x7kn_b5ff1f3a-ab8a-404a-b0ba-a57021f3f105/manager/0.log"
Jul 22 20:50:57.180689 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:57.180665    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745885-5lvg8_c1f95af3-8880-4217-99f9-8e73e96fe775/cleanup/0.log"
Jul 22 20:50:58.627191 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:58.627129    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-577dc5b845-q4xqg_3ee44b2e-b4f5-433e-8d48-5ac296ffd67e/authorino/0.log"
Jul 22 20:50:59.245471 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:50:59.245357    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vg2mx_18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df/manager/0.log"
Jul 22 20:51:00.066467 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:00.066440    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-787b995ffc-kz4js_9aa73c41-e757-49ca-b01a-f9cee2efd569/kube-auth-proxy/0.log"
Jul 22 20:51:00.668337 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:00.668308    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-989655d5b-scqxj_b5607c83-281c-494e-82b1-9aba3f0d7f5c/router/0.log"
Jul 22 20:51:01.359405 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:01.359373    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ft7kcc_3e283127-8193-42a3-a57d-6e951e58ebee/main/0.log"
Jul 22 20:51:01.602691 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:01.602653    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-p6nsm_4be67446-bd58-4346-a7f7-f3009c8329cf/main/0.log"
Jul 22 20:51:10.993220 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:10.993096    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vgksv_41063cd5-8b22-4be6-b670-294312e455e7/global-pull-secret-syncer/0.log"
Jul 22 20:51:11.136334 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:11.136301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nljlm_73220400-0041-4a54-8349-6446c7c9f2a5/konnectivity-agent/0.log"
Jul 22 20:51:11.163379 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:11.163347    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-202.ec2.internal_3a4dd5d87507128fa706ef61307a77d9/haproxy/0.log"
Jul 22 20:51:16.861040 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:16.861003    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-577dc5b845-q4xqg_3ee44b2e-b4f5-433e-8d48-5ac296ffd67e/authorino/0.log"
Jul 22 20:51:17.231593 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:17.231543    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vg2mx_18ba5f9d-da9b-4f3f-a526-7cfec2a0d7df/manager/0.log"
Jul 22 20:51:19.225701 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.225648    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-kb6zg_2ae99fb0-484c-4c13-bcd9-20e7546fe9e2/cluster-monitoring-operator/0.log"
Jul 22 20:51:19.339588 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.339556    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-5whwc_0e208914-ba9b-4ce1-a17c-a1546197b929/monitoring-plugin/0.log"
Jul 22 20:51:19.457862 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.457827    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htxkb_9d49684e-bb37-4da5-8dc8-5f82b5305617/node-exporter/0.log"
Jul 22 20:51:19.476206 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.476129    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htxkb_9d49684e-bb37-4da5-8dc8-5f82b5305617/kube-rbac-proxy/0.log"
Jul 22 20:51:19.495998 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.495974    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-htxkb_9d49684e-bb37-4da5-8dc8-5f82b5305617/init-textfile/0.log"
Jul 22 20:51:19.592979 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.592952    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-sz6jf_38e09e18-8f96-4f57-9e08-1a975c7b6dab/kube-rbac-proxy-main/0.log"
Jul 22 20:51:19.612030 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.611999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-sz6jf_38e09e18-8f96-4f57-9e08-1a975c7b6dab/kube-rbac-proxy-self/0.log"
Jul 22 20:51:19.631861 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.631829    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-sz6jf_38e09e18-8f96-4f57-9e08-1a975c7b6dab/openshift-state-metrics/0.log"
Jul 22 20:51:19.663400 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.663369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/prometheus/0.log"
Jul 22 20:51:19.682345 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.682309    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/config-reloader/0.log"
Jul 22 20:51:19.704737 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.704709    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/thanos-sidecar/0.log"
Jul 22 20:51:19.725653 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.725621    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/kube-rbac-proxy-web/0.log"
Jul 22 20:51:19.744790 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.744713    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/kube-rbac-proxy/0.log"
Jul 22 20:51:19.765414 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.765390    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/kube-rbac-proxy-thanos/0.log"
Jul 22 20:51:19.785854 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.785826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2fdfe3b1-226f-4cf2-8a4c-9346cda2cfe4/init-config-reloader/0.log"
Jul 22 20:51:19.815413 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.815385    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ksdc2_98a4f079-631a-4e81-9a87-9987a7d6dba3/prometheus-operator/0.log"
Jul 22 20:51:19.838690 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.838662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-ksdc2_98a4f079-631a-4e81-9a87-9987a7d6dba3/kube-rbac-proxy/0.log"
Jul 22 20:51:19.890816 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.890786    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55df64ff76-8dzlg_33cdaefb-86d4-4459-9fe2-2640a6b2d5f7/telemeter-client/0.log"
Jul 22 20:51:19.911406 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.911382    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55df64ff76-8dzlg_33cdaefb-86d4-4459-9fe2-2640a6b2d5f7/reload/0.log"
Jul 22 20:51:19.930360 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:19.930334    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55df64ff76-8dzlg_33cdaefb-86d4-4459-9fe2-2640a6b2d5f7/kube-rbac-proxy/0.log"
Jul 22 20:51:20.696005 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.695907    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"]
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696286    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56977111-bd3f-4641-835a-17594a2917b4" containerName="maas-api"
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696301    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="56977111-bd3f-4641-835a-17594a2917b4" containerName="maas-api"
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696321    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427fdbdc-6b21-4449-8fb1-ff59a1837d19" containerName="revoke-keys"
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696327    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="427fdbdc-6b21-4449-8fb1-ff59a1837d19" containerName="revoke-keys"
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696385    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="56977111-bd3f-4641-835a-17594a2917b4" containerName="maas-api"
Jul 22 20:51:20.696481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.696393    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="427fdbdc-6b21-4449-8fb1-ff59a1837d19" containerName="revoke-keys"
Jul 22 20:51:20.699785 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.699763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.702010 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.701986    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzwv7\"/\"kube-root-ca.crt\""
Jul 22 20:51:20.702121 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.702062    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzwv7\"/\"default-dockercfg-mc8gv\""
Jul 22 20:51:20.702761 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.702745    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzwv7\"/\"openshift-service-ca.crt\""
Jul 22 20:51:20.705618 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.705598    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"]
Jul 22 20:51:20.740644 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.740604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-podres\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.740644 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.740650    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-proc\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.740885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.740722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-lib-modules\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.740885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.740753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgnr9\" (UniqueName: \"kubernetes.io/projected/e25952ba-7150-4135-9b88-b4258f60b9ea-kube-api-access-fgnr9\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.740885 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.740861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-sys\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841558 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841524    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-sys\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841558 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-podres\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841583    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-proc\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-lib-modules\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgnr9\" (UniqueName: \"kubernetes.io/projected/e25952ba-7150-4135-9b88-b4258f60b9ea-kube-api-access-fgnr9\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841660    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-sys\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-proc\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841726    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-podres\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.841821 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.841783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e25952ba-7150-4135-9b88-b4258f60b9ea-lib-modules\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:20.848640 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:20.848621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgnr9\" (UniqueName: \"kubernetes.io/projected/e25952ba-7150-4135-9b88-b4258f60b9ea-kube-api-access-fgnr9\") pod \"perf-node-gather-daemonset-xnzbh\" (UID: \"e25952ba-7150-4135-9b88-b4258f60b9ea\") " pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:21.011222 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.011120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:21.139410 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.139376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"]
Jul 22 20:51:21.143036 ip-10-0-133-202 kubenswrapper[2582]: W0722 20:51:21.143006    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode25952ba_7150_4135_9b88_b4258f60b9ea.slice/crio-e60bb633a536a7005ad15dc354c6e979794cab5398119a6e0e74eb69838050c2 WatchSource:0}: Error finding container e60bb633a536a7005ad15dc354c6e979794cab5398119a6e0e74eb69838050c2: Status 404 returned error can't find the container with id e60bb633a536a7005ad15dc354c6e979794cab5398119a6e0e74eb69838050c2
Jul 22 20:51:21.319496 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.319406    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh" event={"ID":"e25952ba-7150-4135-9b88-b4258f60b9ea","Type":"ContainerStarted","Data":"a10176eb87472f0f7113b9b41b2e96999babac8dcfbe69bba27866b0b343a5a6"}
Jul 22 20:51:21.319496 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.319487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:21.319748 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.319505    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh" event={"ID":"e25952ba-7150-4135-9b88-b4258f60b9ea","Type":"ContainerStarted","Data":"e60bb633a536a7005ad15dc354c6e979794cab5398119a6e0e74eb69838050c2"}
Jul 22 20:51:21.334330 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:21.334267    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh" podStartSLOduration=1.334251784 podStartE2EDuration="1.334251784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 20:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 20:51:21.333566544 +0000 UTC m=+2975.064258430" watchObservedRunningTime="2026-07-22 20:51:21.334251784 +0000 UTC m=+2975.064943672"
Jul 22 20:51:23.834125 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:23.834094    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9nph_8c670e33-1ad4-4b20-9507-3a4e6b266fbc/dns/0.log"
Jul 22 20:51:23.855134 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:23.855106    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9nph_8c670e33-1ad4-4b20-9507-3a4e6b266fbc/kube-rbac-proxy/0.log"
Jul 22 20:51:23.948965 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:23.948934    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vzx2n_a98c3da3-aa1a-4139-84b1-88f9b1703936/dns-node-resolver/0.log"
Jul 22 20:51:24.579358 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:24.579324    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ch7l9_ed509c9f-d6a6-467a-b776-c8d1671f2415/node-ca/0.log"
Jul 22 20:51:25.806809 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:25.806782    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-787b995ffc-kz4js_9aa73c41-e757-49ca-b01a-f9cee2efd569/kube-auth-proxy/0.log"
Jul 22 20:51:26.045572 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:26.045541    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-989655d5b-scqxj_b5607c83-281c-494e-82b1-9aba3f0d7f5c/router/0.log"
Jul 22 20:51:26.767481 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:26.767450    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cc7zn_4ad83725-93b2-413a-92fc-5b33791f8396/serve-healthcheck-canary/0.log"
Jul 22 20:51:27.272180 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:27.272135    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g7tx_4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae/kube-rbac-proxy/0.log"
Jul 22 20:51:27.296697 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:27.296669    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g7tx_4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae/exporter/0.log"
Jul 22 20:51:27.322359 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:27.322333    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6g7tx_4cb230a0-b3a8-4218-bf5f-2648a9d8f7ae/extractor/0.log"
Jul 22 20:51:27.333428 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:27.333402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzwv7/perf-node-gather-daemonset-xnzbh"
Jul 22 20:51:30.347636 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:30.347607    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fc56f4f-2x7kn_b5ff1f3a-ab8a-404a-b0ba-a57021f3f105/manager/0.log"
Jul 22 20:51:30.363500 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:30.363473    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9fc56f4f-2x7kn_b5ff1f3a-ab8a-404a-b0ba-a57021f3f105/copy-manifests/0.log"
Jul 22 20:51:31.831987 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:31.831937    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-787b995ffc-kz4js_9aa73c41-e757-49ca-b01a-f9cee2efd569/kube-auth-proxy/0.log"
Jul 22 20:51:31.952100 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:31.952073    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76bfc99684-xpgwf_6ce611f0-f2ed-4783-896c-256dd8be3c4a/manager/0.log"
Jul 22 20:51:31.979454 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:31.979416    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rlhrq_3e1b7cf6-41eb-4620-9915-75438c36fcb2/openshift-lws-operator/0.log"
Jul 22 20:51:32.019270 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:32.019239    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-989655d5b-scqxj_b5607c83-281c-494e-82b1-9aba3f0d7f5c/router/0.log"
Jul 22 20:51:33.402171 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:33.402123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-787b995ffc-kz4js_9aa73c41-e757-49ca-b01a-f9cee2efd569/kube-auth-proxy/0.log"
Jul 22 20:51:33.571899 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:33.571870    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-989655d5b-scqxj_b5607c83-281c-494e-82b1-9aba3f0d7f5c/router/0.log"
Jul 22 20:51:37.248851 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:37.248816    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-n4njw_2c174d5e-eba2-421e-9065-3568b94f5de4/kube-storage-version-migrator-operator/0.log"
Jul 22 20:51:37.251864 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:37.251836    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-n4njw_2c174d5e-eba2-421e-9065-3568b94f5de4/kube-storage-version-migrator-operator/1.log"
Jul 22 20:51:38.374988 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.374949    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5j5cn_336b9427-e19b-4563-a77e-6d1e9f9dff13/kube-multus/0.log"
Jul 22 20:51:38.401181 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.400946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/kube-multus-additional-cni-plugins/0.log"
Jul 22 20:51:38.422642 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.422607    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/egress-router-binary-copy/0.log"
Jul 22 20:51:38.441735 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.441703    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/cni-plugins/0.log"
Jul 22 20:51:38.463210 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.463181    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/bond-cni-plugin/0.log"
Jul 22 20:51:38.482506 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.482473    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/routeoverride-cni/0.log"
Jul 22 20:51:38.501592 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.501560    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/whereabouts-cni-bincopy/0.log"
Jul 22 20:51:38.521584 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:38.521558    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7j5w7_8f22dc14-8fec-4714-ac30-36fe0a25077f/whereabouts-cni/0.log"
Jul 22 20:51:39.121228 ip-10-0-133-202 kubenswrapper[2582]: I0722 20:51:39.121179    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qqz6z_2daef6c5-3620-4336-8f5a-457787a6cf93/network-metrics-daemon/0.log"