Jul 18 01:50:45.255294 ip-10-0-133-234 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 01:50:45.632597 ip-10-0-133-234 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:50:45.632597 ip-10-0-133-234 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 01:50:45.632597 ip-10-0-133-234 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:50:45.632597 ip-10-0-133-234 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 01:50:45.632597 ip-10-0-133-234 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 01:50:45.633191 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.632646    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 01:50:45.636792 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636777    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.636792 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636791    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.636792 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636795    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636798    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636801    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636805    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636808    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636810    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636813    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636816    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636819    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636822    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636825    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636828    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636831    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636835    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636839    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636842    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636845    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636848    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636851    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636854    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.636883 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636857    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636859    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636862    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636865    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636867    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636870    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636872    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636875    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636877    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636880    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636883    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636886    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636889    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636891    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636902    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636905    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636908    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636910    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636913    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.637359 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636917    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636919    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636922    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636924    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636927    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636929    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636931    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636934    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636936    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636939    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636941    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636944    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636946    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636949    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636951    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636957    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636960    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636963    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.637810 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636967    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636970    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636973    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636976    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636979    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636982    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636985    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636988    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636991    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636994    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636996    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.636999    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637002    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637006    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637010    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637012    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637015    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637017    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637020    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637022    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.638331 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637025    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637027    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637030    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637032    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637035    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637038    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637040    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637057    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637060    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637063    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637066    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637069    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637071    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637074    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637077    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637079    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637082    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637084    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637087    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637753    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.638806 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637759    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637762    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637766    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637769    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637772    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637775    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637777    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637780    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637783    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637785    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637788    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637791    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637793    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637796    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637799    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637801    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637804    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637807    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637809    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637812    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.639288 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637816    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637819    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637822    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637825    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637827    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637830    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637832    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637835    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637839    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637843    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637855    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637858    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637861    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637864    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637866    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637869    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637873    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637877    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637880    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.639772 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637882    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637885    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637887    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637890    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637893    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637895    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637898    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637900    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637903    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637906    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637909    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637911    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637914    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637917    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637920    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637923    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637925    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637928    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637931    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.640236 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637933    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637936    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637938    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637941    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637943    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637946    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637949    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637952    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637955    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637957    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637960    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637962    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637965    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637967    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637970    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637972    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637975    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637977    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637980    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.640699 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637983    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637987    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637989    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637992    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637994    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.637997    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638000    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638002    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638005    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638007    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638010    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638012    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638015    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638019    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638022    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638026    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638029    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638032    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638035    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638037    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.641160 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638040    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638404    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638409    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638412    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638415    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638418    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638420    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638423    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638426    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638428    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638431    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638434    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638437    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638440    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638443    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638446    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638448    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638451    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638454    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.641641 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638457    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638460    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638463    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638465    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638468    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638471    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638473    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638476    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638478    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638481    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638483    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638486    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638489    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638491    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638494    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638496    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638499    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638501    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638504    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638507    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.642121 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638509    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638512    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638515    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638517    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638520    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638522    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638525    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638528    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638530    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638533    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638536    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638539    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638542    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638545    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638547    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638549    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638553    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638556    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638558    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.642594 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638561    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638564    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638567    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638570    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638572    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638575    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638577    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638580    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638583    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638585    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638587    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638590    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638592    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638595    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638598    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638600    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638603    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638605    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638608    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638610    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.643098 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638613    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638615    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638618    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638620    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638625    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638628    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638630    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638633    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638637    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638640    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638644    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638647    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638651    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638654    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638657    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638659    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638662    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638665    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638668    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.643577 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638670    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638673    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.638676    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638750    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638767    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638776    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638783    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638788    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638791    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638795    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638799    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638803    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638806    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638809    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638813    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638816    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638819    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638824    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638827    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638830    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638833    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638838    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638840    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638843    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 01:50:45.644037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638846    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638850    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638853    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638856    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638859    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638862    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638866    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638869    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638871    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638874    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638877    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638881    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638884    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638887    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638889    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638892    2563 flags.go:64] FLAG: --enable-server="true"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638896    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638900    2563 flags.go:64] FLAG: --event-burst="100"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638903    2563 flags.go:64] FLAG: --event-qps="50"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638908    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638911    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638914    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638918    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638920    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638923    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 01:50:45.644618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638927    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638930    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638933    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638936    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638939    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638942    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638944    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638947    2563 flags.go:64] FLAG: --feature-gates=""
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638951    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638954    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638957    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638960    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638963    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638966    2563 flags.go:64] FLAG: --help="false"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638969    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-234.ec2.internal"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638972    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638975    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638977    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638981    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638984    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638987    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638989    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638992    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 01:50:45.645341 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638995    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.638999    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639002    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639006    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639009    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639012    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639015    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639018    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639021    2563 flags.go:64] FLAG: --lock-file=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639025    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639028    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639031    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639036    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639039    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639055    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639058    2563 flags.go:64] FLAG: --logging-format="text"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639061    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639064    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639067    2563 flags.go:64] FLAG: --manifest-url=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639070    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639074    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639077    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639081    2563 flags.go:64] FLAG: --max-pods="110"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639084    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639087    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 01:50:45.645948 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639090    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639093    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639096    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639099    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639102    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639108    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639111    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639114    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639117    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639120    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639127    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639129    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639132    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639135    2563 flags.go:64] FLAG: --port="10250"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639138    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639141    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e062609f72a57d28"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639144    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639148    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639151    2563 flags.go:64] FLAG: --register-node="true"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639154    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639158    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639160    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639163    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639166    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639169    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 01:50:45.646639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639172    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639175    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639178    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639181    2563 flags.go:64] FLAG: --runonce="false"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639184    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639187    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639190    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639193    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639195    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639198    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639201    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639204    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639207    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639210    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639213    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639215    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639219    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639223    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639226    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639231    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639234    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639237    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639241    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639244    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639248    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 01:50:45.647263 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639251    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639254    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639257    2563 flags.go:64] FLAG: --v="2"
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639260    2563 flags.go:64] FLAG: --version="false"
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639264    2563 flags.go:64] FLAG: --vmodule=""
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639268    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.639271    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639378    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639381    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639384    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639387    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639390    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639393    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639395    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639398    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639401    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639403    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639406    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639408    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639411    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639413    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.647858 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639416    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639420    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639423    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639427    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639430    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639432    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639435    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639437    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639440    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639442    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639447    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639449    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639454    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639457    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639460    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639463    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639466    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639468    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639471    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.648386 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639473    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639476    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639478    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639481    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639483    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639486    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639489    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639491    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639494    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639496    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639498    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639501    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639504    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639506    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639509    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639511    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639515    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639518    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639521    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639523    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.648843 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639526    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639528    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639531    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639535    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639537    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639540    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639543    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639545    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639548    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639550    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639553    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639555    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639558    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639561    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639563    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639566    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639568    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639571    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639573    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639575    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639578    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.649635 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639580    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639583    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639585    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639588    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639590    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639592    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639595    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639600    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639602    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639605    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639608    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639610    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639613    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639616    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639621    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639623    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639627    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639631    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.650356 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639634    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639637    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639639    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639642    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639644    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639647    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.639649    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.640442    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.646744    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.646759    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.646772    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.646778    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646837    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646842    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646846    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.650795 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646849    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646853    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646856    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646858    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646861    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646864    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646867    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646869    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646872    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646874    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646877    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646880    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646883    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646885    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646890    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646896    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646900    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646905    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646907    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.651194 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646910    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646912    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646915    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646918    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646921    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646923    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646925    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646933    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646936    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646939    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646941    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646944    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646947    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646950    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646954    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646957    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646960    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646963    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646966    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.651657 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646969    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646974    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646978    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646982    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646986    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646989    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646991    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646994    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646996    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.646999    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647002    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647005    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647007    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647009    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647012    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647015    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647018    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647021    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647023    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647026    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.652206 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647028    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647033    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647036    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647039    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647057    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647062    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647066    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647069    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647072    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647074    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647077    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647080    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647082    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647085    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647088    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647090    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647093    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647096    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647098    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.652736 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647101    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647104    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647107    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647109    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647112    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647114    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647117    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647120    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647123    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647126    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647130    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647134    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647139    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647143    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647145    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647149    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647151    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647154    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.653207 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647156    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.647161    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647285    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647293    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647298    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647303    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647306    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647309    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647312    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647314    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647317    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647320    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647322    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647325    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647328    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 01:50:45.653650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647331    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647334    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647336    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647339    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647342    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647344    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647347    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647349    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647352    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647355    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647357    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647360    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647363    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647366    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647370    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647375    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647381    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647384    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647387    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 01:50:45.654021 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647390    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647392    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647395    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647397    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647400    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647402    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647405    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647407    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647410    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647412    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647415    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647417    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647421    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647425    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647428    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647431    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647434    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647437    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647439    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 01:50:45.654491 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647442    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647445    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647449    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647453    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647457    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647461    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647463    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647466    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647468    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647471    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647474    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647477    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647479    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647482    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647484    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647487    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647489    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647491    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647494    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647496    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 01:50:45.654960 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647499    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647501    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647504    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647506    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647509    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647511    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647514    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647517    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647520    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647522    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647527    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647531    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647535    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647539    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647542    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647544    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647547    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647549    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647552    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647555    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 01:50:45.655472 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647557    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647559    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647562    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647565    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647567    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647570    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647574    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:45.647577    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.647581    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.647674    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.651334    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.652678    2563 server.go:1019] "Starting client certificate rotation"
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.652777    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:50:45.656085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.652807    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 01:50:45.656530 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.654772    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:50:45.656530 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.655850    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 01:50:45.666716 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.666699    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 18 01:50:45.669885 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.669868    2563 log.go:25] "Validated CRI v1 image API"
Jul 18 01:50:45.670788 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.670776    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 01:50:45.675855 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.675838    2563 fs.go:135] Filesystem UUIDs: map[28d396f9-84ab-495a-badb-5478eed3f561:/dev/nvme0n1p4 3f88eeba-5d67-4ecf-a5be-f81730c57148:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 18 01:50:45.675901 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.675856    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 01:50:45.681499 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.681393    2563 manager.go:216] Machine: {Timestamp:2026-07-18 01:50:45.679953536 +0000 UTC m=+0.317206807 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089521 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2534a01cb53e8103d0d3b6634adfdf SystemUUID:ec2534a0-1cb5-3e81-03d0-d3b6634adfdf BootID:527d8434-9572-4b1b-8015-d7d5cfeee596 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5a:c0:e3:81:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5a:c0:e3:81:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:c7:ed:a6:c3:09 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 01:50:45.681499 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.681498    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 01:50:45.681601 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.681590    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 01:50:45.682456 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.682441    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:50:45.684299 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.684277    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 01:50:45.684425 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.684303    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 01:50:45.684987 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.684977    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 01:50:45.685024 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.684989    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 01:50:45.685024 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.684996    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:50:45.685646 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.685636    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 01:50:45.686896 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.686886    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 01:50:45.690007 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.689996    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:50:45.690129 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690119    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 01:50:45.690173 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690146    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 01:50:45.690173 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690156    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 01:50:45.690173 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690168    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 01:50:45.690282 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690177    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 18 01:50:45.690282 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690185    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 01:50:45.690506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690483    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:50:45.690506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.690526    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 01:50:45.693698 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.693657    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 01:50:45.695336 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.695320    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 01:50:45.695435 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.695350    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 01:50:45.696328 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696317    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696333    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696339    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696345    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696353    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696358    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 01:50:45.696366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696365    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 01:50:45.696529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696370    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 01:50:45.696529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696376    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 01:50:45.696529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696382    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 01:50:45.696529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696390    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 01:50:45.696529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.696395    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 01:50:45.697183 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.697174    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 01:50:45.697183 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.697183    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 01:50:45.700442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.700427    2563 server.go:1268] "Started kubelet"
Jul 18 01:50:45.700529 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.700515    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 01:50:45.700585 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.700550    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 01:50:45.700672 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.700650    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 01:50:45.700672 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.700638    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 01:50:45.700767 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.700700    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 01:50:45.700861 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.700838    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 01:50:45.701136 ip-10-0-133-234 systemd[1]: Started Kubernetes Kubelet.
Jul 18 01:50:45.702682 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.702667    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 01:50:45.702758 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.702747    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 01:50:45.704715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.704699    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwhmw"
Jul 18 01:50:45.705725 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.705705    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 01:50:45.706997 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.706160    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-234.ec2.internal.18c33f45a3b0b28a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-234.ec2.internal,UID:ip-10-0-133-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-234.ec2.internal,},FirstTimestamp:2026-07-18 01:50:45.700407946 +0000 UTC m=+0.337661216,LastTimestamp:2026-07-18 01:50:45.700407946 +0000 UTC m=+0.337661216,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-234.ec2.internal,}"
Jul 18 01:50:45.709313 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.709295    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 01:50:45.709313 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.709310    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 01:50:45.709774 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.709369    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:45.710160 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.709889    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 01:50:45.710160 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.709891    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 01:50:45.710160 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.709914    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 01:50:45.710160 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710067    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 01:50:45.710160 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710075    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 01:50:45.710418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710172    2563 factory.go:55] Registering systemd factory
Jul 18 01:50:45.710418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710188    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 18 01:50:45.710418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710205    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bwhmw"
Jul 18 01:50:45.710418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710405    2563 factory.go:153] Registering CRI-O factory
Jul 18 01:50:45.710418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710418    2563 factory.go:223] Registration of the crio container factory successfully
Jul 18 01:50:45.710647 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710475    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 01:50:45.710647 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710496    2563 factory.go:103] Registering Raw factory
Jul 18 01:50:45.710647 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710509    2563 manager.go:1196] Started watching for new ooms in manager
Jul 18 01:50:45.710922 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.710898    2563 manager.go:349] Starting recovery of all containers
Jul 18 01:50:45.713060 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.713025    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 01:50:45.713203 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.713143    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 01:50:45.721654 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.721633    2563 manager.go:354] Recovery completed
Jul 18 01:50:45.723970 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.723951    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 18 01:50:45.726777 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.726766    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.728563 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.728548    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.728625 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.728577    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.728625 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.728590    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.729084 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729065    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 01:50:45.729084 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729083    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 01:50:45.729198 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729097    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 01:50:45.729198 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729067    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.729757 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729740    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.729827 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729780    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.729827 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.729792    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.730241 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.730229    2563 policy_none.go:49] "None policy: Start"
Jul 18 01:50:45.730281 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.730246    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 01:50:45.730281 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.730255    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 01:50:45.731310 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.731296    2563 policy_none.go:47] "Start"
Jul 18 01:50:45.769585 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.769568    2563 manager.go:337] "Starting Device Plugin manager"
Jul 18 01:50:45.769678 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.769597    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 01:50:45.769678 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.769609    2563 server.go:87] "Starting device plugin registration server"
Jul 18 01:50:45.769834 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.769822    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 01:50:45.769874 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.769835    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 01:50:45.770148 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.769938    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 01:50:45.770148 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.770120    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 01:50:45.770148 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.770127    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 01:50:45.770459 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.770445    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 01:50:45.770503 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.770491    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:45.870444 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.870418    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.871534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.871164    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.871534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.871188    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.871534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.871198    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.871534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.871219    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-234.ec2.internal"
Jul 18 01:50:45.879765 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.879747    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-234.ec2.internal"
Jul 18 01:50:45.879819 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.879767    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-234.ec2.internal\": node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:45.883640 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.883561    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 01:50:45.884822 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.884805    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 01:50:45.884923 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.884841    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 01:50:45.884923 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.884859    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 01:50:45.884923 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.884890    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 01:50:45.886941 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.886921    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:50:45.895227 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.895207    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:45.985994 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.985968    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"]
Jul 18 01:50:45.986098 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.986037    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.986847 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.986831    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.986913 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.986863    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.986913 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.986878    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.988100 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988088    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.988250 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988234    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:45.988288 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988267    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.988770 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988756    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.988770 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988767    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.988867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988783    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.988867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988791    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.988867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988799    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.988867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.988805    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.989943 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.989929    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:45.989996 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.989956    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 01:50:45.990652 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.990638    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 01:50:45.990711 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.990661    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 01:50:45.990711 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:45.990676    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeHasSufficientPID"
Jul 18 01:50:45.995897 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:45.995881    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.011010 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.010990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.011086 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.011014    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.011086 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.011031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/219a4b19c1c000048ec0124b8e3868d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"219a4b19c1c000048ec0124b8e3868d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.016804 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.016788    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.021293 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.021277    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-234.ec2.internal\" not found" node="ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.096781 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.096764    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.111448 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.111532 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/219a4b19c1c000048ec0124b8e3868d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"219a4b19c1c000048ec0124b8e3868d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.111532 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.111620 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/219a4b19c1c000048ec0124b8e3868d9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-234.ec2.internal\" (UID: \"219a4b19c1c000048ec0124b8e3868d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.111620 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.111620 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.111531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4175e18ce38b81a29250118e4f221cfb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal\" (UID: \"4175e18ce38b81a29250118e4f221cfb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.197211 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.197154    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.303689 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.303662    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.320264 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.320250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.325168 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.325066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.406010 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.405981    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.506982 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.506931    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.614081 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:46.614043    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-234.ec2.internal\" not found"
Jul 18 01:50:46.652117 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.652094    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 01:50:46.652478 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.652224    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 01:50:46.708564 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.708540    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:50:46.710612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.710596    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 01:50:46.710688 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.710630    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.714197 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.714174    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 01:45:46 +0000 UTC" deadline="2027-12-14 02:00:00.184622082 +0000 UTC"
Jul 18 01:50:46.714253 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.714197    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12336h9m13.470428158s"
Jul 18 01:50:46.727780 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.727762    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 01:50:46.732717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.732699    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:50:46.734599 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.734585    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal"
Jul 18 01:50:46.752831 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.752814    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 01:50:46.778335 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.778286    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qgs2p"
Jul 18 01:50:46.787818 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.787789    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qgs2p"
Jul 18 01:50:46.886188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.886170    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:50:46.889229 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:46.889190    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"219a4b19c1c000048ec0124b8e3868d9","Type":"ContainerStarted","Data":"ed1d3447c0fbeeee20b79be7615ed82725ff4de0add22cbdff1d05de3e63f295"}
Jul 18 01:50:46.893171 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:46.893145    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4175e18ce38b81a29250118e4f221cfb.slice/crio-f59e6343f57b15be927dceb9f2b10c99164b0c98436444a501d654bbabfaf00f WatchSource:0}: Error finding container f59e6343f57b15be927dceb9f2b10c99164b0c98436444a501d654bbabfaf00f: Status 404 returned error can't find the container with id f59e6343f57b15be927dceb9f2b10c99164b0c98436444a501d654bbabfaf00f
Jul 18 01:50:47.272426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.272365    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:50:47.273314 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.273286    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:50:47.691113 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.691087    2563 apiserver.go:52] "Watching apiserver"
Jul 18 01:50:47.701639 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.701610    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 01:50:47.704824 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.704536    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-99hsc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal","openshift-network-operator/iptables-alerter-dlvxw","openshift-ovn-kubernetes/ovnkube-node-4bcr4","kube-system/global-pull-secret-syncer-gnklm","kube-system/konnectivity-agent-z7snt","openshift-dns/node-resolver-9z8jw","openshift-image-registry/node-ca-zj9bp","openshift-multus/multus-additional-cni-plugins-sqx9l","openshift-multus/multus-jqh26","openshift-multus/network-metrics-daemon-w74kq","openshift-network-diagnostics/network-check-target-fql9g","kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"]
Jul 18 01:50:47.707381 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.707349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.710099 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.710079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.710219 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.710141    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:47.710862 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.710839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6ttz\""
Jul 18 01:50:47.711199 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.711180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.711430 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.711413    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.712810 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.712584    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.715102 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.715081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 01:50:47.715212 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.715168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.715477 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.715436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.715723 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.715697    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.716011 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.715992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5z5hx\""
Jul 18 01:50:47.717818 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.717794    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.718133 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.718115    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.718230 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.718181    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:47.719244 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.719224    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 01:50:47.719573 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.719553    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 01:50:47.720883 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.720462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.721423 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.721190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4747d\""
Jul 18 01:50:47.721423 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.721205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 01:50:47.721423 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.721424    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 01:50:47.721653 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.721457    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.722976 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.722957    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 01:50:47.723168 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.723149    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 01:50:47.723277 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.723260    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g6b92\""
Jul 18 01:50:47.723669 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.723651    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.725902 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.725881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.726001 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.725962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 01:50:47.726236 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.726217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.726378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.726350    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 01:50:47.727445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqh2\" (UniqueName: \"kubernetes.io/projected/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-kube-api-access-grqh2\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727479    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lggf4\""
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnn4c\" (UniqueName: \"kubernetes.io/projected/0a8884b5-cceb-42fb-93e3-8746a84034f9-kube-api-access-pnn4c\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727430    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727523    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-hosts-file\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.727589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-tmp-dir\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.727918 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.727744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 01:50:47.729144 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.729125    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.729283 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.729265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.729487 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.729469    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.729954 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.729758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mnlgm\""
Jul 18 01:50:47.729954 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.729853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 01:50:47.732698 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.732445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.732698 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.732481    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zxfjb\""
Jul 18 01:50:47.732698 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.732527    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 01:50:47.732698 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.732544    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.733025 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.733007    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.735098 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.735078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 01:50:47.735756 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.735475    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.735756 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.735560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4k2cq\""
Jul 18 01:50:47.737892 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.737872    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:50:47.738866 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.738204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:47.738866 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.738405    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:47.739029 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.738951    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5lgtk\""
Jul 18 01:50:47.739123 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.739065    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 01:50:47.791027 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.790974    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:45:47 +0000 UTC" deadline="2028-02-10 06:32:48.820361153 +0000 UTC"
Jul 18 01:50:47.791027 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.791026    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13732h42m1.029340305s"
Jul 18 01:50:47.811726 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.811708    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 01:50:47.828473 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-host-slash\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.828584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g47q\" (UniqueName: \"kubernetes.io/projected/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-kube-api-access-7g47q\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.828584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-slash\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.828584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.828584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zfg\" (UniqueName: \"kubernetes.io/projected/bf5823b0-620e-4a4c-bfb1-29a0536fb329-kube-api-access-l9zfg\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-systemd\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-tmp\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-system-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cni-binary-copy\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-netd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-script-lib\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-tuned\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-dbus\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.828856 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828830    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-os-release\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-tmp-dir\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-host\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-systemd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.828978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-system-cni-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhmx\" (UniqueName: \"kubernetes.io/projected/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-kube-api-access-jmhmx\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829041    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-kubelet\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-multus-certs\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovn-node-metrics-cert\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-sys\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-socket-dir-parent\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-tmp-dir\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829261    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-netns\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829296 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.829288    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-bin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.829359    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:48.32933809 +0000 UTC m=+2.966591364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thmq2\" (UniqueName: \"kubernetes.io/projected/ef5d566a-41e7-4452-9d6a-0fcafe659b55-kube-api-access-thmq2\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-systemd-units\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829428    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-sys-fs\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-daemon-config\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-iptables-alerter-script\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-kubelet\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829527    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-netns\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-device-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-conf\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-lib-modules\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-host\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-multus\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.829937 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829681    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-etc-selinux\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-kubernetes\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-run\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829826    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-ovn\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-log-socket\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-socket-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.829969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cnibin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-node-log\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrx6x\" (UniqueName: \"kubernetes.io/projected/80441402-2b11-47d8-9c78-d8870340abc6-kube-api-access-vrx6x\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-var-lib-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495c6e74-84f3-425b-9be7-1de591e92ae9-agent-certs\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495c6e74-84f3-425b-9be7-1de591e92ae9-konnectivity-ca\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4cdr\" (UniqueName: \"kubernetes.io/projected/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kube-api-access-s4cdr\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.830603 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-kubelet-config\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-conf-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-etc-kubernetes\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-registration-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqh2\" (UniqueName: \"kubernetes.io/projected/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-kube-api-access-grqh2\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830599    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-k8s-cni-cncf-io\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830632    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysconfig\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-var-lib-kubelet\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnt76\" (UniqueName: \"kubernetes.io/projected/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-kube-api-access-qnt76\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-bin\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830779    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-config\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-modprobe-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.831363 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-hosts-file\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-os-release\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-hostroot\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830972    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-hosts-file\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.830983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-etc-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-env-overrides\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-cnibin\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnn4c\" (UniqueName: \"kubernetes.io/projected/0a8884b5-cceb-42fb-93e3-8746a84034f9-kube-api-access-pnn4c\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831087    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-serviceca\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831209    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.831906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.831244    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.839593 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.839567    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 01:50:47.843261 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.843240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnn4c\" (UniqueName: \"kubernetes.io/projected/0a8884b5-cceb-42fb-93e3-8746a84034f9-kube-api-access-pnn4c\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:47.843359 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.843263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqh2\" (UniqueName: \"kubernetes.io/projected/f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6-kube-api-access-grqh2\") pod \"node-resolver-9z8jw\" (UID: \"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6\") " pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:47.891305 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.891281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"4175e18ce38b81a29250118e4f221cfb","Type":"ContainerStarted","Data":"f59e6343f57b15be927dceb9f2b10c99164b0c98436444a501d654bbabfaf00f"}
Jul 18 01:50:47.931506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:47.931628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.931628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.931628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-host-slash\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.931628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g47q\" (UniqueName: \"kubernetes.io/projected/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-kube-api-access-7g47q\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.931628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kubelet-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-slash\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-slash\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931678    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-host-slash\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931730    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zfg\" (UniqueName: \"kubernetes.io/projected/bf5823b0-620e-4a4c-bfb1-29a0536fb329-kube-api-access-l9zfg\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-systemd\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-tmp\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-system-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cni-binary-copy\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-netd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.931938 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-netd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931935    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-system-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931878    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-script-lib\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.931989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-systemd\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-tuned\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-dbus\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-os-release\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932230    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-host\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-systemd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-system-cni-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhmx\" (UniqueName: \"kubernetes.io/projected/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-kube-api-access-jmhmx\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-kubelet\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-multus-certs\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovn-node-metrics-cert\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-sys\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-dbus\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-socket-dir-parent\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.932665 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-os-release\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-netns\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932521    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cni-binary-copy\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-bin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thmq2\" (UniqueName: \"kubernetes.io/projected/ef5d566a-41e7-4452-9d6a-0fcafe659b55-kube-api-access-thmq2\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-system-cni-dir\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932581    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-script-lib\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-systemd\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-systemd-units\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932637    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-sys-fs\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-netns\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-daemon-config\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-iptables-alerter-script\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932707    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-socket-dir-parent\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-kubelet\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-netns\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-kubelet\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-device-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.933697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932798    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-host\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-conf\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-bin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-lib-modules\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-sys\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-systemd-units\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-host\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-host\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932901    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-multus\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932933    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-var-lib-cni-multus\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-etc-selinux\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932989    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-lib-modules\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-kubernetes\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932940    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-conf\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-run\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.934715 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.932991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-run-netns\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-device-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-sys-fs\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-etc-selinux\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-kubelet\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933228    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-run\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933265    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-ovn\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-kubernetes\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-log-socket\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-socket-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-ovn\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cnibin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-daemon-config\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-node-log\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933390    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-multus-certs\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.933473    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:47.935725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrx6x\" (UniqueName: \"kubernetes.io/projected/80441402-2b11-47d8-9c78-d8870340abc6-kube-api-access-vrx6x\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-var-lib-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.933525    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:50:48.433506432 +0000 UTC m=+3.070759706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-var-lib-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495c6e74-84f3-425b-9be7-1de591e92ae9-agent-certs\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-node-log\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933611    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-iptables-alerter-script\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-cnibin\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-log-socket\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495c6e74-84f3-425b-9be7-1de591e92ae9-konnectivity-ca\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-socket-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933874    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4cdr\" (UniqueName: \"kubernetes.io/projected/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kube-api-access-s4cdr\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933899    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-binary-copy\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.933921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-kubelet-config\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934068    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-conf-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-etc-kubernetes\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.936612 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-conf-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-registration-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-etc-kubernetes\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-kubelet-config\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d69439a6-7fd1-4641-8f54-5628bd5ecf76-registration-dir\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934342    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-run-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysctl-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495c6e74-84f3-425b-9be7-1de591e92ae9-konnectivity-ca\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-k8s-cni-cncf-io\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysconfig\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-var-lib-kubelet\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnt76\" (UniqueName: \"kubernetes.io/projected/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-kube-api-access-qnt76\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-bin\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-host-run-k8s-cni-cncf-io\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-config\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.937317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934588    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-host-cni-bin\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-var-lib-kubelet\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934629    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-modprobe-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-sysconfig\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-modprobe-d\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-os-release\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-hostroot\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.934967    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-etc-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-env-overrides\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-cnibin\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-etc-tuned\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-serviceca\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935099    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-hostroot\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935105    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf5823b0-620e-4a4c-bfb1-29a0536fb329-etc-openvswitch\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-os-release\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.938378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935218    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef5d566a-41e7-4452-9d6a-0fcafe659b55-multus-cni-dir\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovnkube-config\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80441402-2b11-47d8-9c78-d8870340abc6-cnibin\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-serviceca\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935666    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf5823b0-620e-4a4c-bfb1-29a0536fb329-env-overrides\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.935765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80441402-2b11-47d8-9c78-d8870340abc6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.936049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-tmp\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.936333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495c6e74-84f3-425b-9be7-1de591e92ae9-agent-certs\") pod \"konnectivity-agent-z7snt\" (UID: \"495c6e74-84f3-425b-9be7-1de591e92ae9\") " pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.937324    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.937344    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.937359    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:47.937416    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:50:48.437399383 +0000 UTC m=+3.074652649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:47.939426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.937572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf5823b0-620e-4a4c-bfb1-29a0536fb329-ovn-node-metrics-cert\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.940534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.940508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zfg\" (UniqueName: \"kubernetes.io/projected/bf5823b0-620e-4a4c-bfb1-29a0536fb329-kube-api-access-l9zfg\") pod \"ovnkube-node-4bcr4\" (UID: \"bf5823b0-620e-4a4c-bfb1-29a0536fb329\") " pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:47.940718 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.940700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g47q\" (UniqueName: \"kubernetes.io/projected/f208c70b-32e3-44ac-b4f3-ee19ad8ab451-kube-api-access-7g47q\") pod \"iptables-alerter-dlvxw\" (UID: \"f208c70b-32e3-44ac-b4f3-ee19ad8ab451\") " pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:47.941608 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.941528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thmq2\" (UniqueName: \"kubernetes.io/projected/ef5d566a-41e7-4452-9d6a-0fcafe659b55-kube-api-access-thmq2\") pod \"multus-jqh26\" (UID: \"ef5d566a-41e7-4452-9d6a-0fcafe659b55\") " pod="openshift-multus/multus-jqh26"
Jul 18 01:50:47.941983 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.941928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhmx\" (UniqueName: \"kubernetes.io/projected/2283afa0-0e65-4b29-9d2c-3ac6a11c339e-kube-api-access-jmhmx\") pod \"node-ca-zj9bp\" (UID: \"2283afa0-0e65-4b29-9d2c-3ac6a11c339e\") " pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:47.942539 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.942516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrx6x\" (UniqueName: \"kubernetes.io/projected/80441402-2b11-47d8-9c78-d8870340abc6-kube-api-access-vrx6x\") pod \"multus-additional-cni-plugins-sqx9l\" (UID: \"80441402-2b11-47d8-9c78-d8870340abc6\") " pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:47.943380 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.943358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4cdr\" (UniqueName: \"kubernetes.io/projected/d69439a6-7fd1-4641-8f54-5628bd5ecf76-kube-api-access-s4cdr\") pod \"aws-ebs-csi-driver-node-drsk7\" (UID: \"d69439a6-7fd1-4641-8f54-5628bd5ecf76\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:47.943721 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.943702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnt76\" (UniqueName: \"kubernetes.io/projected/d32a92c7-fd5d-450a-b1ad-966f5e3142bb-kube-api-access-qnt76\") pod \"tuned-99hsc\" (UID: \"d32a92c7-fd5d-450a-b1ad-966f5e3142bb\") " pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:47.982900 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:47.982872    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 01:50:48.031420 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.031397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9z8jw"
Jul 18 01:50:48.044245 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.044227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dlvxw"
Jul 18 01:50:48.054085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.054066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:50:48.061043 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.061025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:50:48.070846 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.070825    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sqx9l"
Jul 18 01:50:48.078656 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.078636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7"
Jul 18 01:50:48.086513 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.086486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zj9bp"
Jul 18 01:50:48.093302 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.093282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jqh26"
Jul 18 01:50:48.100236 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.100207    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99hsc"
Jul 18 01:50:48.337445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.337351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:48.337628 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.337530    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:48.337628 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.337606    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.337586532 +0000 UTC m=+3.974839792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:48.438188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.438142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:48.438338 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438295    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:48.438338 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.438309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:48.438455 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438368    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.438347236 +0000 UTC m=+4.075600503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:48.438513 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438462    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:50:48.438513 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438483    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:50:48.438513 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438496    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:48.438675 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.438545    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:50:49.438529208 +0000 UTC m=+4.075782471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:48.791675 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.791601    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 01:45:47 +0000 UTC" deadline="2028-01-11 20:16:06.495611266 +0000 UTC"
Jul 18 01:50:48.791675 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.791668    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13026h25m17.703947981s"
Jul 18 01:50:48.845499 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.845467    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495c6e74_84f3_425b_9be7_1de591e92ae9.slice/crio-b67efcff011abc01941c722767147d0ed6459320313288787409bd479ba0e1a7 WatchSource:0}: Error finding container b67efcff011abc01941c722767147d0ed6459320313288787409bd479ba0e1a7: Status 404 returned error can't find the container with id b67efcff011abc01941c722767147d0ed6459320313288787409bd479ba0e1a7
Jul 18 01:50:48.851507 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.851485    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5d566a_41e7_4452_9d6a_0fcafe659b55.slice/crio-38c6f7779912d758cac097fe804a5481f8776ee319846626056376f99ab692a7 WatchSource:0}: Error finding container 38c6f7779912d758cac097fe804a5481f8776ee319846626056376f99ab692a7: Status 404 returned error can't find the container with id 38c6f7779912d758cac097fe804a5481f8776ee319846626056376f99ab692a7
Jul 18 01:50:48.852483 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.852455    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80441402_2b11_47d8_9c78_d8870340abc6.slice/crio-435ec30d56d9056a47839e038477a739a02add0daf373cdf98a622d0ecab18c7 WatchSource:0}: Error finding container 435ec30d56d9056a47839e038477a739a02add0daf373cdf98a622d0ecab18c7: Status 404 returned error can't find the container with id 435ec30d56d9056a47839e038477a739a02add0daf373cdf98a622d0ecab18c7
Jul 18 01:50:48.853867 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.853837    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2283afa0_0e65_4b29_9d2c_3ac6a11c339e.slice/crio-9aae7938c37f8a192534b0838d14b76f6d95f0e4359f5b7bcfc66b41b313dee6 WatchSource:0}: Error finding container 9aae7938c37f8a192534b0838d14b76f6d95f0e4359f5b7bcfc66b41b313dee6: Status 404 returned error can't find the container with id 9aae7938c37f8a192534b0838d14b76f6d95f0e4359f5b7bcfc66b41b313dee6
Jul 18 01:50:48.854237 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.854192    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28ea0dd_69b9_44f7_a9d4_6243b6dd08a6.slice/crio-0e56875dbdb8a0b2c9c9b04f3938d7f9b76a8764da501cf8a4af2e81152d991f WatchSource:0}: Error finding container 0e56875dbdb8a0b2c9c9b04f3938d7f9b76a8764da501cf8a4af2e81152d991f: Status 404 returned error can't find the container with id 0e56875dbdb8a0b2c9c9b04f3938d7f9b76a8764da501cf8a4af2e81152d991f
Jul 18 01:50:48.855292 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.854868    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf5823b0_620e_4a4c_bfb1_29a0536fb329.slice/crio-ddb5bf49d520f5cfb8b7171517437f283df582311a2f29f292956f17c94ffd3d WatchSource:0}: Error finding container ddb5bf49d520f5cfb8b7171517437f283df582311a2f29f292956f17c94ffd3d: Status 404 returned error can't find the container with id ddb5bf49d520f5cfb8b7171517437f283df582311a2f29f292956f17c94ffd3d
Jul 18 01:50:48.856247 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.856172    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32a92c7_fd5d_450a_b1ad_966f5e3142bb.slice/crio-35ce04086349477a961d0db2ca36a44c9fb7c6783fa5e62c4e3638e536b5504d WatchSource:0}: Error finding container 35ce04086349477a961d0db2ca36a44c9fb7c6783fa5e62c4e3638e536b5504d: Status 404 returned error can't find the container with id 35ce04086349477a961d0db2ca36a44c9fb7c6783fa5e62c4e3638e536b5504d
Jul 18 01:50:48.858630 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.858156    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf208c70b_32e3_44ac_b4f3_ee19ad8ab451.slice/crio-7a0e2c1e96df3f26090815e8557dc0a71ae94daac04ee12675af0df22b75d1e0 WatchSource:0}: Error finding container 7a0e2c1e96df3f26090815e8557dc0a71ae94daac04ee12675af0df22b75d1e0: Status 404 returned error can't find the container with id 7a0e2c1e96df3f26090815e8557dc0a71ae94daac04ee12675af0df22b75d1e0
Jul 18 01:50:48.880495 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:50:48.880468    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69439a6_7fd1_4641_8f54_5628bd5ecf76.slice/crio-1710acb6d524bb7d08cc8dba679eb057d33283f31ca93ba5e985d2d49402d1d1 WatchSource:0}: Error finding container 1710acb6d524bb7d08cc8dba679eb057d33283f31ca93ba5e985d2d49402d1d1: Status 404 returned error can't find the container with id 1710acb6d524bb7d08cc8dba679eb057d33283f31ca93ba5e985d2d49402d1d1
Jul 18 01:50:48.886146 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.886103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:48.886243 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:48.886210    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:48.894351 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.894326    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99hsc" event={"ID":"d32a92c7-fd5d-450a-b1ad-966f5e3142bb","Type":"ContainerStarted","Data":"35ce04086349477a961d0db2ca36a44c9fb7c6783fa5e62c4e3638e536b5504d"}
Jul 18 01:50:48.895501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.895480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"ddb5bf49d520f5cfb8b7171517437f283df582311a2f29f292956f17c94ffd3d"}
Jul 18 01:50:48.896923 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.896896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9z8jw" event={"ID":"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6","Type":"ContainerStarted","Data":"0e56875dbdb8a0b2c9c9b04f3938d7f9b76a8764da501cf8a4af2e81152d991f"}
Jul 18 01:50:48.898221 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.898196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerStarted","Data":"435ec30d56d9056a47839e038477a739a02add0daf373cdf98a622d0ecab18c7"}
Jul 18 01:50:48.899436 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.899325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z7snt" event={"ID":"495c6e74-84f3-425b-9be7-1de591e92ae9","Type":"ContainerStarted","Data":"b67efcff011abc01941c722767147d0ed6459320313288787409bd479ba0e1a7"}
Jul 18 01:50:48.900607 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.900569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7" event={"ID":"d69439a6-7fd1-4641-8f54-5628bd5ecf76","Type":"ContainerStarted","Data":"1710acb6d524bb7d08cc8dba679eb057d33283f31ca93ba5e985d2d49402d1d1"}
Jul 18 01:50:48.901714 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.901695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dlvxw" event={"ID":"f208c70b-32e3-44ac-b4f3-ee19ad8ab451","Type":"ContainerStarted","Data":"7a0e2c1e96df3f26090815e8557dc0a71ae94daac04ee12675af0df22b75d1e0"}
Jul 18 01:50:48.903527 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.903494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zj9bp" event={"ID":"2283afa0-0e65-4b29-9d2c-3ac6a11c339e","Type":"ContainerStarted","Data":"9aae7938c37f8a192534b0838d14b76f6d95f0e4359f5b7bcfc66b41b313dee6"}
Jul 18 01:50:48.904759 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:48.904723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jqh26" event={"ID":"ef5d566a-41e7-4452-9d6a-0fcafe659b55","Type":"ContainerStarted","Data":"38c6f7779912d758cac097fe804a5481f8776ee319846626056376f99ab692a7"}
Jul 18 01:50:49.346866 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.345909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:49.346866 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.346390    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:49.346866 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.346459    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:51.346437481 +0000 UTC m=+5.983690755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.447522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.447644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.447768    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.447829    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:50:51.447809431 +0000 UTC m=+6.085062696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.448249    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.448271    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.448285    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:49.448370 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.448336    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:50:51.448320541 +0000 UTC m=+6.085573803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:49.886815 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.886286    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:49.886815 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.886417    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:49.886815 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.886437    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:49.886815 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:49.886561    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:49.915142 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.915092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" event={"ID":"219a4b19c1c000048ec0124b8e3868d9","Type":"ContainerStarted","Data":"b6a8d0e8de74940be12944e0176f0e770fe86f7d3a00b6c04e6c40398d1e1bb2"}
Jul 18 01:50:49.927860 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.927336    2563 generic.go:356] "Generic (PLEG): container finished" podID="4175e18ce38b81a29250118e4f221cfb" containerID="05ae291683639d3bd207a0291a1c3999180218dfce52478d0e5cca6d8c9db0ea" exitCode=0
Jul 18 01:50:49.927860 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.927372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"4175e18ce38b81a29250118e4f221cfb","Type":"ContainerDied","Data":"05ae291683639d3bd207a0291a1c3999180218dfce52478d0e5cca6d8c9db0ea"}
Jul 18 01:50:49.944633 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:49.944580    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-234.ec2.internal" podStartSLOduration=2.9445603350000003 podStartE2EDuration="2.944560335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:49.930569794 +0000 UTC m=+4.567823081" watchObservedRunningTime="2026-07-18 01:50:49.944560335 +0000 UTC m=+4.581813619"
Jul 18 01:50:50.886180 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:50.886144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:50.886389 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:50.886313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:50.953322 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:50.953187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" event={"ID":"4175e18ce38b81a29250118e4f221cfb","Type":"ContainerStarted","Data":"4756e4d58a132b7314bae7f50a620993632887c471a60bc065ff39eb0491f926"}
Jul 18 01:50:51.367249 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:51.367156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:51.367435 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.367351    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:51.367435 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.367424    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:50:55.367399946 +0000 UTC m=+10.004653213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:51.468209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:51.468276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468443    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468463    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468477    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468541    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:50:55.468521657 +0000 UTC m=+10.105774920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468560    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:51.468902 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.468643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:50:55.468608275 +0000 UTC m=+10.105861577 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:51.888268 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:51.888177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:51.888268 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:51.888209    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:51.888512 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.888315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:51.888512 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:51.888406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:52.885357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:52.885322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:52.885848 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:52.885481    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:53.885781 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:53.885654    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:53.886287 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:53.885789    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:53.886287 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:53.886203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:53.886415 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:53.886310    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:54.885396 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:54.885365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:54.885590 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:54.885495    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:55.409196 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:55.409158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:55.409662 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.409326    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:55.409662 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.409404    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:03.409382045 +0000 UTC m=+18.046635308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:55.510342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:55.510443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510584    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510610    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510637    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510645    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:51:03.510627654 +0000 UTC m=+18.147880926 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510651    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:55.510993 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.510707    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:51:03.510689994 +0000 UTC m=+18.147943255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:50:55.887537 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:55.886396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:55.887537 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.886505    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:55.887537 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:55.886859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:55.887537 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:55.886954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:56.885940 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:56.885907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:56.886392 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:56.886064    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:57.886148 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:57.886073    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:57.886676 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:57.886197    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:50:57.886676 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:57.886536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:57.886676 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:57.886627    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:58.885994 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:58.885959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:50:58.886201 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:58.886114    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:50:59.885877 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:59.885842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:50:59.886082 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:50:59.885842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:50:59.886082 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:59.885947    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:50:59.886082 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:50:59.886064    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:00.885258 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:00.885226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:00.885408 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:00.885344    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:01.886209 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:01.886172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:01.886631 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:01.886172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:01.886631 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:01.886315    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:01.886631 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:01.886360    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:02.885816 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:02.885785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:02.886090 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:02.885898    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:03.472969 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:03.472928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:03.473388 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.473100    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:51:03.473388 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.473172    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:19.473153993 +0000 UTC m=+34.110407256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:51:03.573979 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:03.573949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:03.574180 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:03.574000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:03.574180 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574103    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:51:03.574180 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574130    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:51:03.574180 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574150    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:51:03.574180 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574169    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:51:19.574153079 +0000 UTC m=+34.211406336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:51:03.574389 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574213    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:51:03.574389 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.574268    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:51:19.574252833 +0000 UTC m=+34.211506105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:51:03.885696 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:03.885619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:03.885873 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.885748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:03.885873 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:03.885829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:03.885992 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:03.885942    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:04.885081 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:04.885036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:04.885510 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:04.885189    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:05.889740 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:05.889710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:05.889740 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:05.889724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:05.890295 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:05.889809    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:05.890295 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:05.889883    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:06.885490 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:06.885458    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:06.885649 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:06.885595    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:07.887753 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:07.887726    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:07.888121 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:07.887821    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:07.888121 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:07.887889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:07.888121 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:07.887981    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:08.885255 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.885069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:08.885491 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:08.885350    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:08.991507 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.991431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jqh26" event={"ID":"ef5d566a-41e7-4452-9d6a-0fcafe659b55","Type":"ContainerStarted","Data":"d2b883b77f5e45e62016d0f648d592200eb4fd53b2443937e59ca453408cb348"}
Jul 18 01:51:08.993114 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.993082    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99hsc" event={"ID":"d32a92c7-fd5d-450a-b1ad-966f5e3142bb","Type":"ContainerStarted","Data":"d9a8b21c9e69edb5ee87903a2b9b9951d321d615259447657e46e6b624da7114"}
Jul 18 01:51:08.996334 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996307    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"47991ab23879943e90e27b622d2f759b9956fefaa93e5785f7f54e50472bcdf2"}
Jul 18 01:51:08.996474 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"bbed6b1b801463e06b66025acce4b047fd05f11d5a690a664a322720284dfc9b"}
Jul 18 01:51:08.996474 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"007fba72913adb32d4756056eea715023a2b4a2706b7d5fdda1ee4b055211c43"}
Jul 18 01:51:08.996474 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"6ff6f421fd545227208cd7fdd5924c8dcaaba8678acdbaff288145fa5a099192"}
Jul 18 01:51:08.996636 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"83a2bf02328b74ee9cddc1037aae9380e86d31b0cd5ec2d0fc77f1d9a16f7e73"}
Jul 18 01:51:08.996636 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.996585    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"fc40c1faeeabb62e9a7a771c3003b1d3ad5637950a64e1aab160b6643f3350cb"}
Jul 18 01:51:08.997908 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.997880    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9z8jw" event={"ID":"f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6","Type":"ContainerStarted","Data":"769c8e9efe907091c598ff9f48dad4682d40ba23fc49c537c6c488f58970c5d4"}
Jul 18 01:51:08.999548 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.999519    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="6b6adf2f35365e3583d615e12fa6466d728289a51da80b7ed47020db876ae33e" exitCode=0
Jul 18 01:51:08.999661 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:08.999598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"6b6adf2f35365e3583d615e12fa6466d728289a51da80b7ed47020db876ae33e"}
Jul 18 01:51:09.001256 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.001232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z7snt" event={"ID":"495c6e74-84f3-425b-9be7-1de591e92ae9","Type":"ContainerStarted","Data":"ba0f093e70b0406a3d7bce03803c934e8acd2ea83f088c52b15f8e2177a226a2"}
Jul 18 01:51:09.002839 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.002815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7" event={"ID":"d69439a6-7fd1-4641-8f54-5628bd5ecf76","Type":"ContainerStarted","Data":"087444b791bb2bdb8a43e38d364b13fed8d2368414dee87cc12b5c9896fe30da"}
Jul 18 01:51:09.004421 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.004397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zj9bp" event={"ID":"2283afa0-0e65-4b29-9d2c-3ac6a11c339e","Type":"ContainerStarted","Data":"d04c5f5a764bd4401efd2a7c28d9b6981df087ad15b9dd165df007c1584ccc85"}
Jul 18 01:51:09.008025 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.007989    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-234.ec2.internal" podStartSLOduration=22.007977973 podStartE2EDuration="22.007977973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:50:50.969322958 +0000 UTC m=+5.606576243" watchObservedRunningTime="2026-07-18 01:51:09.007977973 +0000 UTC m=+23.645231253"
Jul 18 01:51:09.027943 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.027893    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jqh26" podStartSLOduration=3.792160254 podStartE2EDuration="23.027879441s" totalImagesPullingTime="19.235719187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:09.007723192 +0000 UTC m=+23.644976474" watchObservedRunningTime="2026-07-18 01:51:09.027879441 +0000 UTC m=+23.665132721"
Jul 18 01:51:09.058371 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.058338    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zj9bp" podStartSLOduration=3.872941603 podStartE2EDuration="23.05832693s" totalImagesPullingTime="19.185385327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:09.043000486 +0000 UTC m=+23.680253766" watchObservedRunningTime="2026-07-18 01:51:09.05832693 +0000 UTC m=+23.695580209"
Jul 18 01:51:09.058765 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.058732    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-99hsc" podStartSLOduration=3.898708203 podStartE2EDuration="23.058722788s" totalImagesPullingTime="19.160014585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:09.057985974 +0000 UTC m=+23.695239255" watchObservedRunningTime="2026-07-18 01:51:09.058722788 +0000 UTC m=+23.695976071"
Jul 18 01:51:09.072792 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.072753    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z7snt" podStartSLOduration=3.883409414 podStartE2EDuration="23.072737713s" totalImagesPullingTime="19.189328299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:09.072439303 +0000 UTC m=+23.709692585" watchObservedRunningTime="2026-07-18 01:51:09.072737713 +0000 UTC m=+23.709990994"
Jul 18 01:51:09.086289 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.086236    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9z8jw" podStartSLOduration=3.892993986 podStartE2EDuration="23.086225788s" totalImagesPullingTime="19.193231802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:09.086030869 +0000 UTC m=+23.723284150" watchObservedRunningTime="2026-07-18 01:51:09.086225788 +0000 UTC m=+23.723479067"
Jul 18 01:51:09.486958 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.486935    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 01:51:09.784536 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.784339    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T01:51:09.486955345Z","UUID":"abb27c91-a180-45b5-87dc-10b31ab54b8e","Handler":null,"Name":"","Endpoint":""}
Jul 18 01:51:09.786059 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.786025    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 01:51:09.786169 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.786086    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 01:51:09.889575 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.889543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:09.889760 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:09.889659    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:09.890037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:09.890002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:09.890134 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:09.890119    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:10.008848 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:10.008801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7" event={"ID":"d69439a6-7fd1-4641-8f54-5628bd5ecf76","Type":"ContainerStarted","Data":"2c7751f122f6b0f09b771ee834c80b01b4f24812c96640c561306b3c5dfba73f"}
Jul 18 01:51:10.010680 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:10.010651    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dlvxw" event={"ID":"f208c70b-32e3-44ac-b4f3-ee19ad8ab451","Type":"ContainerStarted","Data":"9ac5201ec2f35296e429f71e761565da81e8d285c86decb05a583647569bbe80"}
Jul 18 01:51:10.025167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:10.025123    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dlvxw" podStartSLOduration=4.868999799 podStartE2EDuration="24.02510961s" totalImagesPullingTime="19.156109811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:10.024456869 +0000 UTC m=+24.661710150" watchObservedRunningTime="2026-07-18 01:51:10.02510961 +0000 UTC m=+24.662362890"
Jul 18 01:51:10.885789 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:10.885765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:10.885983 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:10.885873    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:11.017546 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:11.017511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"746a09e10916f37b479c5af5fca676fb966bd8ea5acdaf5c1b5caf381be92c00"}
Jul 18 01:51:11.020040 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:11.020010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7" event={"ID":"d69439a6-7fd1-4641-8f54-5628bd5ecf76","Type":"ContainerStarted","Data":"f5c543ac500bbe50292680d884f383b09e6ac1a756b0a0a57ce14e2ab33b0102"}
Jul 18 01:51:11.885480 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:11.885312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:11.885480 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:11.885430    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:11.885718 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:11.885505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:11.885718 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:11.885605    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:12.885262 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:12.885060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:12.885668 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:12.885360    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:13.536281 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:13.536093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:51:13.536563 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:13.536547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:51:13.554329 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:13.554290    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-drsk7" podStartSLOduration=6.347240033 podStartE2EDuration="27.554277555s" totalImagesPullingTime="21.207037522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:11.037695538 +0000 UTC m=+25.674948818" watchObservedRunningTime="2026-07-18 01:51:13.554277555 +0000 UTC m=+28.191530852"
Jul 18 01:51:13.885390 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:13.885370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:13.886034 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:13.885373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:13.886034 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:13.885472    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:13.886034 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:13.885524    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:14.031494 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.031470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" event={"ID":"bf5823b0-620e-4a4c-bfb1-29a0536fb329","Type":"ContainerStarted","Data":"6fc8558db1630ef1d8dc2a6fd3bb4df7ecfd336fb69c191ce411668865e2a8b4"}
Jul 18 01:51:14.031777 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.031757    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:14.031939 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.031907    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:14.032019 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.031991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:14.033306 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.033286    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="27eef508a339bcf96d026c35d8af2f69898bd6163f3a6564619433de6c680314" exitCode=0
Jul 18 01:51:14.033391 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.033364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"27eef508a339bcf96d026c35d8af2f69898bd6163f3a6564619433de6c680314"}
Jul 18 01:51:14.033506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.033489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:51:14.034498 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.034121    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z7snt"
Jul 18 01:51:14.047785 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.047763    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:14.047863 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.047847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:14.056389 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.056356    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4" podStartSLOduration=8.808924470000001 podStartE2EDuration="28.056344574s" totalImagesPullingTime="19.247420104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:14.054657924 +0000 UTC m=+28.691911201" watchObservedRunningTime="2026-07-18 01:51:14.056344574 +0000 UTC m=+28.693597850"
Jul 18 01:51:14.885702 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:14.885677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:14.886206 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:14.885810    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:15.002199 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.002172    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fql9g"]
Jul 18 01:51:15.002473 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.002456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:15.002627 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:15.002603    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:15.003244 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.003092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w74kq"]
Jul 18 01:51:15.004789 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.004765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnklm"]
Jul 18 01:51:15.004883 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.004857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:15.004978 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:15.004954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:15.035099 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:15.035081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:15.035325 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:15.035307    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:16.038648 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:16.038611    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="58ddb555dcb2c62f189e025c336303b545c34cf4f23d3edc7772895fd7c911b4" exitCode=0
Jul 18 01:51:16.039096 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:16.038680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"58ddb555dcb2c62f189e025c336303b545c34cf4f23d3edc7772895fd7c911b4"}
Jul 18 01:51:16.886063 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:16.886029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:16.886229 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:16.886029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:16.886229 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:16.886162    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:16.886229 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:16.886029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:16.886332 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:16.886235    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:16.886332 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:16.886313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:18.045367 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:18.045095    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="e466289e7de80717ec5488dc4c5e51645a28282702143aac9104b254077191a9" exitCode=0
Jul 18 01:51:18.045367 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:18.045175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"e466289e7de80717ec5488dc4c5e51645a28282702143aac9104b254077191a9"}
Jul 18 01:51:18.885535 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:18.885495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:18.885697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:18.885503    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:18.885697 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:18.885627    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnklm" podUID="8d5c6f0a-7d6e-4c68-86c6-2868bde955fb"
Jul 18 01:51:18.885697 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:18.885639    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:18.885820 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:18.885714    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fql9g" podUID="0d37cdbd-c70b-43f9-b81c-270bd38e701d"
Jul 18 01:51:18.885820 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:18.885793    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:51:19.494305 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:19.494273    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:19.494840 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.494383    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:51:19.494840 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.494454    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:51.494433707 +0000 UTC m=+66.131686966 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 01:51:19.594628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:19.594559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:19.594628 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:19.594615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:19.594803 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594714    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 01:51:19.594803 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594782    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret podName:8d5c6f0a-7d6e-4c68-86c6-2868bde955fb nodeName:}" failed. No retries permitted until 2026-07-18 01:51:51.594762935 +0000 UTC m=+66.232016194 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret") pod "global-pull-secret-syncer-gnklm" (UID: "8d5c6f0a-7d6e-4c68-86c6-2868bde955fb") : object "kube-system"/"original-pull-secret" not registered
Jul 18 01:51:19.594903 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594820    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 01:51:19.594903 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594836    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 01:51:19.594903 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594847    2563 projected.go:196] Error preparing data for projected volume kube-api-access-s78rv for pod openshift-network-diagnostics/network-check-target-fql9g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:51:19.594903 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:19.594888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv podName:0d37cdbd-c70b-43f9-b81c-270bd38e701d nodeName:}" failed. No retries permitted until 2026-07-18 01:51:51.594875892 +0000 UTC m=+66.232129166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s78rv" (UniqueName: "kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv") pod "network-check-target-fql9g" (UID: "0d37cdbd-c70b-43f9-b81c-270bd38e701d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 01:51:20.751244 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.751211    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-234.ec2.internal" event="NodeReady"
Jul 18 01:51:20.751716 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.751361    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 01:51:20.793460 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.793432    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wq949"]
Jul 18 01:51:20.795919 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.795898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:20.796654 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.796629    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gxfjn"]
Jul 18 01:51:20.798370 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.798351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:20.798607 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.798503    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 01:51:20.798919 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.798892    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 01:51:20.798995 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.798899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqc6n\""
Jul 18 01:51:20.800893 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.800873    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 01:51:20.801120 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.801103    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 01:51:20.801217 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.801137    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 01:51:20.801276 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.801141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bmfns\""
Jul 18 01:51:20.809131 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.809083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq949"]
Jul 18 01:51:20.811298 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.811254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxfjn"]
Jul 18 01:51:20.885322 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.885292    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:20.885477 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.885446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:20.885539 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.885481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:20.888325 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888291    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:51:20.888325 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888304    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:51:20.888562 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888538    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:51:20.888640 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888543    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jss5k\""
Jul 18 01:51:20.888750 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:51:20.888843 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.888825    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbznb\""
Jul 18 01:51:20.904336 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf729\" (UniqueName: \"kubernetes.io/projected/974d3e72-d838-42fa-9d70-893f456d3c63-kube-api-access-gf729\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:20.904442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqm2\" (UniqueName: \"kubernetes.io/projected/18c83878-29b0-415d-a0d7-2c8536025616-kube-api-access-kvqm2\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:20.904442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:20.904442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/974d3e72-d838-42fa-9d70-893f456d3c63-cert\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:20.904442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18c83878-29b0-415d-a0d7-2c8536025616-config-volume\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:20.904648 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:20.904465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18c83878-29b0-415d-a0d7-2c8536025616-tmp-dir\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005300 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18c83878-29b0-415d-a0d7-2c8536025616-tmp-dir\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005446 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf729\" (UniqueName: \"kubernetes.io/projected/974d3e72-d838-42fa-9d70-893f456d3c63-kube-api-access-gf729\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:21.005446 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqm2\" (UniqueName: \"kubernetes.io/projected/18c83878-29b0-415d-a0d7-2c8536025616-kube-api-access-kvqm2\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005446 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005610 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/974d3e72-d838-42fa-9d70-893f456d3c63-cert\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:21.005610 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18c83878-29b0-415d-a0d7-2c8536025616-config-volume\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005610 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:21.005580    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:21.005610 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18c83878-29b0-415d-a0d7-2c8536025616-tmp-dir\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.005785 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:21.005649    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:21.505626501 +0000 UTC m=+36.142879778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:21.006016 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.005992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/18c83878-29b0-415d-a0d7-2c8536025616-config-volume\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.010057 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.010020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/974d3e72-d838-42fa-9d70-893f456d3c63-cert\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:21.015507 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.015490    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqm2\" (UniqueName: \"kubernetes.io/projected/18c83878-29b0-415d-a0d7-2c8536025616-kube-api-access-kvqm2\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.015773 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.015748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf729\" (UniqueName: \"kubernetes.io/projected/974d3e72-d838-42fa-9d70-893f456d3c63-kube-api-access-gf729\") pod \"ingress-canary-gxfjn\" (UID: \"974d3e72-d838-42fa-9d70-893f456d3c63\") " pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:21.115400 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.115367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gxfjn"
Jul 18 01:51:21.509355 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:21.509270    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:21.509492 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:21.509427    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:21.509539 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:21.509496    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:22.509474331 +0000 UTC m=+37.146727588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:22.123392 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:22.123365    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gxfjn"]
Jul 18 01:51:22.126620 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:51:22.126596    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974d3e72_d838_42fa_9d70_893f456d3c63.slice/crio-cbe20a579d0d3a6e3fa36fde27fa13f2c2ce27ddf6134c2c1bd6c98301b14b38 WatchSource:0}: Error finding container cbe20a579d0d3a6e3fa36fde27fa13f2c2ce27ddf6134c2c1bd6c98301b14b38: Status 404 returned error can't find the container with id cbe20a579d0d3a6e3fa36fde27fa13f2c2ce27ddf6134c2c1bd6c98301b14b38
Jul 18 01:51:22.516765 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:22.516731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:22.516910 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:22.516889    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:22.516976 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:22.516965    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:24.516946078 +0000 UTC m=+39.154199353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:23.060762 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:23.060701    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="4e6a43176e5e938b7e6346d036eb774022538ab1250c8431d6bd1ae4756190b3" exitCode=0
Jul 18 01:51:23.060970 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:23.060781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"4e6a43176e5e938b7e6346d036eb774022538ab1250c8431d6bd1ae4756190b3"}
Jul 18 01:51:23.062176 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:23.062115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxfjn" event={"ID":"974d3e72-d838-42fa-9d70-893f456d3c63","Type":"ContainerStarted","Data":"cbe20a579d0d3a6e3fa36fde27fa13f2c2ce27ddf6134c2c1bd6c98301b14b38"}
Jul 18 01:51:24.067841 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:24.067808    2563 generic.go:356] "Generic (PLEG): container finished" podID="80441402-2b11-47d8-9c78-d8870340abc6" containerID="95125a6939d43be0e47095ca22a4a53e5dc3992bc97a2e6523a8770ed1434c46" exitCode=0
Jul 18 01:51:24.068229 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:24.067882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerDied","Data":"95125a6939d43be0e47095ca22a4a53e5dc3992bc97a2e6523a8770ed1434c46"}
Jul 18 01:51:24.530902 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:24.530740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:24.531085 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:24.530885    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:24.531085 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:24.530998    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:28.530984522 +0000 UTC m=+43.168237781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:25.073229 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:25.073194    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" event={"ID":"80441402-2b11-47d8-9c78-d8870340abc6","Type":"ContainerStarted","Data":"8214bcdba6f179e1d6ca9905cef760e225990ae993221e9644811e35e52bd852"}
Jul 18 01:51:25.074545 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:25.074518    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gxfjn" event={"ID":"974d3e72-d838-42fa-9d70-893f456d3c63","Type":"ContainerStarted","Data":"c8e23e10a71d6e37842d97e23ebbfceb6eb98a976e2263e31f09a5eb85c69f41"}
Jul 18 01:51:25.095398 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:25.095355    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sqx9l" podStartSLOduration=9.832311269 podStartE2EDuration="39.095343575s" totalImagesPullingTime="29.263032306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:25.093537216 +0000 UTC m=+39.730790495" watchObservedRunningTime="2026-07-18 01:51:25.095343575 +0000 UTC m=+39.732596854"
Jul 18 01:51:25.112526 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:25.112476    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gxfjn" podStartSLOduration=3.13811206 podStartE2EDuration="5.112464135s" totalImagesPullingTime="1.974352075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:25.111503494 +0000 UTC m=+39.748756773" watchObservedRunningTime="2026-07-18 01:51:25.112464135 +0000 UTC m=+39.749717453"
Jul 18 01:51:28.554493 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:28.554458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:28.554948 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:28.554568    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:28.554948 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:28.554615    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:36.554602579 +0000 UTC m=+51.191855841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:36.606212 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:36.606166    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:36.606712 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:36.606309    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:36.606712 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:36.606378    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:51:52.606363288 +0000 UTC m=+67.243616550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:46.053961 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:46.053938    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4bcr4"
Jul 18 01:51:51.504226 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.504183    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:51:51.507010 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.506992    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 01:51:51.515304 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:51.515282    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 01:51:51.515387 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:51.515352    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:52:55.515329737 +0000 UTC m=+130.152583011 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : secret "metrics-daemon-secret" not found
Jul 18 01:51:51.604970 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.604937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:51.605073 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.605005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:51.607638 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.607622    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 01:51:51.607720 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.607663    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 01:51:51.618085 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.618062    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 01:51:51.619504 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.619475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d5c6f0a-7d6e-4c68-86c6-2868bde955fb-original-pull-secret\") pod \"global-pull-secret-syncer-gnklm\" (UID: \"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb\") " pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:51.628184 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.628160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s78rv\" (UniqueName: \"kubernetes.io/projected/0d37cdbd-c70b-43f9-b81c-270bd38e701d-kube-api-access-s78rv\") pod \"network-check-target-fql9g\" (UID: \"0d37cdbd-c70b-43f9-b81c-270bd38e701d\") " pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:51.795770 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.795686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnklm"
Jul 18 01:51:51.811578 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.811552    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jss5k\""
Jul 18 01:51:51.819633 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.819612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:51.920442 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.920412    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnklm"]
Jul 18 01:51:51.923153 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:51:51.923030    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5c6f0a_7d6e_4c68_86c6_2868bde955fb.slice/crio-760d97d21fd450762a6e61ee3f56ab27fef2cb49f045e95383774f47dd41064e WatchSource:0}: Error finding container 760d97d21fd450762a6e61ee3f56ab27fef2cb49f045e95383774f47dd41064e: Status 404 returned error can't find the container with id 760d97d21fd450762a6e61ee3f56ab27fef2cb49f045e95383774f47dd41064e
Jul 18 01:51:51.940604 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:51.940575    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fql9g"]
Jul 18 01:51:51.943977 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:51:51.943936    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d37cdbd_c70b_43f9_b81c_270bd38e701d.slice/crio-b8bc8bbe449c61b0c269b4bb5ee167a1a4fbf540468acb7c2b484849adf2ef80 WatchSource:0}: Error finding container b8bc8bbe449c61b0c269b4bb5ee167a1a4fbf540468acb7c2b484849adf2ef80: Status 404 returned error can't find the container with id b8bc8bbe449c61b0c269b4bb5ee167a1a4fbf540468acb7c2b484849adf2ef80
Jul 18 01:51:52.132886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:52.132856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fql9g" event={"ID":"0d37cdbd-c70b-43f9-b81c-270bd38e701d","Type":"ContainerStarted","Data":"b8bc8bbe449c61b0c269b4bb5ee167a1a4fbf540468acb7c2b484849adf2ef80"}
Jul 18 01:51:52.133853 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:52.133828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnklm" event={"ID":"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb","Type":"ContainerStarted","Data":"760d97d21fd450762a6e61ee3f56ab27fef2cb49f045e95383774f47dd41064e"}
Jul 18 01:51:52.612235 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:52.612195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:51:52.612682 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:52.612363    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:51:52.612682 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:51:52.612450    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:52:24.612427681 +0000 UTC m=+99.249680944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:51:57.147090 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:57.147039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fql9g" event={"ID":"0d37cdbd-c70b-43f9-b81c-270bd38e701d","Type":"ContainerStarted","Data":"bfc764002f7384f2f1273a8395f8ac401a5c376995d204a0818d4ceb50358d87"}
Jul 18 01:51:57.147518 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:57.147147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:51:57.148470 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:57.148445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnklm" event={"ID":"8d5c6f0a-7d6e-4c68-86c6-2868bde955fb","Type":"ContainerStarted","Data":"4cbf6e167f9c9a57f836c2860f8a2b47854abba1a6c5d4d40a55875c8d6c1940"}
Jul 18 01:51:57.162392 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:57.162354    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fql9g" podStartSLOduration=66.83348281 podStartE2EDuration="1m11.162342841s" totalImagesPullingTime="4.328860031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:57.16164658 +0000 UTC m=+71.798899862" watchObservedRunningTime="2026-07-18 01:51:57.162342841 +0000 UTC m=+71.799596098"
Jul 18 01:51:57.175627 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:51:57.175590    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gnklm" podStartSLOduration=66.821994883 podStartE2EDuration="1m11.175581519s" totalImagesPullingTime="4.353586636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:51:57.174425553 +0000 UTC m=+71.811678823" watchObservedRunningTime="2026-07-18 01:51:57.175581519 +0000 UTC m=+71.812834799"
Jul 18 01:52:17.369001 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.368862    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"]
Jul 18 01:52:17.371472 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.371450    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.374236 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.374217    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 18 01:52:17.374236 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.374233    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 18 01:52:17.375437 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.375413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xwq4s\""
Jul 18 01:52:17.375437 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.375430    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 18 01:52:17.375674 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.375657    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 18 01:52:17.379445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.379381    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"]
Jul 18 01:52:17.480968 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.480945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/affc7430-ecdf-4557-aee6-3baececf745a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.481080 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.480976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4c6f\" (UniqueName: \"kubernetes.io/projected/affc7430-ecdf-4557-aee6-3baececf745a-kube-api-access-z4c6f\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.581482 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.581458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/affc7430-ecdf-4557-aee6-3baececf745a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.581567 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.581490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4c6f\" (UniqueName: \"kubernetes.io/projected/affc7430-ecdf-4557-aee6-3baececf745a-kube-api-access-z4c6f\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.583766 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.583745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/affc7430-ecdf-4557-aee6-3baececf745a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.588623 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.588602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4c6f\" (UniqueName: \"kubernetes.io/projected/affc7430-ecdf-4557-aee6-3baececf745a-kube-api-access-z4c6f\") pod \"managed-serviceaccount-addon-agent-69b8b79f44-r8npx\" (UID: \"affc7430-ecdf-4557-aee6-3baececf745a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.693636 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.693589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"
Jul 18 01:52:17.809772 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:17.809739    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx"]
Jul 18 01:52:17.812430 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:52:17.812395    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaffc7430_ecdf_4557_aee6_3baececf745a.slice/crio-673b8307c7828852b57fc17f4e3b36e6783b6044ec46cf8de900742288050ad4 WatchSource:0}: Error finding container 673b8307c7828852b57fc17f4e3b36e6783b6044ec46cf8de900742288050ad4: Status 404 returned error can't find the container with id 673b8307c7828852b57fc17f4e3b36e6783b6044ec46cf8de900742288050ad4
Jul 18 01:52:18.197999 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:18.197967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx" event={"ID":"affc7430-ecdf-4557-aee6-3baececf745a","Type":"ContainerStarted","Data":"673b8307c7828852b57fc17f4e3b36e6783b6044ec46cf8de900742288050ad4"}
Jul 18 01:52:20.204014 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:20.203979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx" event={"ID":"affc7430-ecdf-4557-aee6-3baececf745a","Type":"ContainerStarted","Data":"7f36c60e642394409b70d18f68505fd24c7f5bb5e003b3025458a724f2b8888f"}
Jul 18 01:52:20.217595 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:20.217554    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx" podStartSLOduration=0.973813238 podStartE2EDuration="3.217538931s" totalImagesPullingTime="2.243725693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:52:20.217286775 +0000 UTC m=+94.854540055" watchObservedRunningTime="2026-07-18 01:52:20.217538931 +0000 UTC m=+94.854792188"
Jul 18 01:52:24.628954 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:24.628920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:52:24.629304 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:52:24.629039    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:52:24.629304 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:52:24.629116    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:53:28.629102248 +0000 UTC m=+163.266355506 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:52:28.152968 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:28.152934    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fql9g"
Jul 18 01:52:55.515657 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:52:55.515620    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:52:55.516145 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:52:55.515762    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 01:52:55.516145 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:52:55.515841    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:57.51582637 +0000 UTC m=+252.153079628 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : secret "metrics-daemon-secret" not found
Jul 18 01:53:23.809006 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:53:23.808963    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wq949" podUID="18c83878-29b0-415d-a0d7-2c8536025616"
Jul 18 01:53:23.902447 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:53:23.902415    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:53:24.346502 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:53:24.346476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq949"
Jul 18 01:53:28.721531 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:53:28.721497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:53:28.721892 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:53:28.721650    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 18 01:53:28.721892 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:53:28.721721    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls podName:18c83878-29b0-415d-a0d7-2c8536025616 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:30.721705385 +0000 UTC m=+285.358958643 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls") pod "dns-default-wq949" (UID: "18c83878-29b0-415d-a0d7-2c8536025616") : secret "dns-default-metrics-tls" not found
Jul 18 01:53:38.886058 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:53:38.885961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:54:20.473886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:20.473830    2563 generic.go:356] "Generic (PLEG): container finished" podID="affc7430-ecdf-4557-aee6-3baececf745a" containerID="7f36c60e642394409b70d18f68505fd24c7f5bb5e003b3025458a724f2b8888f" exitCode=255
Jul 18 01:54:20.473886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:20.473870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx" event={"ID":"affc7430-ecdf-4557-aee6-3baececf745a","Type":"ContainerDied","Data":"7f36c60e642394409b70d18f68505fd24c7f5bb5e003b3025458a724f2b8888f"}
Jul 18 01:54:20.479021 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:20.479003    2563 scope.go:117] "RemoveContainer" containerID="7f36c60e642394409b70d18f68505fd24c7f5bb5e003b3025458a724f2b8888f"
Jul 18 01:54:21.477680 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:21.477644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69b8b79f44-r8npx" event={"ID":"affc7430-ecdf-4557-aee6-3baececf745a","Type":"ContainerStarted","Data":"27c56ee3adc1cca80da3a84442e83d17e7e0eafeef5c4632ec70e6869a2288f2"}
Jul 18 01:54:49.084687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.084646    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mvhth"]
Jul 18 01:54:49.087245 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.087227    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:54:49.087375 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.087356    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.089719 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.089700    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.091972 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.091951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:54:49.091972 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.091962    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 18 01:54:49.092401 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.092361    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 01:54:49.092537 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.092461    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xlk5h\""
Jul 18 01:54:49.092650 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.092624    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 18 01:54:49.094194 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.094177    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 01:54:49.094312 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.094295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 01:54:49.095411 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.095393    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 18 01:54:49.103696 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.103669    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 18 01:54:49.104502 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.104483    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwp4g\""
Jul 18 01:54:49.104810 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.104786    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 01:54:49.105214 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.105196    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mvhth"]
Jul 18 01:54:49.112750 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.112729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:54:49.118208 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118290 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118216    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwr6\" (UniqueName: \"kubernetes.io/projected/9d474542-3bf9-4478-8517-90d2f74d1117-kube-api-access-9bwr6\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.118339 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118339 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-config\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.118416 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118416 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kv5z\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118416 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-trusted-ca\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.118416 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118555 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118555 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118555 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.118555 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.118475    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d474542-3bf9-4478-8517-90d2f74d1117-serving-cert\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.127601 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.127573    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xsww4"]
Jul 18 01:54:49.130165 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.130148    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.133803 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.133783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 18 01:54:49.134228 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.134211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 18 01:54:49.135713 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.135665    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pmbwm\""
Jul 18 01:54:49.135832 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.135804    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 01:54:49.136128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.136112    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"]
Jul 18 01:54:49.137456 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.137430    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 01:54:49.138596 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.138580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.141015 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.140995    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 18 01:54:49.141675 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.141659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 18 01:54:49.142121 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.142100    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4hzfj\""
Jul 18 01:54:49.142279 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.142264    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 18 01:54:49.142348 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.142332    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 18 01:54:49.143610 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.143592    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 18 01:54:49.145541 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.145524    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xsww4"]
Jul 18 01:54:49.163134 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.163108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"]
Jul 18 01:54:49.219633 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.219633 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwr6\" (UniqueName: \"kubernetes.io/projected/9d474542-3bf9-4478-8517-90d2f74d1117-kube-api-access-9bwr6\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.219746 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-snapshots\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.219746 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kv5z\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.219820 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-trusted-ca\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.219867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-service-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.219911 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.219963 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.219963 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.219963 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-config\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.220121 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.219993    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d474542-3bf9-4478-8517-90d2f74d1117-serving-cert\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.220202 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.220185    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:54:49.220244 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.220205    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5496595594-vfpcx: secret "image-registry-tls" not found
Jul 18 01:54:49.220244 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.220337 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-serving-cert\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.220394 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.220338    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls podName:9bd92d92-829c-4460-b39c-7a54db2ea7b3 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:49.720317905 +0000 UTC m=+244.357571176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls") pod "image-registry-5496595594-vfpcx" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3") : secret "image-registry-tls" not found
Jul 18 01:54:49.220394 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvpww\" (UniqueName: \"kubernetes.io/projected/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-kube-api-access-fvpww\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.220503 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.220503 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220434    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-config\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.220503 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-tmp\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.220503 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.220700 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.220700 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.220700 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s824b\" (UniqueName: \"kubernetes.io/projected/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-kube-api-access-s824b\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.220849 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.220763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-trusted-ca\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.221040 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.221012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.221040 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.221029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.221211 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.221153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.221211 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.221166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d474542-3bf9-4478-8517-90d2f74d1117-config\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.222401 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.222380    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.222496 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.222419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d474542-3bf9-4478-8517-90d2f74d1117-serving-cert\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.223194 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.223170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.232438 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.232410    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kv5z\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.232777 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.232762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.232951 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.232936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwr6\" (UniqueName: \"kubernetes.io/projected/9d474542-3bf9-4478-8517-90d2f74d1117-kube-api-access-9bwr6\") pod \"console-operator-565b7b569d-mvhth\" (UID: \"9d474542-3bf9-4478-8517-90d2f74d1117\") " pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.321177 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321151    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-config\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.321274 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321274 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321237    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-serving-cert\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321274 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321263    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvpww\" (UniqueName: \"kubernetes.io/projected/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-kube-api-access-fvpww\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321447 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321290    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-tmp\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321447 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.321447 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s824b\" (UniqueName: \"kubernetes.io/projected/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-kube-api-access-s824b\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.321447 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321389    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-snapshots\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321447 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-service-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321689 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-tmp\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.321747 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.321701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-config\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.322028 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.322008    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-service-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.322136 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.322114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-snapshots\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.322521 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.322502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.323418 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.323399    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-serving-cert\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.323474 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.323458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-serving-cert\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.329251 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.329234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvpww\" (UniqueName: \"kubernetes.io/projected/01669ad6-45a7-4e6f-bade-bd8b5f3efd00-kube-api-access-fvpww\") pod \"insights-operator-555d9d7885-xsww4\" (UID: \"01669ad6-45a7-4e6f-bade-bd8b5f3efd00\") " pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.329251 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.329246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s824b\" (UniqueName: \"kubernetes.io/projected/37ea1718-cf0a-40f2-86f8-4b9e94fd6f17-kube-api-access-s824b\") pod \"service-ca-operator-5bcbc94c78-pv4pb\" (UID: \"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.397299 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.397282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:49.438660 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.438638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-xsww4"
Jul 18 01:54:49.448297 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.448274    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"
Jul 18 01:54:49.556404 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:54:49.556377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d474542_3bf9_4478_8517_90d2f74d1117.slice/crio-e17d5ccb86f580a1e9bd546f9a2f9c8dbcc06e117799589f35a569a873a52b41 WatchSource:0}: Error finding container e17d5ccb86f580a1e9bd546f9a2f9c8dbcc06e117799589f35a569a873a52b41: Status 404 returned error can't find the container with id e17d5ccb86f580a1e9bd546f9a2f9c8dbcc06e117799589f35a569a873a52b41
Jul 18 01:54:49.560515 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.560492    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-mvhth"]
Jul 18 01:54:49.577321 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.577295    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-xsww4"]
Jul 18 01:54:49.579637 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:54:49.579615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01669ad6_45a7_4e6f_bade_bd8b5f3efd00.slice/crio-eb4e58165ea789fed98f5304c94f302dacc745d639bfed8632927d770393d76f WatchSource:0}: Error finding container eb4e58165ea789fed98f5304c94f302dacc745d639bfed8632927d770393d76f: Status 404 returned error can't find the container with id eb4e58165ea789fed98f5304c94f302dacc745d639bfed8632927d770393d76f
Jul 18 01:54:49.592280 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.592259    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb"]
Jul 18 01:54:49.594751 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:54:49.594730    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ea1718_cf0a_40f2_86f8_4b9e94fd6f17.slice/crio-a1684e458a8d3f66c2aa9f93718009d118a2d2f90145fed736e63b6c7f9d77f5 WatchSource:0}: Error finding container a1684e458a8d3f66c2aa9f93718009d118a2d2f90145fed736e63b6c7f9d77f5: Status 404 returned error can't find the container with id a1684e458a8d3f66c2aa9f93718009d118a2d2f90145fed736e63b6c7f9d77f5
Jul 18 01:54:49.724225 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:49.724175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:49.724330 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.724312    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:54:49.724373 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.724331    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5496595594-vfpcx: secret "image-registry-tls" not found
Jul 18 01:54:49.724405 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:49.724374    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls podName:9bd92d92-829c-4460-b39c-7a54db2ea7b3 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:50.724360467 +0000 UTC m=+245.361613725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls") pod "image-registry-5496595594-vfpcx" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3") : secret "image-registry-tls" not found
Jul 18 01:54:50.548784 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:50.548714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xsww4" event={"ID":"01669ad6-45a7-4e6f-bade-bd8b5f3efd00","Type":"ContainerStarted","Data":"eb4e58165ea789fed98f5304c94f302dacc745d639bfed8632927d770393d76f"}
Jul 18 01:54:50.550217 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:50.550180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" event={"ID":"9d474542-3bf9-4478-8517-90d2f74d1117","Type":"ContainerStarted","Data":"e17d5ccb86f580a1e9bd546f9a2f9c8dbcc06e117799589f35a569a873a52b41"}
Jul 18 01:54:50.552061 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:50.552024    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb" event={"ID":"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17","Type":"ContainerStarted","Data":"a1684e458a8d3f66c2aa9f93718009d118a2d2f90145fed736e63b6c7f9d77f5"}
Jul 18 01:54:50.733894 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:50.733857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:50.734310 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:50.734081    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:54:50.734310 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:50.734102    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5496595594-vfpcx: secret "image-registry-tls" not found
Jul 18 01:54:50.734310 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:50.734167    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls podName:9bd92d92-829c-4460-b39c-7a54db2ea7b3 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:52.734148631 +0000 UTC m=+247.371401892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls") pod "image-registry-5496595594-vfpcx" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3") : secret "image-registry-tls" not found
Jul 18 01:54:52.525540 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.525507    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"]
Jul 18 01:54:52.528832 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.528797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"
Jul 18 01:54:52.534400 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.534185    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 18 01:54:52.534740 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.534641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 18 01:54:52.534740 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.534646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sndb2\""
Jul 18 01:54:52.549597 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.549573    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"]
Jul 18 01:54:52.560353 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.560076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb" event={"ID":"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17","Type":"ContainerStarted","Data":"6fc7b4099b86e594b76b0f585ea374592c6e7a01ce4c0493389b947d7708dc5c"}
Jul 18 01:54:52.561607 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.561583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xsww4" event={"ID":"01669ad6-45a7-4e6f-bade-bd8b5f3efd00","Type":"ContainerStarted","Data":"df0073ed6410bbbbdcea732423756381786acacfe95215f16c6223456b786e1c"}
Jul 18 01:54:52.563083 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.563067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/0.log"
Jul 18 01:54:52.563164 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.563104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" event={"ID":"9d474542-3bf9-4478-8517-90d2f74d1117","Type":"ContainerStarted","Data":"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"}
Jul 18 01:54:52.563361 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.563344    2563 scope.go:117] "RemoveContainer" containerID="5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"
Jul 18 01:54:52.654947 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.654880    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4w47\" (UniqueName: \"kubernetes.io/projected/f8ab6325-bc54-4c7c-97b5-f797d0a9edfa-kube-api-access-t4w47\") pod \"migrator-7cc9c7ffd7-wpzct\" (UID: \"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"
Jul 18 01:54:52.671953 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.671706    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb" podStartSLOduration=0.849369796 podStartE2EDuration="3.671688669s" totalImagesPullingTime="2.822318873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:52.670853422 +0000 UTC m=+247.308106703" watchObservedRunningTime="2026-07-18 01:54:52.671688669 +0000 UTC m=+247.308941951"
Jul 18 01:54:52.707765 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.707716    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-xsww4" podStartSLOduration=0.875933479 podStartE2EDuration="3.707696201s" totalImagesPullingTime="2.831762722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:52.706254591 +0000 UTC m=+247.343507872" watchObservedRunningTime="2026-07-18 01:54:52.707696201 +0000 UTC m=+247.344949482"
Jul 18 01:54:52.755788 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.755762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:52.755886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.755844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4w47\" (UniqueName: \"kubernetes.io/projected/f8ab6325-bc54-4c7c-97b5-f797d0a9edfa-kube-api-access-t4w47\") pod \"migrator-7cc9c7ffd7-wpzct\" (UID: \"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"
Jul 18 01:54:52.755942 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:52.755894    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:54:52.755942 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:52.755912    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5496595594-vfpcx: secret "image-registry-tls" not found
Jul 18 01:54:52.756082 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:52.755956    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls podName:9bd92d92-829c-4460-b39c-7a54db2ea7b3 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:56.755943055 +0000 UTC m=+251.393196314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls") pod "image-registry-5496595594-vfpcx" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3") : secret "image-registry-tls" not found
Jul 18 01:54:52.773037 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.773015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4w47\" (UniqueName: \"kubernetes.io/projected/f8ab6325-bc54-4c7c-97b5-f797d0a9edfa-kube-api-access-t4w47\") pod \"migrator-7cc9c7ffd7-wpzct\" (UID: \"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"
Jul 18 01:54:52.839967 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.839945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"
Jul 18 01:54:52.972846 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:52.972814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct"]
Jul 18 01:54:52.976032 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:54:52.976006    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ab6325_bc54_4c7c_97b5_f797d0a9edfa.slice/crio-e4b010cfe4d5a891cb40851bc8d40ac7f6ca7238b3b915ab4df02e4341b7aa11 WatchSource:0}: Error finding container e4b010cfe4d5a891cb40851bc8d40ac7f6ca7238b3b915ab4df02e4341b7aa11: Status 404 returned error can't find the container with id e4b010cfe4d5a891cb40851bc8d40ac7f6ca7238b3b915ab4df02e4341b7aa11
Jul 18 01:54:53.568291 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568271    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 01:54:53.568689 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/0.log"
Jul 18 01:54:53.568741 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568707    2563 generic.go:356] "Generic (PLEG): container finished" podID="9d474542-3bf9-4478-8517-90d2f74d1117" containerID="5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197" exitCode=255
Jul 18 01:54:53.568741 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568720    2563 generic.go:356] "Generic (PLEG): container finished" podID="9d474542-3bf9-4478-8517-90d2f74d1117" containerID="6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f" exitCode=255
Jul 18 01:54:53.568810 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568773    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" event={"ID":"9d474542-3bf9-4478-8517-90d2f74d1117","Type":"ContainerDied","Data":"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"}
Jul 18 01:54:53.568867 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" event={"ID":"9d474542-3bf9-4478-8517-90d2f74d1117","Type":"ContainerDied","Data":"6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f"}
Jul 18 01:54:53.568917 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.568899    2563 scope.go:117] "RemoveContainer" containerID="5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"
Jul 18 01:54:53.569041 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.569026    2563 scope.go:117] "RemoveContainer" containerID="6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f"
Jul 18 01:54:53.569252 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:53.569228    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mvhth_openshift-console-operator(9d474542-3bf9-4478-8517-90d2f74d1117)\"" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" podUID="9d474542-3bf9-4478-8517-90d2f74d1117"
Jul 18 01:54:53.570226 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.569952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct" event={"ID":"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa","Type":"ContainerStarted","Data":"e4b010cfe4d5a891cb40851bc8d40ac7f6ca7238b3b915ab4df02e4341b7aa11"}
Jul 18 01:54:53.580435 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.580417    2563 scope.go:117] "RemoveContainer" containerID="5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"
Jul 18 01:54:53.580703 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:53.580680    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197\": container with ID starting with 5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197 not found: ID does not exist" containerID="5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"
Jul 18 01:54:53.580789 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.580709    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197"} err="failed to get container status \"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197\": rpc error: code = NotFound desc = could not find container \"5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197\": container with ID starting with 5fe4f804a997eb7484d5a140c5ab36ccb8939a4078e0f8b636b2c30adae5a197 not found: ID does not exist"
Jul 18 01:54:53.895323 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.895290    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2nv7b"]
Jul 18 01:54:53.898397 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.898375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.903074 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.902882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qnqgm\""
Jul 18 01:54:53.906193 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.906163    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 01:54:53.906409 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.906232    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 01:54:53.965880 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.965850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8759g\" (UniqueName: \"kubernetes.io/projected/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-api-access-8759g\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.966022 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.965888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.966022 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.965913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.966022 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.965982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1367c12d-0a32-4e1d-bd1b-993728c23272-data-volume\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.966167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.966114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1367c12d-0a32-4e1d-bd1b-993728c23272-crio-socket\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:53.980440 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:53.980415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2nv7b"]
Jul 18 01:54:54.066806 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1367c12d-0a32-4e1d-bd1b-993728c23272-crio-socket\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.066959 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8759g\" (UniqueName: \"kubernetes.io/projected/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-api-access-8759g\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.066959 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.066959 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.066959 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1367c12d-0a32-4e1d-bd1b-993728c23272-data-volume\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.066959 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.066925    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1367c12d-0a32-4e1d-bd1b-993728c23272-crio-socket\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.067240 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.067094    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:54.067240 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.067158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:54.567136906 +0000 UTC m=+249.204390177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:54.067346 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.067270    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1367c12d-0a32-4e1d-bd1b-993728c23272-data-volume\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.067346 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.067280    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:54:54.067506 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.067365    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:54.567349509 +0000 UTC m=+249.204602786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : configmap "kube-rbac-proxy" not found
Jul 18 01:54:54.076579 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.076556    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8759g\" (UniqueName: \"kubernetes.io/projected/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-api-access-8759g\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.570552 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.570527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.570857 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.570570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:54.570857 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.570649    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:54:54.570857 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.570681    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:54.570857 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.570697    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:55.570678648 +0000 UTC m=+250.207931921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : configmap "kube-rbac-proxy" not found
Jul 18 01:54:54.570857 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.570740    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:55.570720174 +0000 UTC m=+250.207973437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:54.574772 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.574752    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 01:54:54.575137 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.575117    2563 scope.go:117] "RemoveContainer" containerID="6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f"
Jul 18 01:54:54.575311 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:54.575287    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mvhth_openshift-console-operator(9d474542-3bf9-4478-8517-90d2f74d1117)\"" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" podUID="9d474542-3bf9-4478-8517-90d2f74d1117"
Jul 18 01:54:54.576725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:54.576701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct" event={"ID":"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa","Type":"ContainerStarted","Data":"311909dd94cb9ef664be43205b98293e253d4e93b73eec9a1744188b315eb895"}
Jul 18 01:54:55.578005 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:55.577969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:55.578397 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:55.578016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:55.578397 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:55.578107    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:55.578397 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:55.578115    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:54:55.578397 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:55.578163    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:57.578146583 +0000 UTC m=+252.215399845 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:55.578397 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:55.578177    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:54:57.578170519 +0000 UTC m=+252.215423777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : configmap "kube-rbac-proxy" not found
Jul 18 01:54:55.582189 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:55.582161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct" event={"ID":"f8ab6325-bc54-4c7c-97b5-f797d0a9edfa","Type":"ContainerStarted","Data":"8da18be0f1b9dce51df5941d90a2666e6b684a34b8d5ce9a48bc8674a2aae3e1"}
Jul 18 01:54:55.612615 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:55.612574    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wpzct" podStartSLOduration=2.081217518 podStartE2EDuration="3.612560154s" totalImagesPullingTime="1.531342636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:55.611742437 +0000 UTC m=+250.248995718" watchObservedRunningTime="2026-07-18 01:54:55.612560154 +0000 UTC m=+250.249813433"
Jul 18 01:54:56.440579 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.440547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-x5qxn"]
Jul 18 01:54:56.443550 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.443533    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.446405 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.446383    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 18 01:54:56.446512 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.446463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 18 01:54:56.446570 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.446561    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 18 01:54:56.447573 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.447558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g7l9w\""
Jul 18 01:54:56.447616 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.447589    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 18 01:54:56.456366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.455654    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-x5qxn"]
Jul 18 01:54:56.484439 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.484418    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-cabundle\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.484549 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.484487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pzjc\" (UniqueName: \"kubernetes.io/projected/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-kube-api-access-4pzjc\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.484613 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.484544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-key\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.584796 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.584776    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pzjc\" (UniqueName: \"kubernetes.io/projected/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-kube-api-access-4pzjc\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.585103 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.584818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-key\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.585103 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.584862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-cabundle\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.585411 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.585396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-cabundle\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.587236 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.587220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-signing-key\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.593502 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.593483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pzjc\" (UniqueName: \"kubernetes.io/projected/e05f2be8-7e8c-41bd-a257-1d6ffc4d5314-kube-api-access-4pzjc\") pod \"service-ca-58598695f7-x5qxn\" (UID: \"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314\") " pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.665223 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.665204    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9z8jw_f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6/dns-node-resolver/0.log"
Jul 18 01:54:56.751886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.751826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-x5qxn"
Jul 18 01:54:56.785814 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.785788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:54:56.785968 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:56.785951    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 18 01:54:56.786034 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:56.785971    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5496595594-vfpcx: secret "image-registry-tls" not found
Jul 18 01:54:56.786109 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:56.786035    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls podName:9bd92d92-829c-4460-b39c-7a54db2ea7b3 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:04.786014364 +0000 UTC m=+259.423267639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls") pod "image-registry-5496595594-vfpcx" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3") : secret "image-registry-tls" not found
Jul 18 01:54:56.899399 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:56.899369    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-x5qxn"]
Jul 18 01:54:56.902613 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:54:56.902585    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05f2be8_7e8c_41bd_a257_1d6ffc4d5314.slice/crio-3c429236251e1137c4c9f568cbc61c5adf66c42f8fb6d4bfb2f11419119f54a0 WatchSource:0}: Error finding container 3c429236251e1137c4c9f568cbc61c5adf66c42f8fb6d4bfb2f11419119f54a0: Status 404 returned error can't find the container with id 3c429236251e1137c4c9f568cbc61c5adf66c42f8fb6d4bfb2f11419119f54a0
Jul 18 01:54:57.590007 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.589972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-x5qxn" event={"ID":"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314","Type":"ContainerStarted","Data":"6abe57af762b621a94d2956cb1f9c0dd773f38bc00d7536a6f22c19a81594ada"}
Jul 18 01:54:57.590449 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.590019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-x5qxn" event={"ID":"e05f2be8-7e8c-41bd-a257-1d6ffc4d5314","Type":"ContainerStarted","Data":"3c429236251e1137c4c9f568cbc61c5adf66c42f8fb6d4bfb2f11419119f54a0"}
Jul 18 01:54:57.591332 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.591308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:57.591405 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.591349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:54:57.591510 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591484    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:57.591641 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591546    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:54:57.591641 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591553    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:01.59153287 +0000 UTC m=+256.228786143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:54:57.591641 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591628    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:01.591609479 +0000 UTC m=+256.228862750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : configmap "kube-rbac-proxy" not found
Jul 18 01:54:57.591788 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.591690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:54:57.591788 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591773    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 18 01:54:57.591864 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:57.591804    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs podName:0a8884b5-cceb-42fb-93e3-8746a84034f9 nodeName:}" failed. No retries permitted until 2026-07-18 01:56:59.591795775 +0000 UTC m=+374.229049033 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs") pod "network-metrics-daemon-w74kq" (UID: "0a8884b5-cceb-42fb-93e3-8746a84034f9") : secret "metrics-daemon-secret" not found
Jul 18 01:54:57.609929 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.609888    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-x5qxn" podStartSLOduration=1.60987459 podStartE2EDuration="1.60987459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:54:57.609252667 +0000 UTC m=+252.246505953" watchObservedRunningTime="2026-07-18 01:54:57.60987459 +0000 UTC m=+252.247127870"
Jul 18 01:54:57.866027 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:57.865999    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zj9bp_2283afa0-0e65-4b29-9d2c-3ac6a11c339e/node-ca/0.log"
Jul 18 01:54:58.665430 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:58.665400    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxfjn_974d3e72-d838-42fa-9d70-893f456d3c63/serve-healthcheck-canary/0.log"
Jul 18 01:54:58.865841 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:58.865816    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wpzct_f8ab6325-bc54-4c7c-97b5-f797d0a9edfa/migrator/0.log"
Jul 18 01:54:59.064622 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:59.064534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wpzct_f8ab6325-bc54-4c7c-97b5-f797d0a9edfa/graceful-termination/0.log"
Jul 18 01:54:59.397971 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:59.397946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:59.398102 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:59.397990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:54:59.398283 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:54:59.398272    2563 scope.go:117] "RemoveContainer" containerID="6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f"
Jul 18 01:54:59.398409 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:54:59.398393    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-mvhth_openshift-console-operator(9d474542-3bf9-4478-8517-90d2f74d1117)\"" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" podUID="9d474542-3bf9-4478-8517-90d2f74d1117"
Jul 18 01:55:01.620113 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:01.620082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:01.620113 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:01.620116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:01.620558 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:01.620202    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 18 01:55:01.620558 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:01.620251    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:09.620238134 +0000 UTC m=+264.257491392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : configmap "kube-rbac-proxy" not found
Jul 18 01:55:01.620558 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:01.620256    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 18 01:55:01.620558 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:01.620319    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls podName:1367c12d-0a32-4e1d-bd1b-993728c23272 nodeName:}" failed. No retries permitted until 2026-07-18 01:55:09.620300316 +0000 UTC m=+264.257553582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2nv7b" (UID: "1367c12d-0a32-4e1d-bd1b-993728c23272") : secret "insights-runtime-extractor-tls" not found
Jul 18 01:55:04.845781 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:04.845748    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:04.848232 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:04.848205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"image-registry-5496595594-vfpcx\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") " pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:05.004421 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.004394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:05.134574 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.134539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:55:05.138015 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:05.137989    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd92d92_829c_4460_b39c_7a54db2ea7b3.slice/crio-07c22c7480b49f8f5d0c8c70994160fa02d9f4e0b27781e60ecf0d72ff6d5f8d WatchSource:0}: Error finding container 07c22c7480b49f8f5d0c8c70994160fa02d9f4e0b27781e60ecf0d72ff6d5f8d: Status 404 returned error can't find the container with id 07c22c7480b49f8f5d0c8c70994160fa02d9f4e0b27781e60ecf0d72ff6d5f8d
Jul 18 01:55:05.617123 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.617086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5496595594-vfpcx" event={"ID":"9bd92d92-829c-4460-b39c-7a54db2ea7b3","Type":"ContainerStarted","Data":"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"}
Jul 18 01:55:05.617276 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.617148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5496595594-vfpcx" event={"ID":"9bd92d92-829c-4460-b39c-7a54db2ea7b3","Type":"ContainerStarted","Data":"07c22c7480b49f8f5d0c8c70994160fa02d9f4e0b27781e60ecf0d72ff6d5f8d"}
Jul 18 01:55:05.617276 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.617196    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:05.635773 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:05.635727    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5496595594-vfpcx" podStartSLOduration=16.635712482 podStartE2EDuration="16.635712482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:05.635417042 +0000 UTC m=+260.272670324" watchObservedRunningTime="2026-07-18 01:55:05.635712482 +0000 UTC m=+260.272965763"
Jul 18 01:55:09.682673 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.682587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:09.682673 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.682632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:09.683194 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.683177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1367c12d-0a32-4e1d-bd1b-993728c23272-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:09.684908 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.684889    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1367c12d-0a32-4e1d-bd1b-993728c23272-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2nv7b\" (UID: \"1367c12d-0a32-4e1d-bd1b-993728c23272\") " pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:09.811367 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.811338    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2nv7b"
Jul 18 01:55:09.929801 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:09.929777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2nv7b"]
Jul 18 01:55:09.932037 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:09.932008    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1367c12d_0a32_4e1d_bd1b_993728c23272.slice/crio-64faac3fe187a4182838ce5ef2dbea1d116d7b400506d4e3a8ce9ad8128ccb35 WatchSource:0}: Error finding container 64faac3fe187a4182838ce5ef2dbea1d116d7b400506d4e3a8ce9ad8128ccb35: Status 404 returned error can't find the container with id 64faac3fe187a4182838ce5ef2dbea1d116d7b400506d4e3a8ce9ad8128ccb35
Jul 18 01:55:10.638267 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:10.638228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2nv7b" event={"ID":"1367c12d-0a32-4e1d-bd1b-993728c23272","Type":"ContainerStarted","Data":"64faac3fe187a4182838ce5ef2dbea1d116d7b400506d4e3a8ce9ad8128ccb35"}
Jul 18 01:55:12.886135 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:12.886101    2563 scope.go:117] "RemoveContainer" containerID="6b3cf1cf61664df05896c4762f0e51acac05059bda37a82375b8c474ee849d9f"
Jul 18 01:55:15.663813 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.662605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 01:55:15.663813 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.662748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" event={"ID":"9d474542-3bf9-4478-8517-90d2f74d1117","Type":"ContainerStarted","Data":"5b0ae1a83957fef726e840df6477c030e12cc5af7abbffd56f26195edc96304c"}
Jul 18 01:55:15.663813 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.663809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:55:15.667286 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.667242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2nv7b" event={"ID":"1367c12d-0a32-4e1d-bd1b-993728c23272","Type":"ContainerStarted","Data":"e11493ff27c0ab8cc677fdcf0675638860b5c6e77e50103ceb2de5ebafc184ab"}
Jul 18 01:55:15.679860 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.679817    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-mvhth" podStartSLOduration=23.822666615 podStartE2EDuration="26.679803543s" totalImagesPullingTime="2.857136928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:54:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:15.679030355 +0000 UTC m=+270.316283628" watchObservedRunningTime="2026-07-18 01:55:15.679803543 +0000 UTC m=+270.317056822"
Jul 18 01:55:15.870755 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:15.870728    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-mvhth"
Jul 18 01:55:18.681378 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:18.681338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2nv7b" event={"ID":"1367c12d-0a32-4e1d-bd1b-993728c23272","Type":"ContainerStarted","Data":"7d067ca21a0d60f5d315ef43057c1b5562dd717a47e69ec4246ab1146a6129cf"}
Jul 18 01:55:19.095564 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.095489    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:55:19.197911 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.197882    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"]
Jul 18 01:55:19.200975 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.200946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.212939 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.212891    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"]
Jul 18 01:55:19.359928 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.359897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e302226-165e-4550-8199-a84715a4a876-ca-trust-extracted\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.359946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-installation-pull-secrets\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.359973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-trusted-ca\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.360068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-registry-tls\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.360100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-registry-certificates\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360353 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.360142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27p2l\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-kube-api-access-27p2l\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360353 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.360172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-bound-sa-token\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.360353 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.360238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-image-registry-private-configuration\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.461673 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.461643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27p2l\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-kube-api-access-27p2l\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.461833 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.461687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-bound-sa-token\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.461915 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.461892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-image-registry-private-configuration\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.461980 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.461948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e302226-165e-4550-8199-a84715a4a876-ca-trust-extracted\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.462092 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.461980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-installation-pull-secrets\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.462092 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.462007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-trusted-ca\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.462092 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.462080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-registry-tls\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.462269 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.462099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-registry-certificates\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.464874 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.462870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e302226-165e-4550-8199-a84715a4a876-ca-trust-extracted\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.464874 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.463412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-registry-certificates\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.464874 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.463695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e302226-165e-4550-8199-a84715a4a876-trusted-ca\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.468659 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.465455    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-installation-pull-secrets\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.468659 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.465578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e302226-165e-4550-8199-a84715a4a876-image-registry-private-configuration\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.468659 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.465583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-registry-tls\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.469499 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.469474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-bound-sa-token\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.471166 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.471141    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27p2l\" (UniqueName: \"kubernetes.io/projected/9e302226-165e-4550-8199-a84715a4a876-kube-api-access-27p2l\") pod \"image-registry-5b5c58b8fc-hkhmn\" (UID: \"9e302226-165e-4550-8199-a84715a4a876\") " pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.512035 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.512012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:19.680836 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:19.680705    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"]
Jul 18 01:55:19.683563 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:19.683531    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e302226_165e_4550_8199_a84715a4a876.slice/crio-b1923077af1176c03315ff5afc4091f1dd6fcb01f0ac4d72ffdca5c58271cf7c WatchSource:0}: Error finding container b1923077af1176c03315ff5afc4091f1dd6fcb01f0ac4d72ffdca5c58271cf7c: Status 404 returned error can't find the container with id b1923077af1176c03315ff5afc4091f1dd6fcb01f0ac4d72ffdca5c58271cf7c
Jul 18 01:55:20.691553 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:20.691506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn" event={"ID":"9e302226-165e-4550-8199-a84715a4a876","Type":"ContainerStarted","Data":"a3aa3213439beed48604a3987070d66992f41ec6e77132daa704c672b0efbcd2"}
Jul 18 01:55:20.692004 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:20.691577    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn" event={"ID":"9e302226-165e-4550-8199-a84715a4a876","Type":"ContainerStarted","Data":"b1923077af1176c03315ff5afc4091f1dd6fcb01f0ac4d72ffdca5c58271cf7c"}
Jul 18 01:55:20.692004 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:20.691650    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:20.717241 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:20.717196    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn" podStartSLOduration=1.7171829459999999 podStartE2EDuration="1.717182946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:20.715359855 +0000 UTC m=+275.352613136" watchObservedRunningTime="2026-07-18 01:55:20.717182946 +0000 UTC m=+275.354436225"
Jul 18 01:55:22.701860 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:22.701822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2nv7b" event={"ID":"1367c12d-0a32-4e1d-bd1b-993728c23272","Type":"ContainerStarted","Data":"c282242a2422f6937b25881b8ded0cf9788d417d433a89e0f04ded555343be55"}
Jul 18 01:55:22.720600 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:22.720548    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2nv7b" podStartSLOduration=18.115610616 podStartE2EDuration="29.720530972s" totalImagesPullingTime="11.604920356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:54:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:22.719563724 +0000 UTC m=+277.356817005" watchObservedRunningTime="2026-07-18 01:55:22.720530972 +0000 UTC m=+277.357784266"
Jul 18 01:55:27.347191 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:27.347150    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wq949" podUID="18c83878-29b0-415d-a0d7-2c8536025616"
Jul 18 01:55:27.723036 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:27.723005    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:28.111553 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.111524    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-25fzl"]
Jul 18 01:55:28.116422 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.116401    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.119098 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.119076    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 18 01:55:28.119190 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.119099    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 01:55:28.119247 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.119226    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xfr72\""
Jul 18 01:55:28.120402 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.120379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 18 01:55:28.120506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.120421    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 18 01:55:28.120506 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.120457    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 01:55:28.120613 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.120556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 01:55:28.130102 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.130083    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-25fzl"]
Jul 18 01:55:28.135802 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.135784    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l7nsd"]
Jul 18 01:55:28.138837 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.138820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.142292 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.142268    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 01:55:28.142463 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.142317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 01:55:28.142576 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.142560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2cqq9\""
Jul 18 01:55:28.142648 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.142593    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 01:55:28.228874 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.228852    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5bsd\" (UniqueName: \"kubernetes.io/projected/fef92f11-d578-4d99-a1db-a41a42c16f2b-kube-api-access-l5bsd\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.228991 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.228887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.228991 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.228913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-metrics-client-ca\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.228991 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.228938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-tls\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.228985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-sys\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-root\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.229188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229188 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.229357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.229357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-textfile\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.229357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg55h\" (UniqueName: \"kubernetes.io/projected/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-api-access-tg55h\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.229357 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.229538 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.229397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-wtmp\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330169 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg55h\" (UniqueName: \"kubernetes.io/projected/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-api-access-tg55h\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330296 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330267    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-wtmp\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330468 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5bsd\" (UniqueName: \"kubernetes.io/projected/fef92f11-d578-4d99-a1db-a41a42c16f2b-kube-api-access-l5bsd\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330468 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330468 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330440    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-wtmp\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330468 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-metrics-client-ca\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-tls\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-sys\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-root\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330619    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330687 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330985 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-root\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330985 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.330985 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-textfile\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.330985 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.330749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fef92f11-d578-4d99-a1db-a41a42c16f2b-sys\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.331215 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-metrics-client-ca\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.331215 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-textfile\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.331215 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.331624 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331601    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.331771 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331683    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.331893 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.331861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.332994 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.332968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.333140 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.333014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.333140 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.333064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.333340 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.333322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fef92f11-d578-4d99-a1db-a41a42c16f2b-node-exporter-tls\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.337327 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.337304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg55h\" (UniqueName: \"kubernetes.io/projected/fd8c0d14-075e-4a56-bc11-5f551e6c7c06-kube-api-access-tg55h\") pod \"kube-state-metrics-56c5594674-25fzl\" (UID: \"fd8c0d14-075e-4a56-bc11-5f551e6c7c06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.337432 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.337306    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5bsd\" (UniqueName: \"kubernetes.io/projected/fef92f11-d578-4d99-a1db-a41a42c16f2b-kube-api-access-l5bsd\") pod \"node-exporter-l7nsd\" (UID: \"fef92f11-d578-4d99-a1db-a41a42c16f2b\") " pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.426752 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.426706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl"
Jul 18 01:55:28.448009 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.447984    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7nsd"
Jul 18 01:55:28.459706 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:28.459683    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfef92f11_d578_4d99_a1db_a41a42c16f2b.slice/crio-3c4b548057d445229af3bee379cae3aee19e0f35806e113db22b444d797f9874 WatchSource:0}: Error finding container 3c4b548057d445229af3bee379cae3aee19e0f35806e113db22b444d797f9874: Status 404 returned error can't find the container with id 3c4b548057d445229af3bee379cae3aee19e0f35806e113db22b444d797f9874
Jul 18 01:55:28.557835 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.557707    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-25fzl"]
Jul 18 01:55:28.560205 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:28.560176    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8c0d14_075e_4a56_bc11_5f551e6c7c06.slice/crio-a5539676c9e190756540c5684906d52a9402001c62a7d80f2316ee89045318e1 WatchSource:0}: Error finding container a5539676c9e190756540c5684906d52a9402001c62a7d80f2316ee89045318e1: Status 404 returned error can't find the container with id a5539676c9e190756540c5684906d52a9402001c62a7d80f2316ee89045318e1
Jul 18 01:55:28.726722 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.726643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7nsd" event={"ID":"fef92f11-d578-4d99-a1db-a41a42c16f2b","Type":"ContainerStarted","Data":"3c4b548057d445229af3bee379cae3aee19e0f35806e113db22b444d797f9874"}
Jul 18 01:55:28.727649 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:28.727625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl" event={"ID":"fd8c0d14-075e-4a56-bc11-5f551e6c7c06","Type":"ContainerStarted","Data":"a5539676c9e190756540c5684906d52a9402001c62a7d80f2316ee89045318e1"}
Jul 18 01:55:29.102611 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:29.102527    2563 patch_prober.go:28] interesting pod/image-registry-5496595594-vfpcx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 01:55:29.102611 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:29.102599    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5496595594-vfpcx" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 01:55:29.732441 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:29.732359    2563 generic.go:356] "Generic (PLEG): container finished" podID="fef92f11-d578-4d99-a1db-a41a42c16f2b" containerID="62c34aba5c4923f4da9081640e420fcb760c50aa56b467699b74e6f137fb8432" exitCode=0
Jul 18 01:55:29.732803 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:29.732455    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7nsd" event={"ID":"fef92f11-d578-4d99-a1db-a41a42c16f2b","Type":"ContainerDied","Data":"62c34aba5c4923f4da9081640e420fcb760c50aa56b467699b74e6f137fb8432"}
Jul 18 01:55:30.737282 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.737247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7nsd" event={"ID":"fef92f11-d578-4d99-a1db-a41a42c16f2b","Type":"ContainerStarted","Data":"92d369a15cf2e00578c98ae531d1ac49aaf3ad9f874dee957a8ac830451afbc8"}
Jul 18 01:55:30.737717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.737317    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7nsd" event={"ID":"fef92f11-d578-4d99-a1db-a41a42c16f2b","Type":"ContainerStarted","Data":"657e9b2bae467c5a9ab14cfab3ab499e9ba7b62e40061996b7bf3f43fc897250"}
Jul 18 01:55:30.739204 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.739177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl" event={"ID":"fd8c0d14-075e-4a56-bc11-5f551e6c7c06","Type":"ContainerStarted","Data":"da31a84e0b7cf58c3757586f13aee58a41586f01a8410bfaf64951cd8beed285"}
Jul 18 01:55:30.739346 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.739223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl" event={"ID":"fd8c0d14-075e-4a56-bc11-5f551e6c7c06","Type":"ContainerStarted","Data":"e1f11a641275a3864ad042e5fda78de40cbe02b097a535ce7648e144839a8507"}
Jul 18 01:55:30.739346 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.739244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl" event={"ID":"fd8c0d14-075e-4a56-bc11-5f551e6c7c06","Type":"ContainerStarted","Data":"c9ddabd9a9470009e3c73cfb8928c19cebf08a09c21ff548ee98b74a8aaa51a5"}
Jul 18 01:55:30.756906 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.756883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:30.759081 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.759039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/18c83878-29b0-415d-a0d7-2c8536025616-metrics-tls\") pod \"dns-default-wq949\" (UID: \"18c83878-29b0-415d-a0d7-2c8536025616\") " pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:30.778774 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.778735    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l7nsd" podStartSLOduration=1.74055604 podStartE2EDuration="2.778719744s" totalImagesPullingTime="973.958497ms" totalInitContainerRuntime="64.205207ms" isStatefulPod=true podCreationTimestamp="2026-07-18 01:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:30.755725856 +0000 UTC m=+285.392979137" watchObservedRunningTime="2026-07-18 01:55:30.778719744 +0000 UTC m=+285.415973023"
Jul 18 01:55:30.779404 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:30.779378    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-25fzl" podStartSLOduration=1.182961974 podStartE2EDuration="2.779371271s" totalImagesPullingTime="1.596409297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:30.777964618 +0000 UTC m=+285.415217900" watchObservedRunningTime="2026-07-18 01:55:30.779371271 +0000 UTC m=+285.416624572"
Jul 18 01:55:31.028318 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.028253    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qqc6n\""
Jul 18 01:55:31.033530 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.033513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:31.092165 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.092140    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"]
Jul 18 01:55:31.097235 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.097214    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.101615 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.101510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 18 01:55:31.101615 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.101516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-91ilnbhpls02b\""
Jul 18 01:55:31.101817 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.101799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 18 01:55:31.102168 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.102148    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5sr7m\""
Jul 18 01:55:31.102420 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.102407    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 18 01:55:31.103316 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.103296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 18 01:55:31.103470 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.103451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 18 01:55:31.131240 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.131200    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"]
Jul 18 01:55:31.172876 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.172854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq949"]
Jul 18 01:55:31.174922 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:31.174893    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c83878_29b0_415d_a0d7_2c8536025616.slice/crio-22cc46002de19b40fdab17f852f102bcec8f37e235f1ebb5aeb3d2c6021d0899 WatchSource:0}: Error finding container 22cc46002de19b40fdab17f852f102bcec8f37e235f1ebb5aeb3d2c6021d0899: Status 404 returned error can't find the container with id 22cc46002de19b40fdab17f852f102bcec8f37e235f1ebb5aeb3d2c6021d0899
Jul 18 01:55:31.261990 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.261959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262123 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262123 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-grpc-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262237 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262237 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef030a-5dc6-45b5-9c14-306c478f0344-metrics-client-ca\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262237 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjg94\" (UniqueName: \"kubernetes.io/projected/c0ef030a-5dc6-45b5-9c14-306c478f0344-kube-api-access-qjg94\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262384 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.262384 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.262326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.362984 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.362965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363110 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.362992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-grpc-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363110 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363110 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363034    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef030a-5dc6-45b5-9c14-306c478f0344-metrics-client-ca\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363110 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjg94\" (UniqueName: \"kubernetes.io/projected/c0ef030a-5dc6-45b5-9c14-306c478f0344-kube-api-access-qjg94\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363307 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363307 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363307 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.363863 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.363812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef030a-5dc6-45b5-9c14-306c478f0344-metrics-client-ca\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.365695 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.365669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.365760 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.365745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.365958 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.365942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-grpc-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.366000 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.365977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.366388 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.366373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-tls\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.366429 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.366375    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef030a-5dc6-45b5-9c14-306c478f0344-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.376857 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.376835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjg94\" (UniqueName: \"kubernetes.io/projected/c0ef030a-5dc6-45b5-9c14-306c478f0344-kube-api-access-qjg94\") pod \"thanos-querier-64fc86bd87-ks6qp\" (UID: \"c0ef030a-5dc6-45b5-9c14-306c478f0344\") " pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.408706 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.408665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:31.556804 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.556777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"]
Jul 18 01:55:31.558537 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:55:31.558510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ef030a_5dc6_45b5_9c14_306c478f0344.slice/crio-06f8abb6f243215f7db9c98633e8e407575f784a5d9e93dc84aea15773eb2a3a WatchSource:0}: Error finding container 06f8abb6f243215f7db9c98633e8e407575f784a5d9e93dc84aea15773eb2a3a: Status 404 returned error can't find the container with id 06f8abb6f243215f7db9c98633e8e407575f784a5d9e93dc84aea15773eb2a3a
Jul 18 01:55:31.744729 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.744614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq949" event={"ID":"18c83878-29b0-415d-a0d7-2c8536025616","Type":"ContainerStarted","Data":"22cc46002de19b40fdab17f852f102bcec8f37e235f1ebb5aeb3d2c6021d0899"}
Jul 18 01:55:31.745958 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:31.745926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"06f8abb6f243215f7db9c98633e8e407575f784a5d9e93dc84aea15773eb2a3a"}
Jul 18 01:55:32.753915 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:32.753881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq949" event={"ID":"18c83878-29b0-415d-a0d7-2c8536025616","Type":"ContainerStarted","Data":"3fd210f4fa7f556d507a0f2ea4458c13d71478e2d1a1e7f1dddee9f57396d9b8"}
Jul 18 01:55:33.760644 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:33.760597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq949" event={"ID":"18c83878-29b0-415d-a0d7-2c8536025616","Type":"ContainerStarted","Data":"1f8f61d080d2943bcc00c1ffbe034e4a35086426e8a12bebab7555c309bbf0cc"}
Jul 18 01:55:33.760995 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:33.760669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:33.762833 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:33.762808    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"4e4e982d62919adf3f16d6df0d3d965f9e162290b4d37cee9c0a2c32f7347a99"}
Jul 18 01:55:33.762918 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:33.762882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"81b798ac91ffd220cb7a654d5876b658927a3d1a82677642226f8a29b6cd43bb"}
Jul 18 01:55:33.778138 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:33.778083    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wq949" podStartSLOduration=252.306067009 podStartE2EDuration="4m13.778063788s" totalImagesPullingTime="1.471996779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:33.777563039 +0000 UTC m=+288.414816320" watchObservedRunningTime="2026-07-18 01:55:33.778063788 +0000 UTC m=+288.415317060"
Jul 18 01:55:34.768882 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:34.768844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"f2561aae9153b3f099c54e834079706fed064d63174cd5f31f61bc79ad808cd5"}
Jul 18 01:55:35.774816 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:35.774784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"98a9ecaf6d74a9f868b9da21258cf01fca3976f6dbb55861f9c045c2e9066235"}
Jul 18 01:55:35.775209 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:35.774845    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"4af104bd7138593141fcf58baa279ed6459b12c889cc90b4119c36d2636bb2b9"}
Jul 18 01:55:35.775209 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:35.774873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" event={"ID":"c0ef030a-5dc6-45b5-9c14-306c478f0344","Type":"ContainerStarted","Data":"34d001642a9b0cca6e2a9fbb8045a72209869387b2377aa0440783ff76ca91a8"}
Jul 18 01:55:35.775209 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:35.774951    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:35.800573 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:35.800533    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp" podStartSLOduration=1.658111887 podStartE2EDuration="4.800517895s" totalImagesPullingTime="3.142406008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:55:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:55:35.799428294 +0000 UTC m=+290.436681575" watchObservedRunningTime="2026-07-18 01:55:35.800517895 +0000 UTC m=+290.437771177"
Jul 18 01:55:39.100096 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:39.100069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:41.701194 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:41.701163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b5c58b8fc-hkhmn"
Jul 18 01:55:41.787086 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:41.787040    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64fc86bd87-ks6qp"
Jul 18 01:55:41.886588 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:41.886555    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w74kq" podUID="0a8884b5-cceb-42fb-93e3-8746a84034f9"
Jul 18 01:55:43.770922 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:43.770892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wq949"
Jul 18 01:55:44.118684 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.118643    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5496595594-vfpcx" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerName="registry" containerID="cri-o://e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea" gracePeriod=30
Jul 18 01:55:44.346844 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.346822    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:44.360425 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360520 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360444    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360520 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360476    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360520 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360502    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kv5z\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360520 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360520    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360555    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.360717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.360588    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca\") pod \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\" (UID: \"9bd92d92-829c-4460-b39c-7a54db2ea7b3\") "
Jul 18 01:55:44.361167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.361110    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:55:44.361297 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.361169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:55:44.363074 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.363014    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:55:44.363224 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.363169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:55:44.363287 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.363270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:55:44.363343 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.363279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:55:44.363343 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.363290    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z" (OuterVolumeSpecName: "kube-api-access-8kv5z") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "kube-api-access-8kv5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:55:44.371729 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.371679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9bd92d92-829c-4460-b39c-7a54db2ea7b3" (UID: "9bd92d92-829c-4460-b39c-7a54db2ea7b3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:55:44.461806 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461780    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461806 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461805    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9bd92d92-829c-4460-b39c-7a54db2ea7b3-ca-trust-extracted\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461818    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-registry-certificates\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461842    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kv5z\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-kube-api-access-8kv5z\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461857    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-installation-pull-secrets\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461870    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd92d92-829c-4460-b39c-7a54db2ea7b3-bound-sa-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461883    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9bd92d92-829c-4460-b39c-7a54db2ea7b3-image-registry-private-configuration\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.461956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.461896    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9bd92d92-829c-4460-b39c-7a54db2ea7b3-trusted-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:55:44.807437 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.807381    2563 generic.go:356] "Generic (PLEG): container finished" podID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerID="e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea" exitCode=0
Jul 18 01:55:44.807437 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.807419    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5496595594-vfpcx"
Jul 18 01:55:44.807437 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.807432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5496595594-vfpcx" event={"ID":"9bd92d92-829c-4460-b39c-7a54db2ea7b3","Type":"ContainerDied","Data":"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"}
Jul 18 01:55:44.807940 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.807470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5496595594-vfpcx" event={"ID":"9bd92d92-829c-4460-b39c-7a54db2ea7b3","Type":"ContainerDied","Data":"07c22c7480b49f8f5d0c8c70994160fa02d9f4e0b27781e60ecf0d72ff6d5f8d"}
Jul 18 01:55:44.807940 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.807489    2563 scope.go:117] "RemoveContainer" containerID="e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"
Jul 18 01:55:44.816293 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.816278    2563 scope.go:117] "RemoveContainer" containerID="e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"
Jul 18 01:55:44.816525 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:55:44.816508    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea\": container with ID starting with e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea not found: ID does not exist" containerID="e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"
Jul 18 01:55:44.816573 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.816533    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea"} err="failed to get container status \"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea\": rpc error: code = NotFound desc = could not find container \"e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea\": container with ID starting with e83dc0b42cadc91238385aa0660cf1f59e48838696a7867150a8d55d1b31a5ea not found: ID does not exist"
Jul 18 01:55:44.827913 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.827887    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:55:44.831218 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:44.831200    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5496595594-vfpcx"]
Jul 18 01:55:45.732640 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:45.732615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 01:55:45.732798 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:45.732781    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 01:55:45.743317 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:45.743296    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 01:55:45.890678 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:45.890566    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" path="/var/lib/kubelet/pods/9bd92d92-829c-4460-b39c-7a54db2ea7b3/volumes"
Jul 18 01:55:53.885859 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:55:53.885813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:56:08.890162 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:08.890134    2563 generic.go:356] "Generic (PLEG): container finished" podID="37ea1718-cf0a-40f2-86f8-4b9e94fd6f17" containerID="6fc7b4099b86e594b76b0f585ea374592c6e7a01ce4c0493389b947d7708dc5c" exitCode=0
Jul 18 01:56:08.890534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:08.890201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb" event={"ID":"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17","Type":"ContainerDied","Data":"6fc7b4099b86e594b76b0f585ea374592c6e7a01ce4c0493389b947d7708dc5c"}
Jul 18 01:56:08.890534 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:08.890425    2563 scope.go:117] "RemoveContainer" containerID="6fc7b4099b86e594b76b0f585ea374592c6e7a01ce4c0493389b947d7708dc5c"
Jul 18 01:56:09.894666 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:09.894632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-pv4pb" event={"ID":"37ea1718-cf0a-40f2-86f8-4b9e94fd6f17","Type":"ContainerStarted","Data":"b637cbbaa351a3544fa080720c7beeb75ce36d0ee921812cef518ea274488268"}
Jul 18 01:56:13.907992 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:13.907958    2563 generic.go:356] "Generic (PLEG): container finished" podID="01669ad6-45a7-4e6f-bade-bd8b5f3efd00" containerID="df0073ed6410bbbbdcea732423756381786acacfe95215f16c6223456b786e1c" exitCode=0
Jul 18 01:56:13.908584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:13.908040    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xsww4" event={"ID":"01669ad6-45a7-4e6f-bade-bd8b5f3efd00","Type":"ContainerDied","Data":"df0073ed6410bbbbdcea732423756381786acacfe95215f16c6223456b786e1c"}
Jul 18 01:56:13.908584 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:13.908463    2563 scope.go:117] "RemoveContainer" containerID="df0073ed6410bbbbdcea732423756381786acacfe95215f16c6223456b786e1c"
Jul 18 01:56:14.914158 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:14.914120    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-xsww4" event={"ID":"01669ad6-45a7-4e6f-bade-bd8b5f3efd00","Type":"ContainerStarted","Data":"5f3f405300d5e3eba43e63ac61d93898ee73357002f71adc1bf0215d6bde9ed5"}
Jul 18 01:56:59.608615 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:59.608587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:56:59.610764 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:59.610742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a8884b5-cceb-42fb-93e3-8746a84034f9-metrics-certs\") pod \"network-metrics-daemon-w74kq\" (UID: \"0a8884b5-cceb-42fb-93e3-8746a84034f9\") " pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:56:59.889763 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:59.889688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rbznb\""
Jul 18 01:56:59.896907 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:56:59.896890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w74kq"
Jul 18 01:57:00.016336 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:00.016305    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w74kq"]
Jul 18 01:57:00.019147 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:57:00.019121    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8884b5_cceb_42fb_93e3_8746a84034f9.slice/crio-4c961a57658136e575e869fc5d72f605b7b56e14813d078e1dbf7785326dab5a WatchSource:0}: Error finding container 4c961a57658136e575e869fc5d72f605b7b56e14813d078e1dbf7785326dab5a: Status 404 returned error can't find the container with id 4c961a57658136e575e869fc5d72f605b7b56e14813d078e1dbf7785326dab5a
Jul 18 01:57:00.021399 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:00.021384    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 01:57:00.067031 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:00.066993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w74kq" event={"ID":"0a8884b5-cceb-42fb-93e3-8746a84034f9","Type":"ContainerStarted","Data":"4c961a57658136e575e869fc5d72f605b7b56e14813d078e1dbf7785326dab5a"}
Jul 18 01:57:01.072527 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:01.072496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w74kq" event={"ID":"0a8884b5-cceb-42fb-93e3-8746a84034f9","Type":"ContainerStarted","Data":"f1df90e932512f25a1cc0f1b9eb313d87dbaf846226758536713f0af78803957"}
Jul 18 01:57:01.072863 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:01.072549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w74kq" event={"ID":"0a8884b5-cceb-42fb-93e3-8746a84034f9","Type":"ContainerStarted","Data":"8341eb6151991b3da0d6dd1cfa65c53f3ff9840a3c6ae19a1b3bec252984f5d6"}
Jul 18 01:57:01.088999 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:01.088955    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w74kq" podStartSLOduration=374.267033194 podStartE2EDuration="6m15.088941306s" totalImagesPullingTime="821.908112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:57:01.08739057 +0000 UTC m=+375.724643851" watchObservedRunningTime="2026-07-18 01:57:01.088941306 +0000 UTC m=+375.726194587"
Jul 18 01:57:55.504342 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.504308    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"]
Jul 18 01:57:55.504825 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.504571    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerName="registry"
Jul 18 01:57:55.504825 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.504582    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerName="registry"
Jul 18 01:57:55.504825 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.504643    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd92d92-829c-4460-b39c-7a54db2ea7b3" containerName="registry"
Jul 18 01:57:55.507430 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.507414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.509976 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.509946    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 18 01:57:55.509976 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.509954    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 18 01:57:55.510192 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.509968    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6rdrv\""
Jul 18 01:57:55.516235 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.516214    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"]
Jul 18 01:57:55.590890 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.590866    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgsrf\" (UniqueName: \"kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.590986 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.590909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.590986 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.590946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.691209 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.691187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgsrf\" (UniqueName: \"kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.691307 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.691227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.691307 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.691248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.691561 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.691540    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.691618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.691567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.699265 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.699243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgsrf\" (UniqueName: \"kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.816555 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.816498    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:57:55.941868 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:55.941843    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"]
Jul 18 01:57:55.944301 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:57:55.944274    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6804dab4_7034_4756_a448_56097d4da3ba.slice/crio-8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02 WatchSource:0}: Error finding container 8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02: Status 404 returned error can't find the container with id 8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02
Jul 18 01:57:56.261558 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:57:56.261529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw" event={"ID":"6804dab4-7034-4756-a448-56097d4da3ba","Type":"ContainerStarted","Data":"8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02"}
Jul 18 01:58:02.286709 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:02.286671    2563 generic.go:356] "Generic (PLEG): container finished" podID="6804dab4-7034-4756-a448-56097d4da3ba" containerID="9b3576a077e1712865bc99780c6de88df48706ece64f1347861542fd95d1221b" exitCode=0
Jul 18 01:58:02.287210 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:02.286754    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw" event={"ID":"6804dab4-7034-4756-a448-56097d4da3ba","Type":"ContainerDied","Data":"9b3576a077e1712865bc99780c6de88df48706ece64f1347861542fd95d1221b"}
Jul 18 01:58:04.295993 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:04.295930    2563 generic.go:356] "Generic (PLEG): container finished" podID="6804dab4-7034-4756-a448-56097d4da3ba" containerID="ab0d6eb49e9645ef11c4a321e7f75df227dc623c9399b676b2144dc6a404ab1f" exitCode=0
Jul 18 01:58:04.296303 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:04.295991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw" event={"ID":"6804dab4-7034-4756-a448-56097d4da3ba","Type":"ContainerDied","Data":"ab0d6eb49e9645ef11c4a321e7f75df227dc623c9399b676b2144dc6a404ab1f"}
Jul 18 01:58:11.327449 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:11.327351    2563 generic.go:356] "Generic (PLEG): container finished" podID="6804dab4-7034-4756-a448-56097d4da3ba" containerID="8f1c4a78eb594dfa550f76362494490eb4e12bf9f53a5a5b4f68d9940836e0c6" exitCode=0
Jul 18 01:58:11.327845 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:11.327442    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw" event={"ID":"6804dab4-7034-4756-a448-56097d4da3ba","Type":"ContainerDied","Data":"8f1c4a78eb594dfa550f76362494490eb4e12bf9f53a5a5b4f68d9940836e0c6"}
Jul 18 01:58:12.450663 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.450638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:58:12.526911 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.526877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle\") pod \"6804dab4-7034-4756-a448-56097d4da3ba\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") "
Jul 18 01:58:12.527128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.526973    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgsrf\" (UniqueName: \"kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf\") pod \"6804dab4-7034-4756-a448-56097d4da3ba\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") "
Jul 18 01:58:12.527128 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.527006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util\") pod \"6804dab4-7034-4756-a448-56097d4da3ba\" (UID: \"6804dab4-7034-4756-a448-56097d4da3ba\") "
Jul 18 01:58:12.527618 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.527586    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle" (OuterVolumeSpecName: "bundle") pod "6804dab4-7034-4756-a448-56097d4da3ba" (UID: "6804dab4-7034-4756-a448-56097d4da3ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:58:12.529166 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.529139    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf" (OuterVolumeSpecName: "kube-api-access-zgsrf") pod "6804dab4-7034-4756-a448-56097d4da3ba" (UID: "6804dab4-7034-4756-a448-56097d4da3ba"). InnerVolumeSpecName "kube-api-access-zgsrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:58:12.531467 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.531448    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util" (OuterVolumeSpecName: "util") pod "6804dab4-7034-4756-a448-56097d4da3ba" (UID: "6804dab4-7034-4756-a448-56097d4da3ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:58:12.627485 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.627453    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-util\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:58:12.627485 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.627483    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6804dab4-7034-4756-a448-56097d4da3ba-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:58:12.627663 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:12.627493    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgsrf\" (UniqueName: \"kubernetes.io/projected/6804dab4-7034-4756-a448-56097d4da3ba-kube-api-access-zgsrf\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:58:13.336081 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:13.336027    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw"
Jul 18 01:58:13.336081 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:13.336065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wlrlw" event={"ID":"6804dab4-7034-4756-a448-56097d4da3ba","Type":"ContainerDied","Data":"8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02"}
Jul 18 01:58:13.336283 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:13.336107    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8709ec129b5aa61bc027911369d6ab0d3e031ddee63da7f78390fc177a766e02"
Jul 18 01:58:28.767963 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.767933    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdtj9"]
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768227    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="pull"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768239    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="pull"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768252    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="util"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768257    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="util"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768263    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="extract"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768269    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="extract"
Jul 18 01:58:28.768501 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.768312    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6804dab4-7034-4756-a448-56097d4da3ba" containerName="extract"
Jul 18 01:58:28.771543 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.771522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.773973 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.773954    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 01:58:28.774116 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.773955    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-54l92\""
Jul 18 01:58:28.775087 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.775072    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 01:58:28.777473 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.777454    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdtj9"]
Jul 18 01:58:28.843445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.843423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.843568 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.843465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vn6q\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-kube-api-access-9vn6q\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.943794 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.943765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.943891 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.943799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vn6q\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-kube-api-access-9vn6q\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.951617 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.951589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:28.951838 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:28.951817    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vn6q\" (UniqueName: \"kubernetes.io/projected/8f6b0ba0-df1d-49c2-97bd-9186150d18a8-kube-api-access-9vn6q\") pod \"cert-manager-webhook-6486ffd997-pdtj9\" (UID: \"8f6b0ba0-df1d-49c2-97bd-9186150d18a8\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:29.081280 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:29.081191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:29.204832 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:29.204806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pdtj9"]
Jul 18 01:58:29.207322 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:58:29.207294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f6b0ba0_df1d_49c2_97bd_9186150d18a8.slice/crio-cc394f8d82d7f29e4be65edf73a064a75ddf11abdc7366fa3b1c22b601901289 WatchSource:0}: Error finding container cc394f8d82d7f29e4be65edf73a064a75ddf11abdc7366fa3b1c22b601901289: Status 404 returned error can't find the container with id cc394f8d82d7f29e4be65edf73a064a75ddf11abdc7366fa3b1c22b601901289
Jul 18 01:58:29.395648 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:29.395613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9" event={"ID":"8f6b0ba0-df1d-49c2-97bd-9186150d18a8","Type":"ContainerStarted","Data":"cc394f8d82d7f29e4be65edf73a064a75ddf11abdc7366fa3b1c22b601901289"}
Jul 18 01:58:32.409078 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:32.409032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9" event={"ID":"8f6b0ba0-df1d-49c2-97bd-9186150d18a8","Type":"ContainerStarted","Data":"d4ccea214b7d688ffab4a10bc5a56293e29579c321423d0c5adf0eabc530707c"}
Jul 18 01:58:32.409426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:32.409145    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:32.426297 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:32.426249    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9" podStartSLOduration=1.731690882 podStartE2EDuration="4.426235684s" totalImagesPullingTime="2.694544802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:32.425187082 +0000 UTC m=+467.062440362" watchObservedRunningTime="2026-07-18 01:58:32.426235684 +0000 UTC m=+467.063488964"
Jul 18 01:58:38.414180 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:38.414150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pdtj9"
Jul 18 01:58:42.515393 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.515364    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tlqvb"]
Jul 18 01:58:42.517290 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.517271    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.519711 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.519686    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qp4x7\""
Jul 18 01:58:42.528394 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.528374    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tlqvb"]
Jul 18 01:58:42.643920 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.643896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-bound-sa-token\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.644011 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.643943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ln6\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-kube-api-access-w4ln6\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.744878 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.744854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-bound-sa-token\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.744951 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.744899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ln6\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-kube-api-access-w4ln6\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.752416 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.752387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-bound-sa-token\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.752498 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.752459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ln6\" (UniqueName: \"kubernetes.io/projected/731c0f19-2a34-473e-a3b5-032260f81955-kube-api-access-w4ln6\") pod \"cert-manager-55b4d954d5-tlqvb\" (UID: \"731c0f19-2a34-473e-a3b5-032260f81955\") " pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.825901 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.825844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-tlqvb"
Jul 18 01:58:42.948465 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:42.948435    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-tlqvb"]
Jul 18 01:58:42.951706 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:58:42.951681    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod731c0f19_2a34_473e_a3b5_032260f81955.slice/crio-c61852185ff3367fe35b1c1ab23e07893e210a7c8b2e1641d185c41e306bf14c WatchSource:0}: Error finding container c61852185ff3367fe35b1c1ab23e07893e210a7c8b2e1641d185c41e306bf14c: Status 404 returned error can't find the container with id c61852185ff3367fe35b1c1ab23e07893e210a7c8b2e1641d185c41e306bf14c
Jul 18 01:58:43.449427 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:43.449391    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tlqvb" event={"ID":"731c0f19-2a34-473e-a3b5-032260f81955","Type":"ContainerStarted","Data":"5ed1cab3cef75d0fb611c76bdc9cfe781f1b17af4775f5814d9f70c525468aa1"}
Jul 18 01:58:43.449564 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:43.449445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-tlqvb" event={"ID":"731c0f19-2a34-473e-a3b5-032260f81955","Type":"ContainerStarted","Data":"c61852185ff3367fe35b1c1ab23e07893e210a7c8b2e1641d185c41e306bf14c"}
Jul 18 01:58:43.464530 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:58:43.464489    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-tlqvb" podStartSLOduration=1.4644744250000001 podStartE2EDuration="1.464474425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:58:43.463095193 +0000 UTC m=+478.100348473" watchObservedRunningTime="2026-07-18 01:58:43.464474425 +0000 UTC m=+478.101727705"
Jul 18 01:59:06.249890 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.249855    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"]
Jul 18 01:59:06.252541 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.252525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.255168 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.255143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 01:59:06.255318 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.255262    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 01:59:06.255318 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.255272    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9f4g4\""
Jul 18 01:59:06.255318 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.255303    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 01:59:06.255475 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.255325    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 01:59:06.268996 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.268966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"]
Jul 18 01:59:06.302703 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.302666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.302847 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.302721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.302847 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.302797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.302939 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.302845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47mr7\" (UniqueName: \"kubernetes.io/projected/8914f158-4680-47b4-b946-d3d6c167b106-kube-api-access-47mr7\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.302939 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.302877    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.403572 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.403528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47mr7\" (UniqueName: \"kubernetes.io/projected/8914f158-4680-47b4-b946-d3d6c167b106-kube-api-access-47mr7\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.403761 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.403580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.403761 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.403633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.403761 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.403670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.403761 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.403716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.404184 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.404154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-manifests\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.405942 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.405915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8914f158-4680-47b4-b946-d3d6c167b106-tmp\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.406301 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.406280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.406346 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.406290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8914f158-4680-47b4-b946-d3d6c167b106-webhook-cert\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.411414 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.411391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47mr7\" (UniqueName: \"kubernetes.io/projected/8914f158-4680-47b4-b946-d3d6c167b106-kube-api-access-47mr7\") pod \"opendatahub-operator-controller-manager-75cddc5ddd-l2df8\" (UID: \"8914f158-4680-47b4-b946-d3d6c167b106\") " pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.565543 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.565463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:06.691327 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:06.691299    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"]
Jul 18 01:59:06.694151 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:06.694122    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8914f158_4680_47b4_b946_d3d6c167b106.slice/crio-21adc38c566fbaea522500aa3c6e02294e723e4dd004539bbdc9c03c39ec82fc WatchSource:0}: Error finding container 21adc38c566fbaea522500aa3c6e02294e723e4dd004539bbdc9c03c39ec82fc: Status 404 returned error can't find the container with id 21adc38c566fbaea522500aa3c6e02294e723e4dd004539bbdc9c03c39ec82fc
Jul 18 01:59:07.546380 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:07.546346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8" event={"ID":"8914f158-4680-47b4-b946-d3d6c167b106","Type":"ContainerStarted","Data":"21adc38c566fbaea522500aa3c6e02294e723e4dd004539bbdc9c03c39ec82fc"}
Jul 18 01:59:09.557590 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:09.557564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8" event={"ID":"8914f158-4680-47b4-b946-d3d6c167b106","Type":"ContainerStarted","Data":"0dd9f4c66d41bf3290ca321a0a8aa0344d60136121759f266adc5b8c31a75573"}
Jul 18 01:59:10.563533 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:10.563505    2563 generic.go:356] "Generic (PLEG): container finished" podID="8914f158-4680-47b4-b946-d3d6c167b106" containerID="0dd9f4c66d41bf3290ca321a0a8aa0344d60136121759f266adc5b8c31a75573" exitCode=0
Jul 18 01:59:10.563882 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:10.563587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8" event={"ID":"8914f158-4680-47b4-b946-d3d6c167b106","Type":"ContainerDied","Data":"0dd9f4c66d41bf3290ca321a0a8aa0344d60136121759f266adc5b8c31a75573"}
Jul 18 01:59:11.570519 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:11.570473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8" event={"ID":"8914f158-4680-47b4-b946-d3d6c167b106","Type":"ContainerStarted","Data":"ec5ed7743fc8c8dccfdc77884f836cd31f2c25bb397f55222948263337f7279a"}
Jul 18 01:59:11.570958 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:11.570630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:11.593806 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:11.593758    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8" podStartSLOduration=1.356920876 podStartE2EDuration="5.593743963s" totalImagesPullingTime="3.19330082s" totalInitContainerRuntime="1.043522267s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:11.592372279 +0000 UTC m=+506.229625560" watchObservedRunningTime="2026-07-18 01:59:11.593743963 +0000 UTC m=+506.230997244"
Jul 18 01:59:22.576567 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:22.576538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75cddc5ddd-l2df8"
Jul 18 01:59:25.832309 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.832262    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"]
Jul 18 01:59:25.840886 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.840860    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:25.843502 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.843478    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 01:59:25.843659 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.843632    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9hdxh\""
Jul 18 01:59:25.845632 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.845579    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 01:59:25.846351 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.845911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 01:59:25.846351 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.846168    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 01:59:25.847197 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.847143    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"]
Jul 18 01:59:25.915751 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.915720    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj4tw"]
Jul 18 01:59:25.919034 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.919012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:25.921518 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.921493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 18 01:59:25.921643 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.921598    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4z9rq\""
Jul 18 01:59:25.929721 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.929700    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj4tw"]
Jul 18 01:59:25.942342 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.942318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:25.942445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.942397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ppjt\" (UniqueName: \"kubernetes.io/projected/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-kube-api-access-8ppjt\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:25.942445 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.942434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tmp\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:25.942583 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.942563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tls-certs\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:25.942662 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:25.942645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lls2g\" (UniqueName: \"kubernetes.io/projected/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-kube-api-access-lls2g\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.043446 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.043417    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.043605 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.043461    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ppjt\" (UniqueName: \"kubernetes.io/projected/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-kube-api-access-8ppjt\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.043605 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.043480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tmp\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.043605 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.043520    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tls-certs\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.043605 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.043552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lls2g\" (UniqueName: \"kubernetes.io/projected/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-kube-api-access-lls2g\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.043605 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:59:26.043574    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 18 01:59:26.043869 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:59:26.043635    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert podName:a4f1c3a3-42bb-4d82-a658-9795c57bbee9 nodeName:}" failed. No retries permitted until 2026-07-18 01:59:26.543615277 +0000 UTC m=+521.180868543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert") pod "odh-model-controller-7998c67dc4-fj4tw" (UID: "a4f1c3a3-42bb-4d82-a658-9795c57bbee9") : secret "odh-model-controller-webhook-cert" not found
Jul 18 01:59:26.045831 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.045796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tmp\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.046170 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.046149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-tls-certs\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.051903 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.051880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lls2g\" (UniqueName: \"kubernetes.io/projected/5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f-kube-api-access-lls2g\") pod \"kube-auth-proxy-65cb7b95cb-shtwn\" (UID: \"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f\") " pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.052171 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.052148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ppjt\" (UniqueName: \"kubernetes.io/projected/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-kube-api-access-8ppjt\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.154762 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.154720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"
Jul 18 01:59:26.289984 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.289955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn"]
Jul 18 01:59:26.292650 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:26.292605    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c05c6f9_42f6_4e1d_af1a_aa86a9d7de9f.slice/crio-c6e69fa190afa9c8fd8f69850cb18a65e6691fedb9fd7c46ad78fe25019de10b WatchSource:0}: Error finding container c6e69fa190afa9c8fd8f69850cb18a65e6691fedb9fd7c46ad78fe25019de10b: Status 404 returned error can't find the container with id c6e69fa190afa9c8fd8f69850cb18a65e6691fedb9fd7c46ad78fe25019de10b
Jul 18 01:59:26.549392 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.549304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.556071 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.552422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4f1c3a3-42bb-4d82-a658-9795c57bbee9-cert\") pod \"odh-model-controller-7998c67dc4-fj4tw\" (UID: \"a4f1c3a3-42bb-4d82-a658-9795c57bbee9\") " pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.635190 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.635154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn" event={"ID":"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f","Type":"ContainerStarted","Data":"c6e69fa190afa9c8fd8f69850cb18a65e6691fedb9fd7c46ad78fe25019de10b"}
Jul 18 01:59:26.828743 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.828652    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:26.956087 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.955717    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:26.962963 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.962942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:26.970201 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.968850    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 18 01:59:26.970201 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.969183    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 01:59:26.970201 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.969394    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tk2hs\""
Jul 18 01:59:26.970201 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.969545    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 18 01:59:26.970201 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.969715    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 18 01:59:26.978246 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:26.978225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:27.028480 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.028430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-fj4tw"]
Jul 18 01:59:27.030986 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:27.030960    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f1c3a3_42bb_4d82_a658_9795c57bbee9.slice/crio-a03e1abbc3903edf47a7a3ea7114f39a9d1a2db615b7053175cbbe9bef5b0766 WatchSource:0}: Error finding container a03e1abbc3903edf47a7a3ea7114f39a9d1a2db615b7053175cbbe9bef5b0766: Status 404 returned error can't find the container with id a03e1abbc3903edf47a7a3ea7114f39a9d1a2db615b7053175cbbe9bef5b0766
Jul 18 01:59:27.054433 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054547 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054547 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054547 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054528    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh95c\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054703 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054703 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.054703 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.054658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.155952 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.155914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156142 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.155989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156142 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.156017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156142 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.156092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156142 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.156124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156304 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.156161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.156304 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.156190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh95c\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.157706 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.157677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.159589 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.159566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.159929 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.159884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.160725 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.160699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.161191 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.160884    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.164917 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.164872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh95c\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.165275 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.165086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token\") pod \"istiod-openshift-gateway-7574459656-mh4dq\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.283452 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.283410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:27.479426 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.479176    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:27.483404 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:27.483373    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e95adee_72e3_4d0e_af9d_f6352695fee0.slice/crio-d2bb4c7eb1976c31e1a636a24deb18cfd68128b43fcd2613a7a782acd2356f9d WatchSource:0}: Error finding container d2bb4c7eb1976c31e1a636a24deb18cfd68128b43fcd2613a7a782acd2356f9d: Status 404 returned error can't find the container with id d2bb4c7eb1976c31e1a636a24deb18cfd68128b43fcd2613a7a782acd2356f9d
Jul 18 01:59:27.644397 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.644288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw" event={"ID":"a4f1c3a3-42bb-4d82-a658-9795c57bbee9","Type":"ContainerStarted","Data":"a03e1abbc3903edf47a7a3ea7114f39a9d1a2db615b7053175cbbe9bef5b0766"}
Jul 18 01:59:27.649064 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:27.649018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" event={"ID":"4e95adee-72e3-4d0e-af9d-f6352695fee0","Type":"ContainerStarted","Data":"d2bb4c7eb1976c31e1a636a24deb18cfd68128b43fcd2613a7a782acd2356f9d"}
Jul 18 01:59:31.385320 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.385279    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 18 01:59:31.385690 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.385365    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 18 01:59:31.673391 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.673298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw" event={"ID":"a4f1c3a3-42bb-4d82-a658-9795c57bbee9","Type":"ContainerStarted","Data":"0813587d2108391e71c07b19d9a0a0799a67f38a486e3a6237b351fe592c2474"}
Jul 18 01:59:31.673808 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.673783    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 01:59:31.675422 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.675395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" event={"ID":"4e95adee-72e3-4d0e-af9d-f6352695fee0","Type":"ContainerStarted","Data":"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"}
Jul 18 01:59:31.675557 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.675444    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:31.677521 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.677486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn" event={"ID":"5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f","Type":"ContainerStarted","Data":"68b04e79268fb2c0349d8dc000dc422b88481df157ff07b0ab9d6aecf69e332d"}
Jul 18 01:59:31.691548 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.691498    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw" podStartSLOduration=2.339586947 podStartE2EDuration="6.691479246s" totalImagesPullingTime="4.351892299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:31.689354911 +0000 UTC m=+526.326608192" watchObservedRunningTime="2026-07-18 01:59:31.691479246 +0000 UTC m=+526.328732528"
Jul 18 01:59:31.711366 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.711325    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65cb7b95cb-shtwn" podStartSLOduration=1.634848462 podStartE2EDuration="6.711311502s" totalImagesPullingTime="5.07646304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:31.710068642 +0000 UTC m=+526.347321916" watchObservedRunningTime="2026-07-18 01:59:31.711311502 +0000 UTC m=+526.348564782"
Jul 18 01:59:31.731950 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:31.731905    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" podStartSLOduration=1.833159148 podStartE2EDuration="5.731890425s" totalImagesPullingTime="3.898731277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:31.731067939 +0000 UTC m=+526.368321213" watchObservedRunningTime="2026-07-18 01:59:31.731890425 +0000 UTC m=+526.369143705"
Jul 18 01:59:32.691350 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:32.691317    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-mh4dq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 18 01:59:32.691729 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:32.691377    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 01:59:35.690578 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:35.690552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:36.982478 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:36.982438    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b486h"]
Jul 18 01:59:36.985887 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:36.985867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.003276 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.003255    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 18 01:59:37.003403 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.003287    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gtkp6\""
Jul 18 01:59:37.003786 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.003766    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"]
Jul 18 01:59:37.006837 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.006820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.017489 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.017471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 18 01:59:37.017620 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.017599    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-dj4fs\""
Jul 18 01:59:37.026004 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.025981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b486h"]
Jul 18 01:59:37.027701 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.027676    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"]
Jul 18 01:59:37.046221 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.046197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2caf1-3b88-4904-b9fc-19bc790dd746-cert\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.046305 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.046247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbnb\" (UniqueName: \"kubernetes.io/projected/94a2caf1-3b88-4904-b9fc-19bc790dd746-kube-api-access-dfbnb\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.147410 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.147377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f941d57d-c646-4982-b3f5-e7f0f9147522-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.147533 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.147422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2caf1-3b88-4904-b9fc-19bc790dd746-cert\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.147533 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.147514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbnb\" (UniqueName: \"kubernetes.io/projected/94a2caf1-3b88-4904-b9fc-19bc790dd746-kube-api-access-dfbnb\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.147642 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.147591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk5tt\" (UniqueName: \"kubernetes.io/projected/f941d57d-c646-4982-b3f5-e7f0f9147522-kube-api-access-wk5tt\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.149844 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.149823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94a2caf1-3b88-4904-b9fc-19bc790dd746-cert\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.160873 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.160852    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbnb\" (UniqueName: \"kubernetes.io/projected/94a2caf1-3b88-4904-b9fc-19bc790dd746-kube-api-access-dfbnb\") pod \"kserve-controller-manager-d6f4b65b8-b486h\" (UID: \"94a2caf1-3b88-4904-b9fc-19bc790dd746\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.248225 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.248152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f941d57d-c646-4982-b3f5-e7f0f9147522-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.248335 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.248249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk5tt\" (UniqueName: \"kubernetes.io/projected/f941d57d-c646-4982-b3f5-e7f0f9147522-kube-api-access-wk5tt\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.250536 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.250512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f941d57d-c646-4982-b3f5-e7f0f9147522-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.257062 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.257020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk5tt\" (UniqueName: \"kubernetes.io/projected/f941d57d-c646-4982-b3f5-e7f0f9147522-kube-api-access-wk5tt\") pod \"llmisvc-controller-manager-777c6bd7d5-vc4m6\" (UID: \"f941d57d-c646-4982-b3f5-e7f0f9147522\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.297660 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.297638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:37.316961 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.316942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:37.439718 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.439691    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b486h"]
Jul 18 01:59:37.441905 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:37.441873    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a2caf1_3b88_4904_b9fc_19bc790dd746.slice/crio-a752676c7447e595897c7d19a80a1578ca3303806d4bbd3cb27c1c065e68dacf WatchSource:0}: Error finding container a752676c7447e595897c7d19a80a1578ca3303806d4bbd3cb27c1c065e68dacf: Status 404 returned error can't find the container with id a752676c7447e595897c7d19a80a1578ca3303806d4bbd3cb27c1c065e68dacf
Jul 18 01:59:37.464825 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.464806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"]
Jul 18 01:59:37.466554 ip-10-0-133-234 kubenswrapper[2563]: W0718 01:59:37.466534    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf941d57d_c646_4982_b3f5_e7f0f9147522.slice/crio-e14453a578e7ff07ee66125c5ebf73270d7e92d291715696cd59d58093ab248d WatchSource:0}: Error finding container e14453a578e7ff07ee66125c5ebf73270d7e92d291715696cd59d58093ab248d: Status 404 returned error can't find the container with id e14453a578e7ff07ee66125c5ebf73270d7e92d291715696cd59d58093ab248d
Jul 18 01:59:37.713561 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.713358    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6" event={"ID":"f941d57d-c646-4982-b3f5-e7f0f9147522","Type":"ContainerStarted","Data":"e14453a578e7ff07ee66125c5ebf73270d7e92d291715696cd59d58093ab248d"}
Jul 18 01:59:37.714911 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:37.714886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h" event={"ID":"94a2caf1-3b88-4904-b9fc-19bc790dd746","Type":"ContainerStarted","Data":"a752676c7447e595897c7d19a80a1578ca3303806d4bbd3cb27c1c065e68dacf"}
Jul 18 01:59:39.685704 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:39.685662    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:39.686150 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:39.685879    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerName="discovery" containerID="cri-o://a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0" gracePeriod=30
Jul 18 01:59:40.360769 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.360745    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:40.492957 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.492891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.492957 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.492934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.492965    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.492989    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493167 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.493122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493324 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.493165    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493408 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.493388    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh95c\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c\") pod \"4e95adee-72e3-4d0e-af9d-f6352695fee0\" (UID: \"4e95adee-72e3-4d0e-af9d-f6352695fee0\") "
Jul 18 01:59:40.493464 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.493434    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 01:59:40.493806 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.493762    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-ca-configmap\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.495717 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.495679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts" (OuterVolumeSpecName: "cacerts") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:59:40.495832 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.495717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:59:40.495907 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.495883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 01:59:40.495956 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.495933    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:59:40.496117 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.496090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs" (OuterVolumeSpecName: "local-certs") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 01:59:40.496190 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.496157    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c" (OuterVolumeSpecName: "kube-api-access-zh95c") pod "4e95adee-72e3-4d0e-af9d-f6352695fee0" (UID: "4e95adee-72e3-4d0e-af9d-f6352695fee0"). InnerVolumeSpecName "kube-api-access-zh95c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 01:59:40.594295 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594268    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e95adee-72e3-4d0e-af9d-f6352695fee0-local-certs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.594295 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594290    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh95c\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-kube-api-access-zh95c\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.594295 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594299    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-token\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.594483 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594309    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-kubeconfig\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.594483 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594317    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-cacerts\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.594483 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.594328    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e95adee-72e3-4d0e-af9d-f6352695fee0-istio-csr-dns-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 01:59:40.731029 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.730977    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h" event={"ID":"94a2caf1-3b88-4904-b9fc-19bc790dd746","Type":"ContainerStarted","Data":"9207278afbf88f8dc79e3473a06a1b3b828f4b5546637f6080628853f6241d93"}
Jul 18 01:59:40.731509 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.731114    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 01:59:40.732524 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.732492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6" event={"ID":"f941d57d-c646-4982-b3f5-e7f0f9147522","Type":"ContainerStarted","Data":"9182fbcc9966316dcf1b63658ab1378bc843f608367cb2b36fcdc1bcd3b15410"}
Jul 18 01:59:40.732660 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.732575    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 01:59:40.733997 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.733970    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerID="a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0" exitCode=0
Jul 18 01:59:40.734140 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.734061    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"
Jul 18 01:59:40.734197 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.734057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" event={"ID":"4e95adee-72e3-4d0e-af9d-f6352695fee0","Type":"ContainerDied","Data":"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"}
Jul 18 01:59:40.734197 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.734183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq" event={"ID":"4e95adee-72e3-4d0e-af9d-f6352695fee0","Type":"ContainerDied","Data":"d2bb4c7eb1976c31e1a636a24deb18cfd68128b43fcd2613a7a782acd2356f9d"}
Jul 18 01:59:40.734262 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.734208    2563 scope.go:117] "RemoveContainer" containerID="a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"
Jul 18 01:59:40.744255 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.743778    2563 scope.go:117] "RemoveContainer" containerID="a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"
Jul 18 01:59:40.744255 ip-10-0-133-234 kubenswrapper[2563]: E0718 01:59:40.744121    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0\": container with ID starting with a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0 not found: ID does not exist" containerID="a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"
Jul 18 01:59:40.744255 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.744152    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0"} err="failed to get container status \"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0\": rpc error: code = NotFound desc = could not find container \"a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0\": container with ID starting with a5853b92924bb34c465939bba6295a30c39cec98a0b04001be02b957cd3d3fe0 not found: ID does not exist"
Jul 18 01:59:40.747219 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.747175    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h" podStartSLOduration=1.979111011 podStartE2EDuration="4.747160433s" totalImagesPullingTime="2.768049422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:40.745541936 +0000 UTC m=+535.382795228" watchObservedRunningTime="2026-07-18 01:59:40.747160433 +0000 UTC m=+535.384413712"
Jul 18 01:59:40.762198 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.762163    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6" podStartSLOduration=1.965699914 podStartE2EDuration="4.762151473s" totalImagesPullingTime="2.796451559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:59:40.760672809 +0000 UTC m=+535.397926088" watchObservedRunningTime="2026-07-18 01:59:40.762151473 +0000 UTC m=+535.399404752"
Jul 18 01:59:40.775721 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.775697    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:40.779109 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:40.779090    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mh4dq"]
Jul 18 01:59:41.891292 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:41.891260    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" path="/var/lib/kubelet/pods/4e95adee-72e3-4d0e-af9d-f6352695fee0/volumes"
Jul 18 01:59:42.692151 ip-10-0-133-234 kubenswrapper[2563]: I0718 01:59:42.692117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-fj4tw"
Jul 18 02:00:11.741065 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:11.741012    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vc4m6"
Jul 18 02:00:11.744142 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:11.744122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b486h"
Jul 18 02:00:26.587169 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.587136    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:26.587525 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.587441    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerName="discovery"
Jul 18 02:00:26.587525 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.587452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerName="discovery"
Jul 18 02:00:26.587525 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.587517    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e95adee-72e3-4d0e-af9d-f6352695fee0" containerName="discovery"
Jul 18 02:00:26.591838 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.591819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:26.594530 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.594491    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-kbqtr\""
Jul 18 02:00:26.595689 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.595663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 02:00:26.595797 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.595705    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 02:00:26.599255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.599231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:26.634530 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.634505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhz28\" (UniqueName: \"kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28\") pod \"kuadrant-operator-catalog-fqbq4\" (UID: \"6c4ea1aa-b768-4d2e-be04-6084f290d506\") " pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:26.735070 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.735018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhz28\" (UniqueName: \"kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28\") pod \"kuadrant-operator-catalog-fqbq4\" (UID: \"6c4ea1aa-b768-4d2e-be04-6084f290d506\") " pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:26.742636 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.742617    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhz28\" (UniqueName: \"kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28\") pod \"kuadrant-operator-catalog-fqbq4\" (UID: \"6c4ea1aa-b768-4d2e-be04-6084f290d506\") " pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:26.903713 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.903691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:26.956126 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:26.956100    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:27.030106 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.028092    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:27.034072 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:27.034032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4ea1aa_b768_4d2e_be04_6084f290d506.slice/crio-1ec8cc20f4637d49648c5bd8566779038095391c3070e6a069ea5c9f6b10cd4f WatchSource:0}: Error finding container 1ec8cc20f4637d49648c5bd8566779038095391c3070e6a069ea5c9f6b10cd4f: Status 404 returned error can't find the container with id 1ec8cc20f4637d49648c5bd8566779038095391c3070e6a069ea5c9f6b10cd4f
Jul 18 02:00:27.161436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.161382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjqkq"]
Jul 18 02:00:27.164142 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.164126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:27.172956 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.172928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjqkq"]
Jul 18 02:00:27.238301 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.238279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp2z2\" (UniqueName: \"kubernetes.io/projected/86a67634-49ea-41d4-9c62-2d60270f35df-kube-api-access-kp2z2\") pod \"kuadrant-operator-catalog-qjqkq\" (UID: \"86a67634-49ea-41d4-9c62-2d60270f35df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:27.339615 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.339592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp2z2\" (UniqueName: \"kubernetes.io/projected/86a67634-49ea-41d4-9c62-2d60270f35df-kube-api-access-kp2z2\") pod \"kuadrant-operator-catalog-qjqkq\" (UID: \"86a67634-49ea-41d4-9c62-2d60270f35df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:27.347313 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.347290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp2z2\" (UniqueName: \"kubernetes.io/projected/86a67634-49ea-41d4-9c62-2d60270f35df-kube-api-access-kp2z2\") pod \"kuadrant-operator-catalog-qjqkq\" (UID: \"86a67634-49ea-41d4-9c62-2d60270f35df\") " pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:27.474568 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.474504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:27.600182 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.600150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qjqkq"]
Jul 18 02:00:27.602578 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:27.602549    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a67634_49ea_41d4_9c62_2d60270f35df.slice/crio-998f29e1045575e883f893d08af293893cf3ec7a4cb39754548af9bd6dc53ad9 WatchSource:0}: Error finding container 998f29e1045575e883f893d08af293893cf3ec7a4cb39754548af9bd6dc53ad9: Status 404 returned error can't find the container with id 998f29e1045575e883f893d08af293893cf3ec7a4cb39754548af9bd6dc53ad9
Jul 18 02:00:27.940019 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.939978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" event={"ID":"6c4ea1aa-b768-4d2e-be04-6084f290d506","Type":"ContainerStarted","Data":"1ec8cc20f4637d49648c5bd8566779038095391c3070e6a069ea5c9f6b10cd4f"}
Jul 18 02:00:27.941273 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:27.941244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq" event={"ID":"86a67634-49ea-41d4-9c62-2d60270f35df","Type":"ContainerStarted","Data":"998f29e1045575e883f893d08af293893cf3ec7a4cb39754548af9bd6dc53ad9"}
Jul 18 02:00:29.951685 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:29.951648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" event={"ID":"6c4ea1aa-b768-4d2e-be04-6084f290d506","Type":"ContainerStarted","Data":"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"}
Jul 18 02:00:29.952183 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:29.951700    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" podUID="6c4ea1aa-b768-4d2e-be04-6084f290d506" containerName="registry-server" containerID="cri-o://6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c" gracePeriod=2
Jul 18 02:00:29.953393 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:29.953366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq" event={"ID":"86a67634-49ea-41d4-9c62-2d60270f35df","Type":"ContainerStarted","Data":"49ce53a39368d8125269a7f4ac48dd538e61de6b83c08d0c725068865fa65778"}
Jul 18 02:00:29.966568 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:29.966529    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" podStartSLOduration=1.8664696649999999 podStartE2EDuration="3.96651499s" totalImagesPullingTime="2.100045325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:00:29.966192418 +0000 UTC m=+584.603445699" watchObservedRunningTime="2026-07-18 02:00:29.96651499 +0000 UTC m=+584.603768280"
Jul 18 02:00:29.980925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:29.980888    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq" podStartSLOduration=1.4487559509999999 podStartE2EDuration="2.980873776s" totalImagesPullingTime="1.532117825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:00:29.979560436 +0000 UTC m=+584.616813717" watchObservedRunningTime="2026-07-18 02:00:29.980873776 +0000 UTC m=+584.618127056"
Jul 18 02:00:30.196528 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.196505    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:30.266767 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.266700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhz28\" (UniqueName: \"kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28\") pod \"6c4ea1aa-b768-4d2e-be04-6084f290d506\" (UID: \"6c4ea1aa-b768-4d2e-be04-6084f290d506\") "
Jul 18 02:00:30.268714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.268686    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28" (OuterVolumeSpecName: "kube-api-access-nhz28") pod "6c4ea1aa-b768-4d2e-be04-6084f290d506" (UID: "6c4ea1aa-b768-4d2e-be04-6084f290d506"). InnerVolumeSpecName "kube-api-access-nhz28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:30.367286 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.367262    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhz28\" (UniqueName: \"kubernetes.io/projected/6c4ea1aa-b768-4d2e-be04-6084f290d506-kube-api-access-nhz28\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:30.958825 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.958796    2563 generic.go:356] "Generic (PLEG): container finished" podID="6c4ea1aa-b768-4d2e-be04-6084f290d506" containerID="6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c" exitCode=0
Jul 18 02:00:30.959196 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.958837    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4"
Jul 18 02:00:30.959196 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.958883    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" event={"ID":"6c4ea1aa-b768-4d2e-be04-6084f290d506","Type":"ContainerDied","Data":"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"}
Jul 18 02:00:30.959196 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.958930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fqbq4" event={"ID":"6c4ea1aa-b768-4d2e-be04-6084f290d506","Type":"ContainerDied","Data":"1ec8cc20f4637d49648c5bd8566779038095391c3070e6a069ea5c9f6b10cd4f"}
Jul 18 02:00:30.959196 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.958955    2563 scope.go:117] "RemoveContainer" containerID="6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"
Jul 18 02:00:30.967906 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.967891    2563 scope.go:117] "RemoveContainer" containerID="6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"
Jul 18 02:00:30.968191 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:00:30.968173    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c\": container with ID starting with 6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c not found: ID does not exist" containerID="6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"
Jul 18 02:00:30.968263 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.968198    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c"} err="failed to get container status \"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c\": rpc error: code = NotFound desc = could not find container \"6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c\": container with ID starting with 6d5501877caee585ebaeec46e750e298589283b164cf2952d72e507ce5db273c not found: ID does not exist"
Jul 18 02:00:30.979066 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.979032    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:30.983019 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:30.983000    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fqbq4"]
Jul 18 02:00:31.890909 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:31.890867    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c4ea1aa-b768-4d2e-be04-6084f290d506" path="/var/lib/kubelet/pods/6c4ea1aa-b768-4d2e-be04-6084f290d506/volumes"
Jul 18 02:00:37.475202 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:37.475155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:37.475631 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:37.475233    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:37.497452 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:37.497429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:38.009567 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:38.009537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qjqkq"
Jul 18 02:00:42.194119 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.194085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"]
Jul 18 02:00:42.194496 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.194400    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c4ea1aa-b768-4d2e-be04-6084f290d506" containerName="registry-server"
Jul 18 02:00:42.194496 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.194411    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c4ea1aa-b768-4d2e-be04-6084f290d506" containerName="registry-server"
Jul 18 02:00:42.194496 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.194460    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c4ea1aa-b768-4d2e-be04-6084f290d506" containerName="registry-server"
Jul 18 02:00:42.197460 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.197440    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.199883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.199864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4h5xr\""
Jul 18 02:00:42.204876 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.204846    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"]
Jul 18 02:00:42.257437 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.257412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.257546 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.257445    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.257546 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.257517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cfrf\" (UniqueName: \"kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.358830 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.358809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cfrf\" (UniqueName: \"kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.358988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.358876    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.358988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.358910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.359277 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.359258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.359336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.359290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.366330 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.366312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cfrf\" (UniqueName: \"kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.507017 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.506967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:42.595268 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.595234    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"]
Jul 18 02:00:42.599119 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.599091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.610659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.609635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"]
Jul 18 02:00:42.636423 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.636400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"]
Jul 18 02:00:42.638972 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:42.638941    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672ba340_c882_4a4b_9351_74aa852164b5.slice/crio-cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e WatchSource:0}: Error finding container cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e: Status 404 returned error can't find the container with id cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e
Jul 18 02:00:42.661569 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.661543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8l7x\" (UniqueName: \"kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.661652 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.661591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.661652 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.661608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.763070 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.762994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8l7x\" (UniqueName: \"kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.763070 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.763066    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.763212 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.763087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.763452 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.763435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.763491 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.763442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.771039 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.771015    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8l7x\" (UniqueName: \"kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.911538 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.911518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:42.992579 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.992556    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"]
Jul 18 02:00:42.996673 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:42.996650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.004364 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.004334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"]
Jul 18 02:00:43.013717 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.013646    2563 generic.go:356] "Generic (PLEG): container finished" podID="672ba340-c882-4a4b-9351-74aa852164b5" containerID="3c9f9f19c7b7abb38610c80e12603c864a2e307f05005ac204469fca65c2fc35" exitCode=0
Jul 18 02:00:43.013717 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.013689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj" event={"ID":"672ba340-c882-4a4b-9351-74aa852164b5","Type":"ContainerDied","Data":"3c9f9f19c7b7abb38610c80e12603c864a2e307f05005ac204469fca65c2fc35"}
Jul 18 02:00:43.013890 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.013723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj" event={"ID":"672ba340-c882-4a4b-9351-74aa852164b5","Type":"ContainerStarted","Data":"cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e"}
Jul 18 02:00:43.044923 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.044900    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"]
Jul 18 02:00:43.047990 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:43.047965    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae15a262_58ba_4846_a6e5_5d04728131af.slice/crio-5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8 WatchSource:0}: Error finding container 5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8: Status 404 returned error can't find the container with id 5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8
Jul 18 02:00:43.066122 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.066100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq955\" (UniqueName: \"kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.066205 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.066144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.066205 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.066195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.167120 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.167090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq955\" (UniqueName: \"kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.167228 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.167155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.167228 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.167187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.167540 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.167517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.167605 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.167547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.175554 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.175527    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq955\" (UniqueName: \"kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.307463 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.307417    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:43.394627 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.394576    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"]
Jul 18 02:00:43.398564 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.398543    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.406355 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.406289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"]
Jul 18 02:00:43.438796 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.438771    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"]
Jul 18 02:00:43.470802 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.470774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.470914 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.470827    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.470914 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.470900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ws8\" (UniqueName: \"kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.518660 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:43.518634    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9985899c_708a_4b2b_b732_dcd46aa61448.slice/crio-86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9 WatchSource:0}: Error finding container 86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9: Status 404 returned error can't find the container with id 86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9
Jul 18 02:00:43.571420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.571388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.571507 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.571462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ws8\" (UniqueName: \"kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.571559 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.571525    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.571862 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.571822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.571862 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.571848    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.579332 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.579313    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ws8\" (UniqueName: \"kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.712663 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.712633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:43.837966 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:43.837939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"]
Jul 18 02:00:43.839728 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:43.839694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cf3313_c598_4e1a_a6e3_cede43d6efcf.slice/crio-603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782 WatchSource:0}: Error finding container 603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782: Status 404 returned error can't find the container with id 603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782
Jul 18 02:00:44.020252 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.020222    2563 generic.go:356] "Generic (PLEG): container finished" podID="672ba340-c882-4a4b-9351-74aa852164b5" containerID="69eaf54db5256dff8695a1e0c31eb09ea70e198e5b2f8904a7e3ac7e37d5cb95" exitCode=0
Jul 18 02:00:44.020360 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.020312    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj" event={"ID":"672ba340-c882-4a4b-9351-74aa852164b5","Type":"ContainerDied","Data":"69eaf54db5256dff8695a1e0c31eb09ea70e198e5b2f8904a7e3ac7e37d5cb95"}
Jul 18 02:00:44.021904 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.021882    2563 generic.go:356] "Generic (PLEG): container finished" podID="9985899c-708a-4b2b-b732-dcd46aa61448" containerID="fae7835e640de00df8953ae54ba89562c5fe477bac8386e5113ec5d6bacdfed2" exitCode=0
Jul 18 02:00:44.021982 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.021955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s" event={"ID":"9985899c-708a-4b2b-b732-dcd46aa61448","Type":"ContainerDied","Data":"fae7835e640de00df8953ae54ba89562c5fe477bac8386e5113ec5d6bacdfed2"}
Jul 18 02:00:44.022075 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.022001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s" event={"ID":"9985899c-708a-4b2b-b732-dcd46aa61448","Type":"ContainerStarted","Data":"86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9"}
Jul 18 02:00:44.023488 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.023470    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae15a262-58ba-4846-a6e5-5d04728131af" containerID="c195eae1b165c7d4a6f9ced6e94a02839c022c1a104a28496e4e7471982dfc28" exitCode=0
Jul 18 02:00:44.023593 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.023554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl" event={"ID":"ae15a262-58ba-4846-a6e5-5d04728131af","Type":"ContainerDied","Data":"c195eae1b165c7d4a6f9ced6e94a02839c022c1a104a28496e4e7471982dfc28"}
Jul 18 02:00:44.023659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.023604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl" event={"ID":"ae15a262-58ba-4846-a6e5-5d04728131af","Type":"ContainerStarted","Data":"5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8"}
Jul 18 02:00:44.025300 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.025276    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerID="69022b1a79300726fb2588b31744a1e43f87a0a7a7e52acdc1072457b3973492" exitCode=0
Jul 18 02:00:44.025402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.025323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw" event={"ID":"b5cf3313-c598-4e1a-a6e3-cede43d6efcf","Type":"ContainerDied","Data":"69022b1a79300726fb2588b31744a1e43f87a0a7a7e52acdc1072457b3973492"}
Jul 18 02:00:44.025402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:44.025354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw" event={"ID":"b5cf3313-c598-4e1a-a6e3-cede43d6efcf","Type":"ContainerStarted","Data":"603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782"}
Jul 18 02:00:45.031261 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.031237    2563 generic.go:356] "Generic (PLEG): container finished" podID="9985899c-708a-4b2b-b732-dcd46aa61448" containerID="3a866d268acb05bb36ab1e88c73af368212ec8b2bbf9e4659c1927bf65ccee19" exitCode=0
Jul 18 02:00:45.031586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.031308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s" event={"ID":"9985899c-708a-4b2b-b732-dcd46aa61448","Type":"ContainerDied","Data":"3a866d268acb05bb36ab1e88c73af368212ec8b2bbf9e4659c1927bf65ccee19"}
Jul 18 02:00:45.033233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.033209    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae15a262-58ba-4846-a6e5-5d04728131af" containerID="0a0b22839f7306bacd908da355d4094f6dcd319eeab9f5468d4c568bea91aad5" exitCode=0
Jul 18 02:00:45.033338 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.033287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl" event={"ID":"ae15a262-58ba-4846-a6e5-5d04728131af","Type":"ContainerDied","Data":"0a0b22839f7306bacd908da355d4094f6dcd319eeab9f5468d4c568bea91aad5"}
Jul 18 02:00:45.035182 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.035162    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerID="f822f9a0cf5e170309878e6173dbaaf55e96989131e2f65013bd5196b68cded1" exitCode=0
Jul 18 02:00:45.035279 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.035236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw" event={"ID":"b5cf3313-c598-4e1a-a6e3-cede43d6efcf","Type":"ContainerDied","Data":"f822f9a0cf5e170309878e6173dbaaf55e96989131e2f65013bd5196b68cded1"}
Jul 18 02:00:45.037554 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.037531    2563 generic.go:356] "Generic (PLEG): container finished" podID="672ba340-c882-4a4b-9351-74aa852164b5" containerID="3df66be53a6cf2eaa3ec3b5d3b07bb570a55b33c2fd4a283e91a2d4cc5442b75" exitCode=0
Jul 18 02:00:45.037658 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.037572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj" event={"ID":"672ba340-c882-4a4b-9351-74aa852164b5","Type":"ContainerDied","Data":"3df66be53a6cf2eaa3ec3b5d3b07bb570a55b33c2fd4a283e91a2d4cc5442b75"}
Jul 18 02:00:45.774822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.774800    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:00:45.775115 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:45.775097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:00:46.043995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.043837    2563 generic.go:356] "Generic (PLEG): container finished" podID="9985899c-708a-4b2b-b732-dcd46aa61448" containerID="aa7699437424e8d53a2ae924c721c83986a7f25443bf305e77c07fe7fdf35f0d" exitCode=0
Jul 18 02:00:46.043995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.043914    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s" event={"ID":"9985899c-708a-4b2b-b732-dcd46aa61448","Type":"ContainerDied","Data":"aa7699437424e8d53a2ae924c721c83986a7f25443bf305e77c07fe7fdf35f0d"}
Jul 18 02:00:46.074828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.045912    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae15a262-58ba-4846-a6e5-5d04728131af" containerID="f1a9988c5373abe0930c79aac9d7dc8ff70a84c37235a36041b4bd09b6ec0198" exitCode=0
Jul 18 02:00:46.074828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.045988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl" event={"ID":"ae15a262-58ba-4846-a6e5-5d04728131af","Type":"ContainerDied","Data":"f1a9988c5373abe0930c79aac9d7dc8ff70a84c37235a36041b4bd09b6ec0198"}
Jul 18 02:00:46.074828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.048164    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerID="baaa48bcce353f656fccdbdae175a9cb4c3db91a17babe7996891fbb0ee84884" exitCode=0
Jul 18 02:00:46.074828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.048238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw" event={"ID":"b5cf3313-c598-4e1a-a6e3-cede43d6efcf","Type":"ContainerDied","Data":"baaa48bcce353f656fccdbdae175a9cb4c3db91a17babe7996891fbb0ee84884"}
Jul 18 02:00:46.175036 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.175012    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:46.293110 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.293082    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util\") pod \"672ba340-c882-4a4b-9351-74aa852164b5\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") "
Jul 18 02:00:46.293291 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.293164    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cfrf\" (UniqueName: \"kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf\") pod \"672ba340-c882-4a4b-9351-74aa852164b5\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") "
Jul 18 02:00:46.293291 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.293225    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle\") pod \"672ba340-c882-4a4b-9351-74aa852164b5\" (UID: \"672ba340-c882-4a4b-9351-74aa852164b5\") "
Jul 18 02:00:46.293698 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.293674    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle" (OuterVolumeSpecName: "bundle") pod "672ba340-c882-4a4b-9351-74aa852164b5" (UID: "672ba340-c882-4a4b-9351-74aa852164b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:46.295304 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.295255    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf" (OuterVolumeSpecName: "kube-api-access-4cfrf") pod "672ba340-c882-4a4b-9351-74aa852164b5" (UID: "672ba340-c882-4a4b-9351-74aa852164b5"). InnerVolumeSpecName "kube-api-access-4cfrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:46.298899 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.298880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util" (OuterVolumeSpecName: "util") pod "672ba340-c882-4a4b-9351-74aa852164b5" (UID: "672ba340-c882-4a4b-9351-74aa852164b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:46.394243 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.394216    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:46.394243 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.394239    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/672ba340-c882-4a4b-9351-74aa852164b5-util\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:46.394377 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:46.394248    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cfrf\" (UniqueName: \"kubernetes.io/projected/672ba340-c882-4a4b-9351-74aa852164b5-kube-api-access-4cfrf\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.054102 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.054073    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj"
Jul 18 02:00:47.054102 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.054092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj" event={"ID":"672ba340-c882-4a4b-9351-74aa852164b5","Type":"ContainerDied","Data":"cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e"}
Jul 18 02:00:47.054499 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.054146    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc536cae6b29e7afa568ac6e9336bce201f44d026911d0156852d47e2f5bcf2e"
Jul 18 02:00:47.200583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.200559    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:47.246818 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.246796    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:47.249807 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.249787    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:47.301660 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util\") pod \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") "
Jul 18 02:00:47.301783 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle\") pod \"ae15a262-58ba-4846-a6e5-5d04728131af\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") "
Jul 18 02:00:47.301783 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util\") pod \"9985899c-708a-4b2b-b732-dcd46aa61448\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") "
Jul 18 02:00:47.301783 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5ws8\" (UniqueName: \"kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8\") pod \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") "
Jul 18 02:00:47.301783 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301753    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq955\" (UniqueName: \"kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955\") pod \"9985899c-708a-4b2b-b732-dcd46aa61448\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") "
Jul 18 02:00:47.302006 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle\") pod \"9985899c-708a-4b2b-b732-dcd46aa61448\" (UID: \"9985899c-708a-4b2b-b732-dcd46aa61448\") "
Jul 18 02:00:47.302006 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8l7x\" (UniqueName: \"kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x\") pod \"ae15a262-58ba-4846-a6e5-5d04728131af\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") "
Jul 18 02:00:47.302006 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301861    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle\") pod \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\" (UID: \"b5cf3313-c598-4e1a-a6e3-cede43d6efcf\") "
Jul 18 02:00:47.302006 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.301903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util\") pod \"ae15a262-58ba-4846-a6e5-5d04728131af\" (UID: \"ae15a262-58ba-4846-a6e5-5d04728131af\") "
Jul 18 02:00:47.302694 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.302457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle" (OuterVolumeSpecName: "bundle") pod "b5cf3313-c598-4e1a-a6e3-cede43d6efcf" (UID: "b5cf3313-c598-4e1a-a6e3-cede43d6efcf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.303164 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.303139    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle" (OuterVolumeSpecName: "bundle") pod "9985899c-708a-4b2b-b732-dcd46aa61448" (UID: "9985899c-708a-4b2b-b732-dcd46aa61448"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.303620 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.303584    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle" (OuterVolumeSpecName: "bundle") pod "ae15a262-58ba-4846-a6e5-5d04728131af" (UID: "ae15a262-58ba-4846-a6e5-5d04728131af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.304144 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.304092    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8" (OuterVolumeSpecName: "kube-api-access-n5ws8") pod "b5cf3313-c598-4e1a-a6e3-cede43d6efcf" (UID: "b5cf3313-c598-4e1a-a6e3-cede43d6efcf"). InnerVolumeSpecName "kube-api-access-n5ws8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:47.304237 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.304221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955" (OuterVolumeSpecName: "kube-api-access-hq955") pod "9985899c-708a-4b2b-b732-dcd46aa61448" (UID: "9985899c-708a-4b2b-b732-dcd46aa61448"). InnerVolumeSpecName "kube-api-access-hq955". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:47.304338 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.304313    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x" (OuterVolumeSpecName: "kube-api-access-r8l7x") pod "ae15a262-58ba-4846-a6e5-5d04728131af" (UID: "ae15a262-58ba-4846-a6e5-5d04728131af"). InnerVolumeSpecName "kube-api-access-r8l7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:00:47.307983 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.307948    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util" (OuterVolumeSpecName: "util") pod "9985899c-708a-4b2b-b732-dcd46aa61448" (UID: "9985899c-708a-4b2b-b732-dcd46aa61448"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.308558 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.308539    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util" (OuterVolumeSpecName: "util") pod "b5cf3313-c598-4e1a-a6e3-cede43d6efcf" (UID: "b5cf3313-c598-4e1a-a6e3-cede43d6efcf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.308655 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.308636    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util" (OuterVolumeSpecName: "util") pod "ae15a262-58ba-4846-a6e5-5d04728131af" (UID: "ae15a262-58ba-4846-a6e5-5d04728131af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:00:47.403375 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403352    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq955\" (UniqueName: \"kubernetes.io/projected/9985899c-708a-4b2b-b732-dcd46aa61448-kube-api-access-hq955\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403375 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403372    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403381    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8l7x\" (UniqueName: \"kubernetes.io/projected/ae15a262-58ba-4846-a6e5-5d04728131af-kube-api-access-r8l7x\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403402    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403410    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-util\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403417    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-util\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403424    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae15a262-58ba-4846-a6e5-5d04728131af-bundle\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403431    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9985899c-708a-4b2b-b732-dcd46aa61448-util\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:47.403481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:47.403438    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5ws8\" (UniqueName: \"kubernetes.io/projected/b5cf3313-c598-4e1a-a6e3-cede43d6efcf-kube-api-access-n5ws8\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:00:48.060820 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.060792    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw"
Jul 18 02:00:48.060820 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.060805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw" event={"ID":"b5cf3313-c598-4e1a-a6e3-cede43d6efcf","Type":"ContainerDied","Data":"603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782"}
Jul 18 02:00:48.061289 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.060854    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="603044743cd4e869358696cff499361716cf9217ea1945d3d75d1042cd83e782"
Jul 18 02:00:48.062846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.062797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s" event={"ID":"9985899c-708a-4b2b-b732-dcd46aa61448","Type":"ContainerDied","Data":"86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9"}
Jul 18 02:00:48.062846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.062837    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86a23b367f3907ff8d10b56c750093973094f25eb59e97914de541ce0561a4c9"
Jul 18 02:00:48.062846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.062841    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s"
Jul 18 02:00:48.065098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.065077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl" event={"ID":"ae15a262-58ba-4846-a6e5-5d04728131af","Type":"ContainerDied","Data":"5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8"}
Jul 18 02:00:48.065201 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.065107    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e2125814737b250cb0cf294a4bdb6da4912a3c0f1a740a07286cef1a4d8bca8"
Jul 18 02:00:48.065273 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:48.065208    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl"
Jul 18 02:00:53.145936 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.145897    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"]
Jul 18 02:00:53.146426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146393    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="util"
Jul 18 02:00:53.146426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146412    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="util"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146429    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="util"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146437    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="util"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146452    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="extract"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146462    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="extract"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146473    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="pull"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146481    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="pull"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146490    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="util"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146498    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="util"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146508    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="extract"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="extract"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146528    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="pull"
Jul 18 02:00:53.146542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146536    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="pull"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146551    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="pull"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146559    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="pull"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146580    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="util"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146589    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="util"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146598    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146606    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146622    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="pull"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146630    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="pull"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146640    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146647    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146727    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5cf3313-c598-4e1a-a6e3-cede43d6efcf" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146739    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="672ba340-c882-4a4b-9351-74aa852164b5" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146747    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae15a262-58ba-4846-a6e5-5d04728131af" containerName="extract"
Jul 18 02:00:53.147114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.146757    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9985899c-708a-4b2b-b732-dcd46aa61448" containerName="extract"
Jul 18 02:00:53.151218 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.151197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:53.154468 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.154447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dltxj\""
Jul 18 02:00:53.169624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.169602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"]
Jul 18 02:00:53.248739 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.248712    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4qdc\" (UniqueName: \"kubernetes.io/projected/09e03a04-7255-48d5-9dd0-a07c1eacf0a6-kube-api-access-s4qdc\") pod \"authorino-operator-75cc8d5cb7-vqztv\" (UID: \"09e03a04-7255-48d5-9dd0-a07c1eacf0a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:53.349955 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.349931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4qdc\" (UniqueName: \"kubernetes.io/projected/09e03a04-7255-48d5-9dd0-a07c1eacf0a6-kube-api-access-s4qdc\") pod \"authorino-operator-75cc8d5cb7-vqztv\" (UID: \"09e03a04-7255-48d5-9dd0-a07c1eacf0a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:53.359082 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.359037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4qdc\" (UniqueName: \"kubernetes.io/projected/09e03a04-7255-48d5-9dd0-a07c1eacf0a6-kube-api-access-s4qdc\") pod \"authorino-operator-75cc8d5cb7-vqztv\" (UID: \"09e03a04-7255-48d5-9dd0-a07c1eacf0a6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:53.460822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.460768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:53.591870 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:53.591835    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"]
Jul 18 02:00:53.594084 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:53.594039    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e03a04_7255_48d5_9dd0_a07c1eacf0a6.slice/crio-d942d988e1c9c104ad5b12b5acbd2a37db5b9798f5103dff2a6bd8ba49c5d727 WatchSource:0}: Error finding container d942d988e1c9c104ad5b12b5acbd2a37db5b9798f5103dff2a6bd8ba49c5d727: Status 404 returned error can't find the container with id d942d988e1c9c104ad5b12b5acbd2a37db5b9798f5103dff2a6bd8ba49c5d727
Jul 18 02:00:54.094215 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:54.094179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv" event={"ID":"09e03a04-7255-48d5-9dd0-a07c1eacf0a6","Type":"ContainerStarted","Data":"d942d988e1c9c104ad5b12b5acbd2a37db5b9798f5103dff2a6bd8ba49c5d727"}
Jul 18 02:00:55.954343 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:55.954310    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"]
Jul 18 02:00:55.957495 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:55.957480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:55.960015 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:55.959995    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fdg4r\""
Jul 18 02:00:55.967673 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:55.967652    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"]
Jul 18 02:00:56.075994 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.075914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xhf\" (UniqueName: \"kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf\") pod \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" (UID: \"52487a87-130a-4b6b-9f1b-f3cd457eea1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:56.106398 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.106364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv" event={"ID":"09e03a04-7255-48d5-9dd0-a07c1eacf0a6","Type":"ContainerStarted","Data":"06f6bafcc1f8a242aecacd885ed3d859176498b2e3cca0039475505aefac0da9"}
Jul 18 02:00:56.106534 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.106483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:00:56.123275 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.123234    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv" podStartSLOduration=0.911523911 podStartE2EDuration="3.123220882s" totalImagesPullingTime="2.211696971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:00:56.122474697 +0000 UTC m=+610.759727990" watchObservedRunningTime="2026-07-18 02:00:56.123220882 +0000 UTC m=+610.760474235"
Jul 18 02:00:56.176470 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.176444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xhf\" (UniqueName: \"kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf\") pod \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" (UID: \"52487a87-130a-4b6b-9f1b-f3cd457eea1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:56.185478 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.185449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xhf\" (UniqueName: \"kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf\") pod \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" (UID: \"52487a87-130a-4b6b-9f1b-f3cd457eea1d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:56.267565 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.267536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:56.394823 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:56.394797    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"]
Jul 18 02:00:56.395765 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:00:56.395741    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52487a87_130a_4b6b_9f1b_f3cd457eea1d.slice/crio-e3fb6f26906036cf1e526f4a8e5a67a1bf81b42ad540c818b3b7f5a5b14328fa WatchSource:0}: Error finding container e3fb6f26906036cf1e526f4a8e5a67a1bf81b42ad540c818b3b7f5a5b14328fa: Status 404 returned error can't find the container with id e3fb6f26906036cf1e526f4a8e5a67a1bf81b42ad540c818b3b7f5a5b14328fa
Jul 18 02:00:57.114426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:57.114388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs" event={"ID":"52487a87-130a-4b6b-9f1b-f3cd457eea1d","Type":"ContainerStarted","Data":"e3fb6f26906036cf1e526f4a8e5a67a1bf81b42ad540c818b3b7f5a5b14328fa"}
Jul 18 02:00:58.121082 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:58.121028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs" event={"ID":"52487a87-130a-4b6b-9f1b-f3cd457eea1d","Type":"ContainerStarted","Data":"17c799a217d11fbda5f95f2e99ad613e45902a41bd53281a02c50abbf8df86f8"}
Jul 18 02:00:58.121451 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:58.121163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:00:58.155471 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:58.155411    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs" podStartSLOduration=1.7729893140000001 podStartE2EDuration="3.155396731s" totalImagesPullingTime="1.382407417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:00:58.154717911 +0000 UTC m=+612.791971187" watchObservedRunningTime="2026-07-18 02:00:58.155396731 +0000 UTC m=+612.792650011"
Jul 18 02:00:59.720005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.719970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"]
Jul 18 02:00:59.724004 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.723982    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.727017 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.726993    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-glnkl\""
Jul 18 02:00:59.733286 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.733265    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"]
Jul 18 02:00:59.804990 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.804952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqcv6\" (UniqueName: \"kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.805145 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.805005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.906375 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.906343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqcv6\" (UniqueName: \"kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.906526 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.906383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.906716 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.906700    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:00:59.917848 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:00:59.917819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqcv6\" (UniqueName: \"kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:00.035941 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:00.035850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:00.168247 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:00.168167    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"]
Jul 18 02:01:00.170471 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:00.170437    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a40fc2_11ab_4ebe_9c61_78a2339995ab.slice/crio-4718dc523d1f796cc8283f700139530a4718bab0b5987c3bc103c7f8ff7ec34d WatchSource:0}: Error finding container 4718dc523d1f796cc8283f700139530a4718bab0b5987c3bc103c7f8ff7ec34d: Status 404 returned error can't find the container with id 4718dc523d1f796cc8283f700139530a4718bab0b5987c3bc103c7f8ff7ec34d
Jul 18 02:01:01.137243 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:01.137208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj" event={"ID":"24a40fc2-11ab-4ebe-9c61-78a2339995ab","Type":"ContainerStarted","Data":"4718dc523d1f796cc8283f700139530a4718bab0b5987c3bc103c7f8ff7ec34d"}
Jul 18 02:01:02.228880 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.228847    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"]
Jul 18 02:01:02.232322 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.232306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:02.234841 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.234812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bmwkm\""
Jul 18 02:01:02.234965 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.234887    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 18 02:01:02.240111 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.240080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"]
Jul 18 02:01:02.328244 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.328215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vm9d\" (UniqueName: \"kubernetes.io/projected/50ec202f-ea81-4d30-91b8-e3b9958b3dd4-kube-api-access-4vm9d\") pod \"dns-operator-controller-manager-864dd78c4c-88s8x\" (UID: \"50ec202f-ea81-4d30-91b8-e3b9958b3dd4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:02.429059 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.429019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vm9d\" (UniqueName: \"kubernetes.io/projected/50ec202f-ea81-4d30-91b8-e3b9958b3dd4-kube-api-access-4vm9d\") pod \"dns-operator-controller-manager-864dd78c4c-88s8x\" (UID: \"50ec202f-ea81-4d30-91b8-e3b9958b3dd4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:02.439204 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.439154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vm9d\" (UniqueName: \"kubernetes.io/projected/50ec202f-ea81-4d30-91b8-e3b9958b3dd4-kube-api-access-4vm9d\") pod \"dns-operator-controller-manager-864dd78c4c-88s8x\" (UID: \"50ec202f-ea81-4d30-91b8-e3b9958b3dd4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:02.543800 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.543709    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:02.699287 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:02.699257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"]
Jul 18 02:01:02.701949 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:02.701919    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ec202f_ea81_4d30_91b8_e3b9958b3dd4.slice/crio-f04c01bd99170615c451920024ee7d6dfe1d16276bc5f2a48b1770c1e799bcb9 WatchSource:0}: Error finding container f04c01bd99170615c451920024ee7d6dfe1d16276bc5f2a48b1770c1e799bcb9: Status 404 returned error can't find the container with id f04c01bd99170615c451920024ee7d6dfe1d16276bc5f2a48b1770c1e799bcb9
Jul 18 02:01:03.148644 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:03.148609    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x" event={"ID":"50ec202f-ea81-4d30-91b8-e3b9958b3dd4","Type":"ContainerStarted","Data":"f04c01bd99170615c451920024ee7d6dfe1d16276bc5f2a48b1770c1e799bcb9"}
Jul 18 02:01:05.162130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:05.162095    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj" event={"ID":"24a40fc2-11ab-4ebe-9c61-78a2339995ab","Type":"ContainerStarted","Data":"36e97d126a0efd1c1f27e46806ff7b451543d5aef63ba4da1abf3ca650920b2f"}
Jul 18 02:01:05.162593 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:05.162239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:05.188270 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:05.188223    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj" podStartSLOduration=2.262768495 podStartE2EDuration="6.188203715s" totalImagesPullingTime="3.92543522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:05.187088921 +0000 UTC m=+619.824342192" watchObservedRunningTime="2026-07-18 02:01:05.188203715 +0000 UTC m=+619.825456996"
Jul 18 02:01:06.170663 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.170627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x" event={"ID":"50ec202f-ea81-4d30-91b8-e3b9958b3dd4","Type":"ContainerStarted","Data":"891e8e99eddb172b6b0f8da932297cda0bd52c525f9e1412dc0ad4eab17b1b45"}
Jul 18 02:01:06.187944 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.187894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x" podStartSLOduration=1.712635243 podStartE2EDuration="4.187879773s" totalImagesPullingTime="2.47524453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:06.18601102 +0000 UTC m=+620.823264312" watchObservedRunningTime="2026-07-18 02:01:06.187879773 +0000 UTC m=+620.825133127"
Jul 18 02:01:06.968706 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.968672    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"]
Jul 18 02:01:06.972156 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.972113    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:06.974659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.974638    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4h5xr\""
Jul 18 02:01:06.974772 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.974657    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 18 02:01:06.974772 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.974640    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 18 02:01:06.978041 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:06.978018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"]
Jul 18 02:01:07.066508 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.066482    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5lnn\" (UniqueName: \"kubernetes.io/projected/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-kube-api-access-j5lnn\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.066639 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.066516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.066639 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.066533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.116866 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.116847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vqztv"
Jul 18 02:01:07.167794 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.167769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5lnn\" (UniqueName: \"kubernetes.io/projected/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-kube-api-access-j5lnn\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.167895 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.167803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.167895 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.167818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.168432 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.168415    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.170278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.170255    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.176439 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.176417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5lnn\" (UniqueName: \"kubernetes.io/projected/cc780088-3bfe-4c42-bfda-3fea4f2d88cf-kube-api-access-j5lnn\") pod \"kuadrant-console-plugin-66b5774985-hdrxl\" (UID: \"cc780088-3bfe-4c42-bfda-3fea4f2d88cf\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.176778 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.176761    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:07.283024 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.282971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"
Jul 18 02:01:07.409720 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:07.409695    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl"]
Jul 18 02:01:07.411344 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:07.411320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc780088_3bfe_4c42_bfda_3fea4f2d88cf.slice/crio-0cde8366fa656aa6c2ae77816f5ccb9c02f06678b49e3ece973bb615e8087295 WatchSource:0}: Error finding container 0cde8366fa656aa6c2ae77816f5ccb9c02f06678b49e3ece973bb615e8087295: Status 404 returned error can't find the container with id 0cde8366fa656aa6c2ae77816f5ccb9c02f06678b49e3ece973bb615e8087295
Jul 18 02:01:08.182351 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:08.182313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl" event={"ID":"cc780088-3bfe-4c42-bfda-3fea4f2d88cf","Type":"ContainerStarted","Data":"0cde8366fa656aa6c2ae77816f5ccb9c02f06678b49e3ece973bb615e8087295"}
Jul 18 02:01:09.128493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:09.128452    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:16.173178 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:16.173143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:17.248495 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.248462    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"]
Jul 18 02:01:17.280291 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.280258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"]
Jul 18 02:01:17.280457 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.280377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.465511 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.465472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.465687 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.465538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnx9z\" (UniqueName: \"kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.566548 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.566468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.566548 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.566516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnx9z\" (UniqueName: \"kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.566887 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.566867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.574901 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.574877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnx9z\" (UniqueName: \"kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.593749 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.593723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:17.918784 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.918745    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"]
Jul 18 02:01:17.946994 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.943121    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"]
Jul 18 02:01:17.949835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.949809    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"]
Jul 18 02:01:17.950097 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.950068    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" containerName="manager" containerID="cri-o://36e97d126a0efd1c1f27e46806ff7b451543d5aef63ba4da1abf3ca650920b2f" gracePeriod=2
Jul 18 02:01:17.952828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.952718    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:17.954265 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:17.954218    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:17.973229 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.973207    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"]
Jul 18 02:01:17.973407 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.973394    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:17.973543 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.973532    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"]
Jul 18 02:01:17.973669 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.973656    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:17.974473 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.973599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:17.974624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.974581    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" containerName="manager"
Jul 18 02:01:17.974624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.974605    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" containerName="manager"
Jul 18 02:01:17.974849 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.974823    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerName="manager" containerID="cri-o://17c799a217d11fbda5f95f2e99ad613e45902a41bd53281a02c50abbf8df86f8" gracePeriod=2
Jul 18 02:01:17.975813 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.975408    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" containerName="manager"
Jul 18 02:01:17.980383 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.979721    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"]
Jul 18 02:01:17.980383 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.979816    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:17.981300 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:17.981160    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:17.983871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.983818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:17.995395 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.995363    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"]
Jul 18 02:01:17.995870 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.995850    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerName="manager"
Jul 18 02:01:17.995974 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.995873    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerName="manager"
Jul 18 02:01:17.996070 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:17.995983    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerName="manager"
Jul 18 02:01:18.000236 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.000196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:18.012810 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.012789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"]
Jul 18 02:01:18.012998 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:18.012921    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:18.037092 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:18.037041    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:18.070714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.070683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.070837 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.070767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzh9z\" (UniqueName: \"kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.070926 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.070908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.070987 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.070948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxzr\" (UniqueName: \"kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.171402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.171402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzh9z\" (UniqueName: \"kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.171583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171423    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhkc\" (UniqueName: \"kubernetes.io/projected/f161905f-c059-4b55-a53b-775364663002-kube-api-access-glhkc\") pod \"limitador-operator-controller-manager-859d7b78bd-4ns62\" (UID: \"f161905f-c059-4b55-a53b-775364663002\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:18.171583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.171583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxzr\" (UniqueName: \"kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.171736 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.171854 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.171831    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.182596 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.182568    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzh9z\" (UniqueName: \"kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mtb4\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.184702 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.184681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-88s8x"
Jul 18 02:01:18.187283 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:18.187254    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:18.189589 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:18.189433    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:18.192791 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.192768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxzr\" (UniqueName: \"kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-966bs\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.273016 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.272980    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhkc\" (UniqueName: \"kubernetes.io/projected/f161905f-c059-4b55-a53b-775364663002-kube-api-access-glhkc\") pod \"limitador-operator-controller-manager-859d7b78bd-4ns62\" (UID: \"f161905f-c059-4b55-a53b-775364663002\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:18.282386 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.282360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhkc\" (UniqueName: \"kubernetes.io/projected/f161905f-c059-4b55-a53b-775364663002-kube-api-access-glhkc\") pod \"limitador-operator-controller-manager-859d7b78bd-4ns62\" (UID: \"f161905f-c059-4b55-a53b-775364663002\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:18.370518 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.370490    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:18.380376 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.380352    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:18.386404 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:18.386380    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:20.126540 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:20.126488    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.35:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 02:01:28.311517 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.311352    2563 generic.go:356] "Generic (PLEG): container finished" podID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" containerID="36e97d126a0efd1c1f27e46806ff7b451543d5aef63ba4da1abf3ca650920b2f" exitCode=0
Jul 18 02:01:28.314335 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.314145    2563 generic.go:356] "Generic (PLEG): container finished" podID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" containerID="17c799a217d11fbda5f95f2e99ad613e45902a41bd53281a02c50abbf8df86f8" exitCode=0
Jul 18 02:01:28.325991 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.325719    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:28.328532 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:28.328494    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:28.344426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.344322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"]
Jul 18 02:01:28.348373 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:28.348337    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf161905f_c059_4b55_a53b_775364663002.slice/crio-111dc40aea07a515144f68f633bcc830d757260b444e7ecc7fd38e7ca5ce9b9d WatchSource:0}: Error finding container 111dc40aea07a515144f68f633bcc830d757260b444e7ecc7fd38e7ca5ce9b9d: Status 404 returned error can't find the container with id 111dc40aea07a515144f68f633bcc830d757260b444e7ecc7fd38e7ca5ce9b9d
Jul 18 02:01:28.349322 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.349254    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:28.351338 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:28.351306    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:28.353191 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:28.353166    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:28.356703 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.356681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqcv6\" (UniqueName: \"kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6\") pod \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") "
Jul 18 02:01:28.356798 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.356721    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume\") pod \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\" (UID: \"24a40fc2-11ab-4ebe-9c61-78a2339995ab\") "
Jul 18 02:01:28.358122 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.357801    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "24a40fc2-11ab-4ebe-9c61-78a2339995ab" (UID: "24a40fc2-11ab-4ebe-9c61-78a2339995ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:01:28.360474 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.360446    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6" (OuterVolumeSpecName: "kube-api-access-kqcv6") pod "24a40fc2-11ab-4ebe-9c61-78a2339995ab" (UID: "24a40fc2-11ab-4ebe-9c61-78a2339995ab"). InnerVolumeSpecName "kube-api-access-kqcv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:01:28.458658 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.458635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4xhf\" (UniqueName: \"kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf\") pod \"52487a87-130a-4b6b-9f1b-f3cd457eea1d\" (UID: \"52487a87-130a-4b6b-9f1b-f3cd457eea1d\") "
Jul 18 02:01:28.458794 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.458783    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqcv6\" (UniqueName: \"kubernetes.io/projected/24a40fc2-11ab-4ebe-9c61-78a2339995ab-kube-api-access-kqcv6\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:28.458837 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.458796    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/24a40fc2-11ab-4ebe-9c61-78a2339995ab-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:28.460404 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.460385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf" (OuterVolumeSpecName: "kube-api-access-l4xhf") pod "52487a87-130a-4b6b-9f1b-f3cd457eea1d" (UID: "52487a87-130a-4b6b-9f1b-f3cd457eea1d"). InnerVolumeSpecName "kube-api-access-l4xhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:01:28.559392 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.559368    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4xhf\" (UniqueName: \"kubernetes.io/projected/52487a87-130a-4b6b-9f1b-f3cd457eea1d-kube-api-access-l4xhf\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:28.577289 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.577261    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:28.579867 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:28.579847    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:28.580370 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:28.580340    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6aff658_09ae_48c8_907f_d10a8811017e.slice/crio-f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd WatchSource:0}: Error finding container f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd: Status 404 returned error can't find the container with id f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd
Jul 18 02:01:28.581472 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:28.581445    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99218c80_936d_4457_afaf_7f90360a0169.slice/crio-1d13f92013d4237ffe713a95343626dc4a7a8bde1b1a534f76c766ff92578aca WatchSource:0}: Error finding container 1d13f92013d4237ffe713a95343626dc4a7a8bde1b1a534f76c766ff92578aca: Status 404 returned error can't find the container with id 1d13f92013d4237ffe713a95343626dc4a7a8bde1b1a534f76c766ff92578aca
Jul 18 02:01:29.326646 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.326617    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:29.326646 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.326615    2563 scope.go:117] "RemoveContainer" containerID="36e97d126a0efd1c1f27e46806ff7b451543d5aef63ba4da1abf3ca650920b2f"
Jul 18 02:01:29.328392 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.328359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl" event={"ID":"cc780088-3bfe-4c42-bfda-3fea4f2d88cf","Type":"ContainerStarted","Data":"d83b5d397545d3dda7f1e6eaebf3c2cbc842a79bb8cdd0a92a0f30f8fb1391da"}
Jul 18 02:01:29.329183 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.329152    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:29.329840 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.329820    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:29.331320 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.331293    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:29.331874 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.331787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" event={"ID":"99218c80-936d-4457-afaf-7f90360a0169","Type":"ContainerStarted","Data":"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"}
Jul 18 02:01:29.331874 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.331865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" event={"ID":"99218c80-936d-4457-afaf-7f90360a0169","Type":"ContainerStarted","Data":"1d13f92013d4237ffe713a95343626dc4a7a8bde1b1a534f76c766ff92578aca"}
Jul 18 02:01:29.332068 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.331897    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:29.333574 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.333243    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:29.334162 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.334139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" event={"ID":"b6aff658-09ae-48c8-907f-d10a8811017e","Type":"ContainerStarted","Data":"758ca9c1d5a670ff5339af3285045fec9a5cc0ac0e40b4dfa53c278d4169467d"}
Jul 18 02:01:29.334550 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.334529    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" event={"ID":"b6aff658-09ae-48c8-907f-d10a8811017e","Type":"ContainerStarted","Data":"f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd"}
Jul 18 02:01:29.334725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.334702    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:29.335398 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.335369    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:29.338396 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.337154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62" event={"ID":"f161905f-c059-4b55-a53b-775364663002","Type":"ContainerStarted","Data":"646c32dbba1808f770f46c0f68c8182f324074846f7cb2ba871a1777fb0151c0"}
Jul 18 02:01:29.338396 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.337199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62" event={"ID":"f161905f-c059-4b55-a53b-775364663002","Type":"ContainerStarted","Data":"111dc40aea07a515144f68f633bcc830d757260b444e7ecc7fd38e7ca5ce9b9d"}
Jul 18 02:01:29.338396 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.337644    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:29.340079 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.339808    2563 scope.go:117] "RemoveContainer" containerID="17c799a217d11fbda5f95f2e99ad613e45902a41bd53281a02c50abbf8df86f8"
Jul 18 02:01:29.353422 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.353383    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hdrxl" podStartSLOduration=2.498690224 podStartE2EDuration="23.353369772s" totalImagesPullingTime="20.854679548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:29.352060496 +0000 UTC m=+643.989313774" watchObservedRunningTime="2026-07-18 02:01:29.353369772 +0000 UTC m=+643.990623052"
Jul 18 02:01:29.354123 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.354095    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wgxzs\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wgxzs"
Jul 18 02:01:29.372447 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.372411    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62" podStartSLOduration=12.372375334000001 podStartE2EDuration="12.372375334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:29.371342112 +0000 UTC m=+644.008595394" watchObservedRunningTime="2026-07-18 02:01:29.372375334 +0000 UTC m=+644.009628614"
Jul 18 02:01:29.373229 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:29.373204    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g2wkj\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g2wkj"
Jul 18 02:01:29.393313 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.393278    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" podStartSLOduration=12.393266028 podStartE2EDuration="12.393266028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:29.390628918 +0000 UTC m=+644.027882200" watchObservedRunningTime="2026-07-18 02:01:29.393266028 +0000 UTC m=+644.030519307"
Jul 18 02:01:29.407032 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.406844    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" podStartSLOduration=12.406829791 podStartE2EDuration="12.406829791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:29.406589721 +0000 UTC m=+644.043843001" watchObservedRunningTime="2026-07-18 02:01:29.406829791 +0000 UTC m=+644.044083072"
Jul 18 02:01:29.892740 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.892708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a40fc2-11ab-4ebe-9c61-78a2339995ab" path="/var/lib/kubelet/pods/24a40fc2-11ab-4ebe-9c61-78a2339995ab/volumes"
Jul 18 02:01:29.893034 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:29.893021    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52487a87-130a-4b6b-9f1b-f3cd457eea1d" path="/var/lib/kubelet/pods/52487a87-130a-4b6b-9f1b-f3cd457eea1d/volumes"
Jul 18 02:01:30.711098 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:30.711057    2563 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-cmg8f_kuadrant-system_5aff1340-8cf1-44e5-910f-f01739f570d1_0(03b99316209471cb5b310b7fde8a53523ff2527231dad6ae34104cc5853987ed): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-cmg8f to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 18 02:01:30.711444 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:30.711123    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-cmg8f_kuadrant-system_5aff1340-8cf1-44e5-910f-f01739f570d1_0(03b99316209471cb5b310b7fde8a53523ff2527231dad6ae34104cc5853987ed): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-cmg8f to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:31.350031 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.349998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:31.352445 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:31.352419    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="5aff1340-8cf1-44e5-910f-f01739f570d1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:31.359422 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.359402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:31.361628 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:31.361601    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="5aff1340-8cf1-44e5-910f-f01739f570d1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:31.476998 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.476970    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnx9z\" (UniqueName: \"kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z\") pod \"5aff1340-8cf1-44e5-910f-f01739f570d1\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") "
Jul 18 02:01:31.477149 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.477006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume\") pod \"5aff1340-8cf1-44e5-910f-f01739f570d1\" (UID: \"5aff1340-8cf1-44e5-910f-f01739f570d1\") "
Jul 18 02:01:31.477326 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.477300    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5aff1340-8cf1-44e5-910f-f01739f570d1" (UID: "5aff1340-8cf1-44e5-910f-f01739f570d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:01:31.479137 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.479116    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z" (OuterVolumeSpecName: "kube-api-access-nnx9z") pod "5aff1340-8cf1-44e5-910f-f01739f570d1" (UID: "5aff1340-8cf1-44e5-910f-f01739f570d1"). InnerVolumeSpecName "kube-api-access-nnx9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:01:31.577619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.577593    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnx9z\" (UniqueName: \"kubernetes.io/projected/5aff1340-8cf1-44e5-910f-f01739f570d1-kube-api-access-nnx9z\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:31.577619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.577616    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5aff1340-8cf1-44e5-910f-f01739f570d1-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:31.891444 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:31.891408    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aff1340-8cf1-44e5-910f-f01739f570d1" path="/var/lib/kubelet/pods/5aff1340-8cf1-44e5-910f-f01739f570d1/volumes"
Jul 18 02:01:32.355500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:32.355468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:32.357814 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:32.357786    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="5aff1340-8cf1-44e5-910f-f01739f570d1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:32.359658 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:32.359636    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-cmg8f\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="5aff1340-8cf1-44e5-910f-f01739f570d1" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-cmg8f"
Jul 18 02:01:40.347105 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:40.347068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:41.351887 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.351854    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:41.352310 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.352001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4ns62"
Jul 18 02:01:41.414496 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.414454    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:41.414741 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.414709    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" podUID="99218c80-936d-4457-afaf-7f90360a0169" containerName="manager" containerID="cri-o://d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c" gracePeriod=10
Jul 18 02:01:41.626851 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.626807    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:01:41.629269 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.629245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.645459 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.645432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:01:41.654312 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.654288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68ddp\" (UniqueName: \"kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.654416 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.654342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.665020 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.664999    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:41.755472 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.755442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzh9z\" (UniqueName: \"kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z\") pod \"99218c80-936d-4457-afaf-7f90360a0169\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") "
Jul 18 02:01:41.755659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.755515    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume\") pod \"99218c80-936d-4457-afaf-7f90360a0169\" (UID: \"99218c80-936d-4457-afaf-7f90360a0169\") "
Jul 18 02:01:41.755725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.755665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.755787 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.755772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68ddp\" (UniqueName: \"kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.755907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.755882    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99218c80-936d-4457-afaf-7f90360a0169" (UID: "99218c80-936d-4457-afaf-7f90360a0169"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:01:41.756075 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.756020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.757484 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.757460    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z" (OuterVolumeSpecName: "kube-api-access-tzh9z") pod "99218c80-936d-4457-afaf-7f90360a0169" (UID: "99218c80-936d-4457-afaf-7f90360a0169"). InnerVolumeSpecName "kube-api-access-tzh9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:01:41.767093 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.767070    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68ddp\" (UniqueName: \"kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp\") pod \"kuadrant-operator-controller-manager-86878c769f-skl4b\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:41.856625 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.856595    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99218c80-936d-4457-afaf-7f90360a0169-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:41.856625 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.856625    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzh9z\" (UniqueName: \"kubernetes.io/projected/99218c80-936d-4457-afaf-7f90360a0169-kube-api-access-tzh9z\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:41.940374 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:41.940349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:42.069625 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.069599    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:01:42.071131 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:01:42.071103    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4280246f_c6ba_4eed_b082_d7431b3a827d.slice/crio-7c57044dc5c3eefde86bf5123e24b54ca4be607d718fec13a29a768b505ce431 WatchSource:0}: Error finding container 7c57044dc5c3eefde86bf5123e24b54ca4be607d718fec13a29a768b505ce431: Status 404 returned error can't find the container with id 7c57044dc5c3eefde86bf5123e24b54ca4be607d718fec13a29a768b505ce431
Jul 18 02:01:42.410678 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.410646    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" event={"ID":"4280246f-c6ba-4eed-b082-d7431b3a827d","Type":"ContainerStarted","Data":"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"}
Jul 18 02:01:42.411185 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.410707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" event={"ID":"4280246f-c6ba-4eed-b082-d7431b3a827d","Type":"ContainerStarted","Data":"7c57044dc5c3eefde86bf5123e24b54ca4be607d718fec13a29a768b505ce431"}
Jul 18 02:01:42.411185 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.410736    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:42.411955 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.411933    2563 generic.go:356] "Generic (PLEG): container finished" podID="99218c80-936d-4457-afaf-7f90360a0169" containerID="d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c" exitCode=0
Jul 18 02:01:42.412081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.411971    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"
Jul 18 02:01:42.412081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.412015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" event={"ID":"99218c80-936d-4457-afaf-7f90360a0169","Type":"ContainerDied","Data":"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"}
Jul 18 02:01:42.412169 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.412086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4" event={"ID":"99218c80-936d-4457-afaf-7f90360a0169","Type":"ContainerDied","Data":"1d13f92013d4237ffe713a95343626dc4a7a8bde1b1a534f76c766ff92578aca"}
Jul 18 02:01:42.412169 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.412111    2563 scope.go:117] "RemoveContainer" containerID="d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"
Jul 18 02:01:42.421660 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.421511    2563 scope.go:117] "RemoveContainer" containerID="d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"
Jul 18 02:01:42.421771 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:01:42.421753    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c\": container with ID starting with d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c not found: ID does not exist" containerID="d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"
Jul 18 02:01:42.421810 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.421781    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c"} err="failed to get container status \"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c\": rpc error: code = NotFound desc = could not find container \"d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c\": container with ID starting with d822c996fd7db6c653143fc08a72284afe57be7b7f8af2ecee377d94f59d2e2c not found: ID does not exist"
Jul 18 02:01:42.439131 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.439073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" podStartSLOduration=1.439041186 podStartE2EDuration="1.439041186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:01:42.438701315 +0000 UTC m=+657.075954600" watchObservedRunningTime="2026-07-18 02:01:42.439041186 +0000 UTC m=+657.076294466"
Jul 18 02:01:42.456805 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.456777    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:42.464683 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:42.464660    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mtb4"]
Jul 18 02:01:43.891129 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:43.891100    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99218c80-936d-4457-afaf-7f90360a0169" path="/var/lib/kubelet/pods/99218c80-936d-4457-afaf-7f90360a0169/volumes"
Jul 18 02:01:53.421296 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:53.421263    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:01:53.471314 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:53.471179    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:53.471806 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:53.471490    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" podUID="b6aff658-09ae-48c8-907f-d10a8811017e" containerName="manager" containerID="cri-o://758ca9c1d5a670ff5339af3285045fec9a5cc0ac0e40b4dfa53c278d4169467d" gracePeriod=10
Jul 18 02:01:54.476380 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.476346    2563 generic.go:356] "Generic (PLEG): container finished" podID="b6aff658-09ae-48c8-907f-d10a8811017e" containerID="758ca9c1d5a670ff5339af3285045fec9a5cc0ac0e40b4dfa53c278d4169467d" exitCode=0
Jul 18 02:01:54.476714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.476380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" event={"ID":"b6aff658-09ae-48c8-907f-d10a8811017e","Type":"ContainerDied","Data":"758ca9c1d5a670ff5339af3285045fec9a5cc0ac0e40b4dfa53c278d4169467d"}
Jul 18 02:01:54.476714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.476444    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs" event={"ID":"b6aff658-09ae-48c8-907f-d10a8811017e","Type":"ContainerDied","Data":"f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd"}
Jul 18 02:01:54.476714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.476469    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5224644a9ea1f5bb70730349455abdc6b3d4bf9cc8ccf17ad23bb0aa5e8bbbd"
Jul 18 02:01:54.543131 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.543072    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:54.648313 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.648286    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bxzr\" (UniqueName: \"kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr\") pod \"b6aff658-09ae-48c8-907f-d10a8811017e\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") "
Jul 18 02:01:54.648436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.648335    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume\") pod \"b6aff658-09ae-48c8-907f-d10a8811017e\" (UID: \"b6aff658-09ae-48c8-907f-d10a8811017e\") "
Jul 18 02:01:54.648718 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.648695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b6aff658-09ae-48c8-907f-d10a8811017e" (UID: "b6aff658-09ae-48c8-907f-d10a8811017e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:01:54.650412 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.650394    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr" (OuterVolumeSpecName: "kube-api-access-8bxzr") pod "b6aff658-09ae-48c8-907f-d10a8811017e" (UID: "b6aff658-09ae-48c8-907f-d10a8811017e"). InnerVolumeSpecName "kube-api-access-8bxzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:01:54.749168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.749145    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6aff658-09ae-48c8-907f-d10a8811017e-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:54.749168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:54.749165    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bxzr\" (UniqueName: \"kubernetes.io/projected/b6aff658-09ae-48c8-907f-d10a8811017e-kube-api-access-8bxzr\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:01:55.481943 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:55.481911    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"
Jul 18 02:01:55.503451 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:55.503426    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:55.506744 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:55.506719    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-966bs"]
Jul 18 02:01:55.897255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:01:55.897226    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6aff658-09ae-48c8-907f-d10a8811017e" path="/var/lib/kubelet/pods/b6aff658-09ae-48c8-907f-d10a8811017e/volumes"
Jul 18 02:02:11.679508 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679475    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679840    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6aff658-09ae-48c8-907f-d10a8811017e" containerName="manager"
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679852    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6aff658-09ae-48c8-907f-d10a8811017e" containerName="manager"
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679879    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99218c80-936d-4457-afaf-7f90360a0169" containerName="manager"
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679886    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="99218c80-936d-4457-afaf-7f90360a0169" containerName="manager"
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679942    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="99218c80-936d-4457-afaf-7f90360a0169" containerName="manager"
Jul 18 02:02:11.679950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.679952    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6aff658-09ae-48c8-907f-d10a8811017e" containerName="manager"
Jul 18 02:02:11.681873 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.681859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.684346 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.684318    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 18 02:02:11.690009 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.689990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:11.775159 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.775119    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:11.786836 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.786805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5jbz\" (UniqueName: \"kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.787019 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.786892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.888188 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.888157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5jbz\" (UniqueName: \"kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.888342 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.888217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.888811 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.888792    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.895761 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.895738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5jbz\" (UniqueName: \"kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz\") pod \"limitador-limitador-64c94fd64f-jm9mn\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:11.992901 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:11.992832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:12.125270 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.125242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:12.127035 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:12.127012    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d56482b_d65c_4645_b81d_b536fa4ce901.slice/crio-699d06df786c81e4404c875a9d565cd0f9d2a3927654517fe3375689b6e4dd96 WatchSource:0}: Error finding container 699d06df786c81e4404c875a9d565cd0f9d2a3927654517fe3375689b6e4dd96: Status 404 returned error can't find the container with id 699d06df786c81e4404c875a9d565cd0f9d2a3927654517fe3375689b6e4dd96
Jul 18 02:02:12.128964 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.128941    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:02:12.455951 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.455916    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:12.458913 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.458892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:12.461489 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.461456    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-586bp\""
Jul 18 02:02:12.465199 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.465174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:12.570519 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.570484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" event={"ID":"4d56482b-d65c-4645-b81d-b536fa4ce901","Type":"ContainerStarted","Data":"699d06df786c81e4404c875a9d565cd0f9d2a3927654517fe3375689b6e4dd96"}
Jul 18 02:02:12.593717 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.593686    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc4dn\" (UniqueName: \"kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn\") pod \"authorino-58cd955675-tz2tz\" (UID: \"0d92965b-4896-4bbc-86ee-f3adad3329a7\") " pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:12.694493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.694459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc4dn\" (UniqueName: \"kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn\") pod \"authorino-58cd955675-tz2tz\" (UID: \"0d92965b-4896-4bbc-86ee-f3adad3329a7\") " pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:12.718474 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.718411    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc4dn\" (UniqueName: \"kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn\") pod \"authorino-58cd955675-tz2tz\" (UID: \"0d92965b-4896-4bbc-86ee-f3adad3329a7\") " pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:12.770376 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.770316    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:12.950447 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:12.950393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:12.952858 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:12.952828    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d92965b_4896_4bbc_86ee_f3adad3329a7.slice/crio-9308362d0b6b2cf43c96ae81fdc0155d4f16d6f29a4b6d666258a304d6245866 WatchSource:0}: Error finding container 9308362d0b6b2cf43c96ae81fdc0155d4f16d6f29a4b6d666258a304d6245866: Status 404 returned error can't find the container with id 9308362d0b6b2cf43c96ae81fdc0155d4f16d6f29a4b6d666258a304d6245866
Jul 18 02:02:13.577298 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:13.577252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tz2tz" event={"ID":"0d92965b-4896-4bbc-86ee-f3adad3329a7","Type":"ContainerStarted","Data":"9308362d0b6b2cf43c96ae81fdc0155d4f16d6f29a4b6d666258a304d6245866"}
Jul 18 02:02:15.592624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:15.592591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" event={"ID":"4d56482b-d65c-4645-b81d-b536fa4ce901","Type":"ContainerStarted","Data":"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"}
Jul 18 02:02:15.593114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:15.592711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:15.608462 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:15.608417    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" podStartSLOduration=2.005330828 podStartE2EDuration="4.608401946s" totalImagesPullingTime="2.603071118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:15.606993685 +0000 UTC m=+690.244246966" watchObservedRunningTime="2026-07-18 02:02:15.608401946 +0000 UTC m=+690.245655227"
Jul 18 02:02:17.604106 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:17.604072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tz2tz" event={"ID":"0d92965b-4896-4bbc-86ee-f3adad3329a7","Type":"ContainerStarted","Data":"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"}
Jul 18 02:02:17.619057 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:17.618997    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-tz2tz" podStartSLOduration=2.004911658 podStartE2EDuration="5.618982726s" totalImagesPullingTime="3.614071068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:17.618521076 +0000 UTC m=+692.255774355" watchObservedRunningTime="2026-07-18 02:02:17.618982726 +0000 UTC m=+692.256236006"
Jul 18 02:02:18.119007 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:18.118969    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:19.614260 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:19.614219    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-tz2tz" podUID="0d92965b-4896-4bbc-86ee-f3adad3329a7" containerName="authorino" containerID="cri-o://c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d" gracePeriod=30
Jul 18 02:02:19.866363 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:19.866312    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:19.949181 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:19.949154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc4dn\" (UniqueName: \"kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn\") pod \"0d92965b-4896-4bbc-86ee-f3adad3329a7\" (UID: \"0d92965b-4896-4bbc-86ee-f3adad3329a7\") "
Jul 18 02:02:19.951055 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:19.951023    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn" (OuterVolumeSpecName: "kube-api-access-tc4dn") pod "0d92965b-4896-4bbc-86ee-f3adad3329a7" (UID: "0d92965b-4896-4bbc-86ee-f3adad3329a7"). InnerVolumeSpecName "kube-api-access-tc4dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:02:20.050388 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.050363    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc4dn\" (UniqueName: \"kubernetes.io/projected/0d92965b-4896-4bbc-86ee-f3adad3329a7-kube-api-access-tc4dn\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:02:20.620407 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.620370    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d92965b-4896-4bbc-86ee-f3adad3329a7" containerID="c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d" exitCode=0
Jul 18 02:02:20.620407 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.620409    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-tz2tz"
Jul 18 02:02:20.620843 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.620457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tz2tz" event={"ID":"0d92965b-4896-4bbc-86ee-f3adad3329a7","Type":"ContainerDied","Data":"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"}
Jul 18 02:02:20.620843 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.620493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-tz2tz" event={"ID":"0d92965b-4896-4bbc-86ee-f3adad3329a7","Type":"ContainerDied","Data":"9308362d0b6b2cf43c96ae81fdc0155d4f16d6f29a4b6d666258a304d6245866"}
Jul 18 02:02:20.620843 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.620514    2563 scope.go:117] "RemoveContainer" containerID="c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"
Jul 18 02:02:20.629786 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.629768    2563 scope.go:117] "RemoveContainer" containerID="c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"
Jul 18 02:02:20.630035 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:20.630018    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d\": container with ID starting with c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d not found: ID does not exist" containerID="c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"
Jul 18 02:02:20.630193 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.630064    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d"} err="failed to get container status \"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d\": rpc error: code = NotFound desc = could not find container \"c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d\": container with ID starting with c31fa24ccf44ca9cef1883f49f75573eaa0f908029deeef7228424b658e0e51d not found: ID does not exist"
Jul 18 02:02:20.640798 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.640776    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:20.644858 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:20.644839    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-tz2tz"]
Jul 18 02:02:21.891062 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:21.891026    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d92965b-4896-4bbc-86ee-f3adad3329a7" path="/var/lib/kubelet/pods/0d92965b-4896-4bbc-86ee-f3adad3329a7/volumes"
Jul 18 02:02:26.598361 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:26.598333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:29.119057 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.119014    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:29.119560 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.119185    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" podUID="4d56482b-d65c-4645-b81d-b536fa4ce901" containerName="limitador" containerID="cri-o://01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775" gracePeriod=30
Jul 18 02:02:29.663921 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.663899    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:29.666174 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.666143    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d56482b-d65c-4645-b81d-b536fa4ce901" containerID="01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775" exitCode=0
Jul 18 02:02:29.666278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.666174    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"
Jul 18 02:02:29.666278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.666191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" event={"ID":"4d56482b-d65c-4645-b81d-b536fa4ce901","Type":"ContainerDied","Data":"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"}
Jul 18 02:02:29.666278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.666235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jm9mn" event={"ID":"4d56482b-d65c-4645-b81d-b536fa4ce901","Type":"ContainerDied","Data":"699d06df786c81e4404c875a9d565cd0f9d2a3927654517fe3375689b6e4dd96"}
Jul 18 02:02:29.666278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.666258    2563 scope.go:117] "RemoveContainer" containerID="01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"
Jul 18 02:02:29.674657 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.674643    2563 scope.go:117] "RemoveContainer" containerID="01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"
Jul 18 02:02:29.674885 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:29.674869    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775\": container with ID starting with 01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775 not found: ID does not exist" containerID="01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"
Jul 18 02:02:29.674925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.674894    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775"} err="failed to get container status \"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775\": rpc error: code = NotFound desc = could not find container \"01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775\": container with ID starting with 01805a1fcfc72d2fb1617180b06a893d680a795a26f7ba01aa0963869aa26775 not found: ID does not exist"
Jul 18 02:02:29.818935 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.818280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5jbz\" (UniqueName: \"kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz\") pod \"4d56482b-d65c-4645-b81d-b536fa4ce901\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") "
Jul 18 02:02:29.818935 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.818329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file\") pod \"4d56482b-d65c-4645-b81d-b536fa4ce901\" (UID: \"4d56482b-d65c-4645-b81d-b536fa4ce901\") "
Jul 18 02:02:29.819415 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.819279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file" (OuterVolumeSpecName: "config-file") pod "4d56482b-d65c-4645-b81d-b536fa4ce901" (UID: "4d56482b-d65c-4645-b81d-b536fa4ce901"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:02:29.825946 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.825917    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz" (OuterVolumeSpecName: "kube-api-access-x5jbz") pod "4d56482b-d65c-4645-b81d-b536fa4ce901" (UID: "4d56482b-d65c-4645-b81d-b536fa4ce901"). InnerVolumeSpecName "kube-api-access-x5jbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:02:29.919495 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.919470    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5jbz\" (UniqueName: \"kubernetes.io/projected/4d56482b-d65c-4645-b81d-b536fa4ce901-kube-api-access-x5jbz\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:02:29.919495 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.919492    2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d56482b-d65c-4645-b81d-b536fa4ce901-config-file\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:02:29.980647 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.980617    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:29.984379 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:29.984357    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jm9mn"]
Jul 18 02:02:31.891020 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:31.890986    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d56482b-d65c-4645-b81d-b536fa4ce901" path="/var/lib/kubelet/pods/4d56482b-d65c-4645-b81d-b536fa4ce901/volumes"
Jul 18 02:02:32.124067 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124009    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"]
Jul 18 02:02:32.124581 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124559    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d56482b-d65c-4645-b81d-b536fa4ce901" containerName="limitador"
Jul 18 02:02:32.124581 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124579    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d56482b-d65c-4645-b81d-b536fa4ce901" containerName="limitador"
Jul 18 02:02:32.124765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124602    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d92965b-4896-4bbc-86ee-f3adad3329a7" containerName="authorino"
Jul 18 02:02:32.124765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124608    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d92965b-4896-4bbc-86ee-f3adad3329a7" containerName="authorino"
Jul 18 02:02:32.124765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124673    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d92965b-4896-4bbc-86ee-f3adad3329a7" containerName="authorino"
Jul 18 02:02:32.124765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.124682    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d56482b-d65c-4645-b81d-b536fa4ce901" containerName="limitador"
Jul 18 02:02:32.129341 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.129323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.131747 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.131719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 18 02:02:32.131882 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.131793    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-5pb25\""
Jul 18 02:02:32.131882 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.131876    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 18 02:02:32.132848 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.132832    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 02:02:32.139878 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.139858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"]
Jul 18 02:02:32.234683 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.234630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f15f705d-75e5-4418-ab32-2ed97faf9366-data\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.234683 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.234661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rxkp\" (UniqueName: \"kubernetes.io/projected/f15f705d-75e5-4418-ab32-2ed97faf9366-kube-api-access-2rxkp\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.335467 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.335442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f15f705d-75e5-4418-ab32-2ed97faf9366-data\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.335556 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.335475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rxkp\" (UniqueName: \"kubernetes.io/projected/f15f705d-75e5-4418-ab32-2ed97faf9366-kube-api-access-2rxkp\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.335855 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.335837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f15f705d-75e5-4418-ab32-2ed97faf9366-data\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.343372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.343353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rxkp\" (UniqueName: \"kubernetes.io/projected/f15f705d-75e5-4418-ab32-2ed97faf9366-kube-api-access-2rxkp\") pod \"postgres-69fb4594cf-s6c75\" (UID: \"f15f705d-75e5-4418-ab32-2ed97faf9366\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.440271 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.440252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:32.579888 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.579864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"]
Jul 18 02:02:32.582039 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:32.582017    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15f705d_75e5_4418_ab32_2ed97faf9366.slice/crio-e571bab6c78ec3c7f9aa9e96a863c8c0faa3762fc07860991c949f5c04ec13e6 WatchSource:0}: Error finding container e571bab6c78ec3c7f9aa9e96a863c8c0faa3762fc07860991c949f5c04ec13e6: Status 404 returned error can't find the container with id e571bab6c78ec3c7f9aa9e96a863c8c0faa3762fc07860991c949f5c04ec13e6
Jul 18 02:02:32.683774 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:32.683747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75" event={"ID":"f15f705d-75e5-4418-ab32-2ed97faf9366","Type":"ContainerStarted","Data":"e571bab6c78ec3c7f9aa9e96a863c8c0faa3762fc07860991c949f5c04ec13e6"}
Jul 18 02:02:37.717410 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:37.717372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75" event={"ID":"f15f705d-75e5-4418-ab32-2ed97faf9366","Type":"ContainerStarted","Data":"311c282581376d58806a15f52b95c9bb705d2bea1a6b4fcde2499493dc718feb"}
Jul 18 02:02:37.717783 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:37.717472    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:37.734590 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:37.734546    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75" podStartSLOduration=1.179330384 podStartE2EDuration="5.734532298s" totalImagesPullingTime="4.555201914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:37.731309549 +0000 UTC m=+712.368562843" watchObservedRunningTime="2026-07-18 02:02:37.734532298 +0000 UTC m=+712.371785578"
Jul 18 02:02:43.751864 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:43.751835    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-s6c75"
Jul 18 02:02:44.270245 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.270211    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b5rj9"]
Jul 18 02:02:44.276165 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.276142    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.278835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.278801    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-586bp\""
Jul 18 02:02:44.280170 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.280147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b5rj9"]
Jul 18 02:02:44.432370 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.432342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7hd\" (UniqueName: \"kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd\") pod \"authorino-5d4b67c446-b5rj9\" (UID: \"eaceed3e-0413-4ace-b982-9463f2c62173\") " pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.506654 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.506620    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b5rj9"]
Jul 18 02:02:44.506859 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:44.506838    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hd7hd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-b5rj9" podUID="eaceed3e-0413-4ace-b982-9463f2c62173"
Jul 18 02:02:44.527527 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.527465    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fc8446c47-nmp4k"]
Jul 18 02:02:44.531169 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.531150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.533499 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.533470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7hd\" (UniqueName: \"kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd\") pod \"authorino-5d4b67c446-b5rj9\" (UID: \"eaceed3e-0413-4ace-b982-9463f2c62173\") " pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.538919 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.538896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fc8446c47-nmp4k"]
Jul 18 02:02:44.543721 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.543699    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7hd\" (UniqueName: \"kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd\") pod \"authorino-5d4b67c446-b5rj9\" (UID: \"eaceed3e-0413-4ace-b982-9463f2c62173\") " pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.634315 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.634292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vmsg\" (UniqueName: \"kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg\") pod \"authorino-fc8446c47-nmp4k\" (UID: \"210d3950-7e25-469b-8612-40b8af40657c\") " pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.708856 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.708832    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fc8446c47-nmp4k"]
Jul 18 02:02:44.709027 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:44.709008    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8vmsg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-fc8446c47-nmp4k" podUID="210d3950-7e25-469b-8612-40b8af40657c"
Jul 18 02:02:44.732370 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.732346    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:02:44.734749 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.734724    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vmsg\" (UniqueName: \"kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg\") pod \"authorino-fc8446c47-nmp4k\" (UID: \"210d3950-7e25-469b-8612-40b8af40657c\") " pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.736248 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.736231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.738524 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.738504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 02:02:44.745414 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.745392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:02:44.746375 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.746354    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vmsg\" (UniqueName: \"kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg\") pod \"authorino-fc8446c47-nmp4k\" (UID: \"210d3950-7e25-469b-8612-40b8af40657c\") " pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.756284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.756265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.756599 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.756268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.763149 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.763134    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:44.766222 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.766206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:44.835799 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.835743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvqhv\" (UniqueName: \"kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.835799 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.835783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.937138 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.937114    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hd7hd\" (UniqueName: \"kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd\") pod \"eaceed3e-0413-4ace-b982-9463f2c62173\" (UID: \"eaceed3e-0413-4ace-b982-9463f2c62173\") "
Jul 18 02:02:44.937231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.937151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vmsg\" (UniqueName: \"kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg\") pod \"210d3950-7e25-469b-8612-40b8af40657c\" (UID: \"210d3950-7e25-469b-8612-40b8af40657c\") "
Jul 18 02:02:44.937280 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.937239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.937360 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.937343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvqhv\" (UniqueName: \"kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.939126 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.939103    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd" (OuterVolumeSpecName: "kube-api-access-hd7hd") pod "eaceed3e-0413-4ace-b982-9463f2c62173" (UID: "eaceed3e-0413-4ace-b982-9463f2c62173"). InnerVolumeSpecName "kube-api-access-hd7hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:02:44.939190 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.939163    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg" (OuterVolumeSpecName: "kube-api-access-8vmsg") pod "210d3950-7e25-469b-8612-40b8af40657c" (UID: "210d3950-7e25-469b-8612-40b8af40657c"). InnerVolumeSpecName "kube-api-access-8vmsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:02:44.939567 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.939548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:44.956454 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:44.956425    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvqhv\" (UniqueName: \"kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv\") pod \"authorino-76d8d986c5-2pdn4\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") " pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:45.038458 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.038426    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vmsg\" (UniqueName: \"kubernetes.io/projected/210d3950-7e25-469b-8612-40b8af40657c-kube-api-access-8vmsg\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:02:45.038458 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.038456    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd7hd\" (UniqueName: \"kubernetes.io/projected/eaceed3e-0413-4ace-b982-9463f2c62173-kube-api-access-hd7hd\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:02:45.045988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.045971    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:02:45.175769 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.175741    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:02:45.177131 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:45.177105    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1d75fd5_4797_46ac_a208_4dced4a67209.slice/crio-cf0a49de05676ca7fd9cf9a79ef631fa69422f69028779b7093ce1531d05bf1b WatchSource:0}: Error finding container cf0a49de05676ca7fd9cf9a79ef631fa69422f69028779b7093ce1531d05bf1b: Status 404 returned error can't find the container with id cf0a49de05676ca7fd9cf9a79ef631fa69422f69028779b7093ce1531d05bf1b
Jul 18 02:02:45.765371 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.765334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" event={"ID":"f1d75fd5-4797-46ac-a208-4dced4a67209","Type":"ContainerStarted","Data":"cf0a49de05676ca7fd9cf9a79ef631fa69422f69028779b7093ce1531d05bf1b"}
Jul 18 02:02:45.765745 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.765409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b5rj9"
Jul 18 02:02:45.765745 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.765414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fc8446c47-nmp4k"
Jul 18 02:02:45.795310 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.795283    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fc8446c47-nmp4k"]
Jul 18 02:02:45.798672 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.798646    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fc8446c47-nmp4k"]
Jul 18 02:02:45.840856 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.840826    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b5rj9"]
Jul 18 02:02:45.855969 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.855941    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b5rj9"]
Jul 18 02:02:45.891554 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.891524    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="210d3950-7e25-469b-8612-40b8af40657c" path="/var/lib/kubelet/pods/210d3950-7e25-469b-8612-40b8af40657c/volumes"
Jul 18 02:02:45.891780 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:45.891767    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaceed3e-0413-4ace-b982-9463f2c62173" path="/var/lib/kubelet/pods/eaceed3e-0413-4ace-b982-9463f2c62173/volumes"
Jul 18 02:02:46.771893 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:46.771858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" event={"ID":"f1d75fd5-4797-46ac-a208-4dced4a67209","Type":"ContainerStarted","Data":"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"}
Jul 18 02:02:46.788731 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:46.788680    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" podStartSLOduration=1.936166555 podStartE2EDuration="2.788665564s" totalImagesPullingTime="852.499009ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:46.785926848 +0000 UTC m=+721.423180128" watchObservedRunningTime="2026-07-18 02:02:46.788665564 +0000 UTC m=+721.425918844"
Jul 18 02:02:51.469269 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.469234    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:02:51.486968 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.486939    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:02:51.487159 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.487085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.489756 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.489733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 02:02:51.489756 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.489749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcz2x\""
Jul 18 02:02:51.490724 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.490704    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 02:02:51.593907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.593879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7xp7\" (UniqueName: \"kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.594069 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.593938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.652837 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.652804    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:02:51.655791 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.655771    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.666334 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.666311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:02:51.695005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.694984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.695129 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.695034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4ps\" (UniqueName: \"kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.695129 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.695091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.695233 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:51.695135    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 18 02:02:51.695233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.695131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7xp7\" (UniqueName: \"kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.695233 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:02:51.695206    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert podName:64d136f5-08af-4f38-a186-ff3e1c9173d1 nodeName:}" failed. No retries permitted until 2026-07-18 02:02:52.195189731 +0000 UTC m=+726.832442992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert") pod "maas-controller-657874674b-hg9sz" (UID: "64d136f5-08af-4f38-a186-ff3e1c9173d1") : secret "maas-controller-webhook-cert" not found
Jul 18 02:02:51.704227 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.704204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7xp7\" (UniqueName: \"kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:51.795846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.795784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4ps\" (UniqueName: \"kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.795846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.795816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.798372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.798350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.803002 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.802980    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4ps\" (UniqueName: \"kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps\") pod \"maas-controller-ff5bb5c77-zhwvx\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") " pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:51.965906 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:51.965886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:52.091073 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.091020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:02:52.093165 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:52.093142    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97cf852_e554_4f4a_b6e4_44642f2d4ec0.slice/crio-eb3a56429e90ba605fc8b76837f5345f94e7928765dcc8ecbbfa23a860e50a85 WatchSource:0}: Error finding container eb3a56429e90ba605fc8b76837f5345f94e7928765dcc8ecbbfa23a860e50a85: Status 404 returned error can't find the container with id eb3a56429e90ba605fc8b76837f5345f94e7928765dcc8ecbbfa23a860e50a85
Jul 18 02:02:52.199551 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.199529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:52.201704 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.201686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") pod \"maas-controller-657874674b-hg9sz\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") " pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:52.400009 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.399987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:52.524271 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.524242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:02:52.526059 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:02:52.526022    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64d136f5_08af_4f38_a186_ff3e1c9173d1.slice/crio-99b80ca18dbd4fad9a0375b88fbff082c2b91f8ac46c6a8a70391a0560a5608b WatchSource:0}: Error finding container 99b80ca18dbd4fad9a0375b88fbff082c2b91f8ac46c6a8a70391a0560a5608b: Status 404 returned error can't find the container with id 99b80ca18dbd4fad9a0375b88fbff082c2b91f8ac46c6a8a70391a0560a5608b
Jul 18 02:02:52.805555 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.805482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-657874674b-hg9sz" event={"ID":"64d136f5-08af-4f38-a186-ff3e1c9173d1","Type":"ContainerStarted","Data":"99b80ca18dbd4fad9a0375b88fbff082c2b91f8ac46c6a8a70391a0560a5608b"}
Jul 18 02:02:52.806594 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:52.806572    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" event={"ID":"e97cf852-e554-4f4a-b6e4-44642f2d4ec0","Type":"ContainerStarted","Data":"eb3a56429e90ba605fc8b76837f5345f94e7928765dcc8ecbbfa23a860e50a85"}
Jul 18 02:02:55.826508 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.826475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" event={"ID":"e97cf852-e554-4f4a-b6e4-44642f2d4ec0","Type":"ContainerStarted","Data":"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"}
Jul 18 02:02:55.826951 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.826578    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:02:55.827962 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.827939    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-657874674b-hg9sz" event={"ID":"64d136f5-08af-4f38-a186-ff3e1c9173d1","Type":"ContainerStarted","Data":"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"}
Jul 18 02:02:55.828113 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.828075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:02:55.858604 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.858554    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" podStartSLOduration=1.993095529 podStartE2EDuration="4.858537452s" totalImagesPullingTime="2.865441923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:55.857441761 +0000 UTC m=+730.494695043" watchObservedRunningTime="2026-07-18 02:02:55.858537452 +0000 UTC m=+730.495790733"
Jul 18 02:02:55.891756 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:02:55.891717    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-657874674b-hg9sz" podStartSLOduration=2.448633347 podStartE2EDuration="4.891703958s" totalImagesPullingTime="2.443070611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:02:55.890088972 +0000 UTC m=+730.527342252" watchObservedRunningTime="2026-07-18 02:02:55.891703958 +0000 UTC m=+730.528957238"
Jul 18 02:03:06.836330 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:06.836300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:03:06.836699 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:06.836373    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:03:06.894985 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:06.894951    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:03:06.895173 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:06.895127    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-657874674b-hg9sz" podUID="64d136f5-08af-4f38-a186-ff3e1c9173d1" containerName="manager" containerID="cri-o://ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf" gracePeriod=30
Jul 18 02:03:07.144192 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.144172    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:03:07.216918 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.216892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7xp7\" (UniqueName: \"kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7\") pod \"64d136f5-08af-4f38-a186-ff3e1c9173d1\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") "
Jul 18 02:03:07.217064 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.216945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") pod \"64d136f5-08af-4f38-a186-ff3e1c9173d1\" (UID: \"64d136f5-08af-4f38-a186-ff3e1c9173d1\") "
Jul 18 02:03:07.218925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.218899    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "64d136f5-08af-4f38-a186-ff3e1c9173d1" (UID: "64d136f5-08af-4f38-a186-ff3e1c9173d1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:03:07.219005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.218935    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7" (OuterVolumeSpecName: "kube-api-access-m7xp7") pod "64d136f5-08af-4f38-a186-ff3e1c9173d1" (UID: "64d136f5-08af-4f38-a186-ff3e1c9173d1"). InnerVolumeSpecName "kube-api-access-m7xp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:03:07.317995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.317969    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7xp7\" (UniqueName: \"kubernetes.io/projected/64d136f5-08af-4f38-a186-ff3e1c9173d1-kube-api-access-m7xp7\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:03:07.317995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.317993    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/64d136f5-08af-4f38-a186-ff3e1c9173d1-webhook-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:03:07.895751 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.895716    2563 generic.go:356] "Generic (PLEG): container finished" podID="64d136f5-08af-4f38-a186-ff3e1c9173d1" containerID="ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf" exitCode=0
Jul 18 02:03:07.896154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.895758    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-657874674b-hg9sz"
Jul 18 02:03:07.896154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.895787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-657874674b-hg9sz" event={"ID":"64d136f5-08af-4f38-a186-ff3e1c9173d1","Type":"ContainerDied","Data":"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"}
Jul 18 02:03:07.896154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.895825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-657874674b-hg9sz" event={"ID":"64d136f5-08af-4f38-a186-ff3e1c9173d1","Type":"ContainerDied","Data":"99b80ca18dbd4fad9a0375b88fbff082c2b91f8ac46c6a8a70391a0560a5608b"}
Jul 18 02:03:07.896154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.895847    2563 scope.go:117] "RemoveContainer" containerID="ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"
Jul 18 02:03:07.905491 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.905448    2563 scope.go:117] "RemoveContainer" containerID="ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"
Jul 18 02:03:07.905677 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:03:07.905657    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf\": container with ID starting with ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf not found: ID does not exist" containerID="ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"
Jul 18 02:03:07.905765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.905681    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf"} err="failed to get container status \"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf\": rpc error: code = NotFound desc = could not find container \"ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf\": container with ID starting with ae783fbafda6415380a8ae477f22a86b4e36521652f8503abd1bce58c40936bf not found: ID does not exist"
Jul 18 02:03:07.916164 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.916140    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:03:07.919278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:07.919257    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-657874674b-hg9sz"]
Jul 18 02:03:09.891592 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:09.891562    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64d136f5-08af-4f38-a186-ff3e1c9173d1" path="/var/lib/kubelet/pods/64d136f5-08af-4f38-a186-ff3e1c9173d1/volumes"
Jul 18 02:03:28.122345 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.122311    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"]
Jul 18 02:03:28.123231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.122666    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64d136f5-08af-4f38-a186-ff3e1c9173d1" containerName="manager"
Jul 18 02:03:28.123231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.122678    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64d136f5-08af-4f38-a186-ff3e1c9173d1" containerName="manager"
Jul 18 02:03:28.123231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.122759    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64d136f5-08af-4f38-a186-ff3e1c9173d1" containerName="manager"
Jul 18 02:03:28.126873 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.126854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.129626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.129607    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 18 02:03:28.129626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.129621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fh5b5\""
Jul 18 02:03:28.135675 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.135653    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"]
Jul 18 02:03:28.166768 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.166745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjbw\" (UniqueName: \"kubernetes.io/projected/83a62dcc-ab5b-43de-8797-f679df732582-kube-api-access-hwjbw\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.166883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.166812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a62dcc-ab5b-43de-8797-f679df732582-openshift-service-ca\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.166883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.166835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.267499 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.267475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a62dcc-ab5b-43de-8797-f679df732582-openshift-service-ca\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.267617 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.267506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.267617 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.267549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjbw\" (UniqueName: \"kubernetes.io/projected/83a62dcc-ab5b-43de-8797-f679df732582-kube-api-access-hwjbw\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.267730 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:03:28.267684    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 18 02:03:28.267788 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:03:28.267768    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls podName:83a62dcc-ab5b-43de-8797-f679df732582 nodeName:}" failed. No retries permitted until 2026-07-18 02:03:28.767745611 +0000 UTC m=+763.404998871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls") pod "maas-api-644d7f5bc4-ztpx5" (UID: "83a62dcc-ab5b-43de-8797-f679df732582") : secret "maas-api-serving-cert" not found
Jul 18 02:03:28.268210 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.268192    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83a62dcc-ab5b-43de-8797-f679df732582-openshift-service-ca\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.281903 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.281879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjbw\" (UniqueName: \"kubernetes.io/projected/83a62dcc-ab5b-43de-8797-f679df732582-kube-api-access-hwjbw\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.614356 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.614325    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6c462"]
Jul 18 02:03:28.617176 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.617155    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.619954 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.619931    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ndpws\""
Jul 18 02:03:28.620098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.619936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 18 02:03:28.629448 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.629423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6c462"]
Jul 18 02:03:28.648679 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.648657    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lghxx"]
Jul 18 02:03:28.651177 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.651161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.663795 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.663766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lghxx"]
Jul 18 02:03:28.670536 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.670514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.670654 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.670602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpb9w\" (UniqueName: \"kubernetes.io/projected/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-kube-api-access-fpb9w\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.771226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.771372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nggs2\" (UniqueName: \"kubernetes.io/projected/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-kube-api-access-nggs2\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.771372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771272    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.771372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpb9w\" (UniqueName: \"kubernetes.io/projected/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-kube-api-access-fpb9w\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.771372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.771966 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.771942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.773725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.773703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83a62dcc-ab5b-43de-8797-f679df732582-maas-api-tls\") pod \"maas-api-644d7f5bc4-ztpx5\" (UID: \"83a62dcc-ab5b-43de-8797-f679df732582\") " pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:28.778709 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.778689    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpb9w\" (UniqueName: \"kubernetes.io/projected/4776bc82-fb7b-4ddd-ad65-e0333f37b1a6-kube-api-access-fpb9w\") pod \"payload-pre-processing-7677b774bb-6c462\" (UID: \"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.872464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.872370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nggs2\" (UniqueName: \"kubernetes.io/projected/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-kube-api-access-nggs2\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.872464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.872423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.873159 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.873133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-plugins-config-volume\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.883301 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.883267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nggs2\" (UniqueName: \"kubernetes.io/projected/1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a-kube-api-access-nggs2\") pod \"payload-processing-5bf47cd988-lghxx\" (UID: \"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a\") " pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:28.929160 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.929123    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:28.961823 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:28.961800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:29.039506 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:29.039471    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:29.113920 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:29.113123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-lghxx"]
Jul 18 02:03:29.116179 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:03:29.116147    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbd9161_7b52_4f70_9a7e_7fd0aa4e425a.slice/crio-0a07218987f9a47c39ad905b4bebab7ff3cf94255fcfe878110621947ed7d735 WatchSource:0}: Error finding container 0a07218987f9a47c39ad905b4bebab7ff3cf94255fcfe878110621947ed7d735: Status 404 returned error can't find the container with id 0a07218987f9a47c39ad905b4bebab7ff3cf94255fcfe878110621947ed7d735
Jul 18 02:03:29.186784 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:29.186755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"]
Jul 18 02:03:29.188320 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:03:29.188282    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a62dcc_ab5b_43de_8797_f679df732582.slice/crio-341713f619c95604b6055f2f657f409459017d465125bf01772ca4cf96a60744 WatchSource:0}: Error finding container 341713f619c95604b6055f2f657f409459017d465125bf01772ca4cf96a60744: Status 404 returned error can't find the container with id 341713f619c95604b6055f2f657f409459017d465125bf01772ca4cf96a60744
Jul 18 02:03:29.280493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:29.280467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-6c462"]
Jul 18 02:03:29.282438 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:03:29.282399    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4776bc82_fb7b_4ddd_ad65_e0333f37b1a6.slice/crio-e6766e82177855544ae64d158bb7ea3e56ab56640a5b40b7ba46e188370430ee WatchSource:0}: Error finding container e6766e82177855544ae64d158bb7ea3e56ab56640a5b40b7ba46e188370430ee: Status 404 returned error can't find the container with id e6766e82177855544ae64d158bb7ea3e56ab56640a5b40b7ba46e188370430ee
Jul 18 02:03:30.016813 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:30.016725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5" event={"ID":"83a62dcc-ab5b-43de-8797-f679df732582","Type":"ContainerStarted","Data":"341713f619c95604b6055f2f657f409459017d465125bf01772ca4cf96a60744"}
Jul 18 02:03:30.019105 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:30.019027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx" event={"ID":"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a","Type":"ContainerStarted","Data":"0a07218987f9a47c39ad905b4bebab7ff3cf94255fcfe878110621947ed7d735"}
Jul 18 02:03:30.022815 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:30.022748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462" event={"ID":"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6","Type":"ContainerStarted","Data":"e6766e82177855544ae64d158bb7ea3e56ab56640a5b40b7ba46e188370430ee"}
Jul 18 02:03:31.031202 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.031166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx" event={"ID":"1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a","Type":"ContainerStarted","Data":"e016eebc6bc99919202a497f7ef9375184c8c0ab3663707d555e1e6b8ac54985"}
Jul 18 02:03:31.031629 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.031354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:31.033344 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.033310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462" event={"ID":"4776bc82-fb7b-4ddd-ad65-e0333f37b1a6","Type":"ContainerStarted","Data":"e12813c0d55ea1a8343439e81037572c530956f6cfda5a7d5bb456091562acae"}
Jul 18 02:03:31.033498 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.033449    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:31.048916 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.048865    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx" podStartSLOduration=1.313316255 podStartE2EDuration="3.048846321s" totalImagesPullingTime="1.735530066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:03:31.045819035 +0000 UTC m=+765.683072316" watchObservedRunningTime="2026-07-18 02:03:31.048846321 +0000 UTC m=+765.686099601"
Jul 18 02:03:31.061873 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:31.061827    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462" podStartSLOduration=1.480310291 podStartE2EDuration="3.061812745s" totalImagesPullingTime="1.581502454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:03:31.059258756 +0000 UTC m=+765.696512040" watchObservedRunningTime="2026-07-18 02:03:31.061812745 +0000 UTC m=+765.699066024"
Jul 18 02:03:32.040421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:32.040387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5" event={"ID":"83a62dcc-ab5b-43de-8797-f679df732582","Type":"ContainerStarted","Data":"96056de0b93b201a17dc9197597d947be2d015b3c2efef354f360436a5af0237"}
Jul 18 02:03:32.040888 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:32.040779    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:32.057260 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:32.057216    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5" podStartSLOduration=1.929631093 podStartE2EDuration="4.057200229s" totalImagesPullingTime="2.127569136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:03:32.056513697 +0000 UTC m=+766.693766978" watchObservedRunningTime="2026-07-18 02:03:32.057200229 +0000 UTC m=+766.694453538"
Jul 18 02:03:39.058733 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:39.058708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-644d7f5bc4-ztpx5"
Jul 18 02:03:42.042668 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:42.042630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-lghxx"
Jul 18 02:03:42.043452 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:42.042902    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-6c462"
Jul 18 02:03:49.986004 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.985963    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"]
Jul 18 02:03:49.990994 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.990969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:49.993979 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.993959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 02:03:49.995430 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.995410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 18 02:03:49.995546 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.995459    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 02:03:49.995546 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:49.995463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7rth8\""
Jul 18 02:03:50.003306 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.003279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"]
Jul 18 02:03:50.144319 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.144486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5lrj\" (UniqueName: \"kubernetes.io/projected/b9e4613d-73f8-4aca-b440-575545b54bf9-kube-api-access-l5lrj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.144486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.144486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e4613d-73f8-4aca-b440-575545b54bf9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.144486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.144689 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.144505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245106 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5lrj\" (UniqueName: \"kubernetes.io/projected/b9e4613d-73f8-4aca-b440-575545b54bf9-kube-api-access-l5lrj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245106 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e4613d-73f8-4aca-b440-575545b54bf9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245172    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.245765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.245665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.247532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.247505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9e4613d-73f8-4aca-b440-575545b54bf9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.247730 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.247714    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9e4613d-73f8-4aca-b440-575545b54bf9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.252420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.252395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5lrj\" (UniqueName: \"kubernetes.io/projected/b9e4613d-73f8-4aca-b440-575545b54bf9-kube-api-access-l5lrj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5f274\" (UID: \"b9e4613d-73f8-4aca-b440-575545b54bf9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.304139 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.304107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:03:50.656821 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:50.656785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"]
Jul 18 02:03:50.663233 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:03:50.663191    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e4613d_73f8_4aca_b440_575545b54bf9.slice/crio-b4015004367d91e2cab3a34603a784916215581d1778c4fb1b7b358f88fa4ade WatchSource:0}: Error finding container b4015004367d91e2cab3a34603a784916215581d1778c4fb1b7b358f88fa4ade: Status 404 returned error can't find the container with id b4015004367d91e2cab3a34603a784916215581d1778c4fb1b7b358f88fa4ade
Jul 18 02:03:51.153018 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:51.152930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274" event={"ID":"b9e4613d-73f8-4aca-b440-575545b54bf9","Type":"ContainerStarted","Data":"b4015004367d91e2cab3a34603a784916215581d1778c4fb1b7b358f88fa4ade"}
Jul 18 02:03:52.159828 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:52.159782    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274" event={"ID":"b9e4613d-73f8-4aca-b440-575545b54bf9","Type":"ContainerStarted","Data":"99b0012247f03ddd95c51be2364ba24caeb45307b98d868d306b8814366c460b"}
Jul 18 02:03:52.176819 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:03:52.176772    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274" podStartSLOduration=2.053240178 podStartE2EDuration="3.176757315s" totalImagesPullingTime="1.123517137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:03:52.175041547 +0000 UTC m=+786.812294828" watchObservedRunningTime="2026-07-18 02:03:52.176757315 +0000 UTC m=+786.814010639"
Jul 18 02:04:00.304303 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:04:00.304273    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:04:00.304798 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:04:00.304335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:04:00.316413 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:04:00.316386    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:04:01.218634 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:04:01.218602    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5f274"
Jul 18 02:05:45.810261 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:45.810189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:05:45.811611 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:45.811587    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:05:46.419426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.419394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58778cdb86-5ssxf"]
Jul 18 02:05:46.423019 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.423002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.432905 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.432876    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58778cdb86-5ssxf"]
Jul 18 02:05:46.560361 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.560335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmk6\" (UniqueName: \"kubernetes.io/projected/70c468e5-87b1-4820-a068-2c1984efeeab-kube-api-access-vzmk6\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.560500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.560410    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70c468e5-87b1-4820-a068-2c1984efeeab-tls-cert\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.661423 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.661391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70c468e5-87b1-4820-a068-2c1984efeeab-tls-cert\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.661550 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.661436    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmk6\" (UniqueName: \"kubernetes.io/projected/70c468e5-87b1-4820-a068-2c1984efeeab-kube-api-access-vzmk6\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.663700 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.663672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70c468e5-87b1-4820-a068-2c1984efeeab-tls-cert\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.668665 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.668641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmk6\" (UniqueName: \"kubernetes.io/projected/70c468e5-87b1-4820-a068-2c1984efeeab-kube-api-access-vzmk6\") pod \"authorino-58778cdb86-5ssxf\" (UID: \"70c468e5-87b1-4820-a068-2c1984efeeab\") " pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.733349 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.733265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58778cdb86-5ssxf"
Jul 18 02:05:46.871471 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:46.871446    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58778cdb86-5ssxf"]
Jul 18 02:05:46.872960 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:05:46.872934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70c468e5_87b1_4820_a068_2c1984efeeab.slice/crio-0dd985f96dfcbc4ff9a5aa4e9cf46a823ece6ee1ae4ba1e1db39fcec62dded6f WatchSource:0}: Error finding container 0dd985f96dfcbc4ff9a5aa4e9cf46a823ece6ee1ae4ba1e1db39fcec62dded6f: Status 404 returned error can't find the container with id 0dd985f96dfcbc4ff9a5aa4e9cf46a823ece6ee1ae4ba1e1db39fcec62dded6f
Jul 18 02:05:47.789571 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:47.789530    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58778cdb86-5ssxf" event={"ID":"70c468e5-87b1-4820-a068-2c1984efeeab","Type":"ContainerStarted","Data":"6d8c59734bfc5c80a9202d68cbc924e81fc4b5904f63513130d4888921ea5e7d"}
Jul 18 02:05:47.789769 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:47.789584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58778cdb86-5ssxf" event={"ID":"70c468e5-87b1-4820-a068-2c1984efeeab","Type":"ContainerStarted","Data":"0dd985f96dfcbc4ff9a5aa4e9cf46a823ece6ee1ae4ba1e1db39fcec62dded6f"}
Jul 18 02:05:47.807206 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:47.807142    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58778cdb86-5ssxf" podStartSLOduration=1.488573586 podStartE2EDuration="1.807118389s" totalImagesPullingTime="318.544803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:05:47.803994891 +0000 UTC m=+902.441248172" watchObservedRunningTime="2026-07-18 02:05:47.807118389 +0000 UTC m=+902.444371671"
Jul 18 02:05:47.843469 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:47.842796    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:05:47.843469 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:47.843148    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" podUID="f1d75fd5-4797-46ac-a208-4dced4a67209" containerName="authorino" containerID="cri-o://81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a" gracePeriod=30
Jul 18 02:05:48.120736 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.120708    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:05:48.277899 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.277868    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert\") pod \"f1d75fd5-4797-46ac-a208-4dced4a67209\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") "
Jul 18 02:05:48.278090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.277966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvqhv\" (UniqueName: \"kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv\") pod \"f1d75fd5-4797-46ac-a208-4dced4a67209\" (UID: \"f1d75fd5-4797-46ac-a208-4dced4a67209\") "
Jul 18 02:05:48.280129 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.280098    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv" (OuterVolumeSpecName: "kube-api-access-gvqhv") pod "f1d75fd5-4797-46ac-a208-4dced4a67209" (UID: "f1d75fd5-4797-46ac-a208-4dced4a67209"). InnerVolumeSpecName "kube-api-access-gvqhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:05:48.288551 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.288523    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f1d75fd5-4797-46ac-a208-4dced4a67209" (UID: "f1d75fd5-4797-46ac-a208-4dced4a67209"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:05:48.379359 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.379332    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvqhv\" (UniqueName: \"kubernetes.io/projected/f1d75fd5-4797-46ac-a208-4dced4a67209-kube-api-access-gvqhv\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:05:48.379359 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.379358    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f1d75fd5-4797-46ac-a208-4dced4a67209-tls-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:05:48.795925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.795890    2563 generic.go:356] "Generic (PLEG): container finished" podID="f1d75fd5-4797-46ac-a208-4dced4a67209" containerID="81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a" exitCode=0
Jul 18 02:05:48.796130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.795931    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d8d986c5-2pdn4"
Jul 18 02:05:48.796130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.795951    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" event={"ID":"f1d75fd5-4797-46ac-a208-4dced4a67209","Type":"ContainerDied","Data":"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"}
Jul 18 02:05:48.796130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.795996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d8d986c5-2pdn4" event={"ID":"f1d75fd5-4797-46ac-a208-4dced4a67209","Type":"ContainerDied","Data":"cf0a49de05676ca7fd9cf9a79ef631fa69422f69028779b7093ce1531d05bf1b"}
Jul 18 02:05:48.796130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.796023    2563 scope.go:117] "RemoveContainer" containerID="81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"
Jul 18 02:05:48.806357 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.806341    2563 scope.go:117] "RemoveContainer" containerID="81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"
Jul 18 02:05:48.806626 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:05:48.806608    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a\": container with ID starting with 81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a not found: ID does not exist" containerID="81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"
Jul 18 02:05:48.806680 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.806633    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a"} err="failed to get container status \"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a\": rpc error: code = NotFound desc = could not find container \"81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a\": container with ID starting with 81d4a66195aebeec115f6fe451d51b3c367d4dca33e2ba88632acfd79b68775a not found: ID does not exist"
Jul 18 02:05:48.818711 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.818690    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:05:48.820883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:48.820863    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76d8d986c5-2pdn4"]
Jul 18 02:05:49.891303 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:05:49.891266    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1d75fd5-4797-46ac-a208-4dced4a67209" path="/var/lib/kubelet/pods/f1d75fd5-4797-46ac-a208-4dced4a67209/volumes"
Jul 18 02:06:36.497852 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.497818    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:06:36.498478 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.498055    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" podUID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" containerName="manager" containerID="cri-o://ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125" gracePeriod=30
Jul 18 02:06:36.748480 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.748425    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:06:36.878351 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.878328    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert\") pod \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") "
Jul 18 02:06:36.878497 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.878366    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms4ps\" (UniqueName: \"kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps\") pod \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\" (UID: \"e97cf852-e554-4f4a-b6e4-44642f2d4ec0\") "
Jul 18 02:06:36.880237 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.880207    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e97cf852-e554-4f4a-b6e4-44642f2d4ec0" (UID: "e97cf852-e554-4f4a-b6e4-44642f2d4ec0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:06:36.880360 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.880302    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps" (OuterVolumeSpecName: "kube-api-access-ms4ps") pod "e97cf852-e554-4f4a-b6e4-44642f2d4ec0" (UID: "e97cf852-e554-4f4a-b6e4-44642f2d4ec0"). InnerVolumeSpecName "kube-api-access-ms4ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:06:36.979912 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.979888    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-webhook-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:06:36.979912 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:36.979910    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms4ps\" (UniqueName: \"kubernetes.io/projected/e97cf852-e554-4f4a-b6e4-44642f2d4ec0-kube-api-access-ms4ps\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:06:37.061436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.061369    2563 generic.go:356] "Generic (PLEG): container finished" podID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" containerID="ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125" exitCode=0
Jul 18 02:06:37.061436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.061421    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx"
Jul 18 02:06:37.061586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.061457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" event={"ID":"e97cf852-e554-4f4a-b6e4-44642f2d4ec0","Type":"ContainerDied","Data":"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"}
Jul 18 02:06:37.061586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.061509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-zhwvx" event={"ID":"e97cf852-e554-4f4a-b6e4-44642f2d4ec0","Type":"ContainerDied","Data":"eb3a56429e90ba605fc8b76837f5345f94e7928765dcc8ecbbfa23a860e50a85"}
Jul 18 02:06:37.061586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.061533    2563 scope.go:117] "RemoveContainer" containerID="ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"
Jul 18 02:06:37.071098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.071081    2563 scope.go:117] "RemoveContainer" containerID="ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"
Jul 18 02:06:37.071356 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:06:37.071338    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125\": container with ID starting with ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125 not found: ID does not exist" containerID="ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"
Jul 18 02:06:37.071418 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.071365    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125"} err="failed to get container status \"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125\": rpc error: code = NotFound desc = could not find container \"ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125\": container with ID starting with ba02ebe8a5fec32df4098adb4b18f6bbc0734e3ef37e9a551fcbe43ca866d125 not found: ID does not exist"
Jul 18 02:06:37.083094 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.083072    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:06:37.085023 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.085003    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-zhwvx"]
Jul 18 02:06:37.892078 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:06:37.892031    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" path="/var/lib/kubelet/pods/e97cf852-e554-4f4a-b6e4-44642f2d4ec0/volumes"
Jul 18 02:07:37.863629 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.863556    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:37.864090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.863985    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" containerName="manager"
Jul 18 02:07:37.864090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.864001    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" containerName="manager"
Jul 18 02:07:37.864090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.864015    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1d75fd5-4797-46ac-a208-4dced4a67209" containerName="authorino"
Jul 18 02:07:37.864090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.864021    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1d75fd5-4797-46ac-a208-4dced4a67209" containerName="authorino"
Jul 18 02:07:37.864226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.864116    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e97cf852-e554-4f4a-b6e4-44642f2d4ec0" containerName="manager"
Jul 18 02:07:37.864226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.864127    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1d75fd5-4797-46ac-a208-4dced4a67209" containerName="authorino"
Jul 18 02:07:37.867232 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.867212    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:37.870804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.870786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 02:07:37.870936 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.870815    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcz2x\""
Jul 18 02:07:37.870936 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.870835    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 02:07:37.875351 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.875018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:37.968200 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.968171    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ppbs\" (UniqueName: \"kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:37.968316 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:37.968220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.068991 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.068963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ppbs\" (UniqueName: \"kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.069130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.069010    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.071144 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.071125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.076621 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.076602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ppbs\" (UniqueName: \"kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs\") pod \"maas-controller-ff5bb5c77-4mvc8\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") " pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.179492 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.179439    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:38.308549 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.308522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:38.309871 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:07:38.309844    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5757bf_655b_4eca_bd2b_edad4fee5e6e.slice/crio-bfbfc49d880be74b958b3f4d239ab99aa9d3849b399b906f89d66716a288248a WatchSource:0}: Error finding container bfbfc49d880be74b958b3f4d239ab99aa9d3849b399b906f89d66716a288248a: Status 404 returned error can't find the container with id bfbfc49d880be74b958b3f4d239ab99aa9d3849b399b906f89d66716a288248a
Jul 18 02:07:38.311137 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.311119    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:07:38.382411 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:38.382382    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" event={"ID":"4c5757bf-655b-4eca-bd2b-edad4fee5e6e","Type":"ContainerStarted","Data":"bfbfc49d880be74b958b3f4d239ab99aa9d3849b399b906f89d66716a288248a"}
Jul 18 02:07:39.389174 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:39.389135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" event={"ID":"4c5757bf-655b-4eca-bd2b-edad4fee5e6e","Type":"ContainerStarted","Data":"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"}
Jul 18 02:07:39.389557 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:39.389201    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:39.405830 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:39.405772    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" podStartSLOduration=1.846351877 podStartE2EDuration="2.405755495s" totalImagesPullingTime="559.403618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:07:39.40357019 +0000 UTC m=+1014.040823472" watchObservedRunningTime="2026-07-18 02:07:39.405755495 +0000 UTC m=+1014.043008797"
Jul 18 02:07:45.856099 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:45.856065    2563 scope.go:117] "RemoveContainer" containerID="758ca9c1d5a670ff5339af3285045fec9a5cc0ac0e40b4dfa53c278d4169467d"
Jul 18 02:07:50.397494 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:50.397466    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:55.028896 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.028847    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:55.029417 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.029147    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" podUID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" containerName="manager" containerID="cri-o://1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62" gracePeriod=30
Jul 18 02:07:55.278030 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.278005    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:55.403728 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.403703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ppbs\" (UniqueName: \"kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs\") pod \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") "
Jul 18 02:07:55.403861 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.403740    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert\") pod \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\" (UID: \"4c5757bf-655b-4eca-bd2b-edad4fee5e6e\") "
Jul 18 02:07:55.405687 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.405655    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4c5757bf-655b-4eca-bd2b-edad4fee5e6e" (UID: "4c5757bf-655b-4eca-bd2b-edad4fee5e6e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:07:55.405822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.405798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs" (OuterVolumeSpecName: "kube-api-access-8ppbs") pod "4c5757bf-655b-4eca-bd2b-edad4fee5e6e" (UID: "4c5757bf-655b-4eca-bd2b-edad4fee5e6e"). InnerVolumeSpecName "kube-api-access-8ppbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:07:55.477944 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.477916    2563 generic.go:356] "Generic (PLEG): container finished" podID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" containerID="1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62" exitCode=0
Jul 18 02:07:55.478143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.477963    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8"
Jul 18 02:07:55.478143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.477964    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" event={"ID":"4c5757bf-655b-4eca-bd2b-edad4fee5e6e","Type":"ContainerDied","Data":"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"}
Jul 18 02:07:55.478143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.478022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-4mvc8" event={"ID":"4c5757bf-655b-4eca-bd2b-edad4fee5e6e","Type":"ContainerDied","Data":"bfbfc49d880be74b958b3f4d239ab99aa9d3849b399b906f89d66716a288248a"}
Jul 18 02:07:55.478143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.478064    2563 scope.go:117] "RemoveContainer" containerID="1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"
Jul 18 02:07:55.487417 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.487399    2563 scope.go:117] "RemoveContainer" containerID="1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"
Jul 18 02:07:55.487705 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:07:55.487684    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62\": container with ID starting with 1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62 not found: ID does not exist" containerID="1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"
Jul 18 02:07:55.487756 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.487715    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62"} err="failed to get container status \"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62\": rpc error: code = NotFound desc = could not find container \"1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62\": container with ID starting with 1a2ba9fefab9b4fbe8bcbbfa6daa8178072d2a83083dc68bd32aa1d54cdbfd62 not found: ID does not exist"
Jul 18 02:07:55.499399 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.499378    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:55.502755 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.502734    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-4mvc8"]
Jul 18 02:07:55.504803 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.504784    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-webhook-cert\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:07:55.504871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.504808    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ppbs\" (UniqueName: \"kubernetes.io/projected/4c5757bf-655b-4eca-bd2b-edad4fee5e6e-kube-api-access-8ppbs\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:07:55.893063 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:55.893017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" path="/var/lib/kubelet/pods/4c5757bf-655b-4eca-bd2b-edad4fee5e6e/volumes"
Jul 18 02:07:56.270439 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.270368    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-v9sd5"]
Jul 18 02:07:56.270778 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.270749    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" containerName="manager"
Jul 18 02:07:56.270778 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.270760    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" containerName="manager"
Jul 18 02:07:56.270852 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.270820    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5757bf-655b-4eca-bd2b-edad4fee5e6e" containerName="manager"
Jul 18 02:07:56.275098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.275081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.278729 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.278705    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 18 02:07:56.278853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.278705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcz2x\""
Jul 18 02:07:56.278853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.278771    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 18 02:07:56.282163 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.282137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-v9sd5"]
Jul 18 02:07:56.412164 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.412125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc6z7\" (UniqueName: \"kubernetes.io/projected/d8be7021-3e8f-42a9-bac9-beb126b7c717-kube-api-access-jc6z7\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.412164 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.412168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8be7021-3e8f-42a9-bac9-beb126b7c717-webhook-cert\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.513481 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.513450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc6z7\" (UniqueName: \"kubernetes.io/projected/d8be7021-3e8f-42a9-bac9-beb126b7c717-kube-api-access-jc6z7\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.513631 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.513486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8be7021-3e8f-42a9-bac9-beb126b7c717-webhook-cert\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.515813 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.515788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d8be7021-3e8f-42a9-bac9-beb126b7c717-webhook-cert\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.521409 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.521358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc6z7\" (UniqueName: \"kubernetes.io/projected/d8be7021-3e8f-42a9-bac9-beb126b7c717-kube-api-access-jc6z7\") pod \"maas-controller-ff5bb5c77-v9sd5\" (UID: \"d8be7021-3e8f-42a9-bac9-beb126b7c717\") " pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.586178 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.586152    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:56.920805 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:56.920777    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ff5bb5c77-v9sd5"]
Jul 18 02:07:56.922979 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:07:56.922956    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8be7021_3e8f_42a9_bac9_beb126b7c717.slice/crio-087f86d7186147dd7758c7d728310f3ef163032cb1ba821e2285d3dc2e281fce WatchSource:0}: Error finding container 087f86d7186147dd7758c7d728310f3ef163032cb1ba821e2285d3dc2e281fce: Status 404 returned error can't find the container with id 087f86d7186147dd7758c7d728310f3ef163032cb1ba821e2285d3dc2e281fce
Jul 18 02:07:57.493198 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:57.493161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5" event={"ID":"d8be7021-3e8f-42a9-bac9-beb126b7c717","Type":"ContainerStarted","Data":"1b002bc3a9feb2a53f1fadfe4ca5dc05b8b4c86a993383af8b57fc8760d39224"}
Jul 18 02:07:57.493576 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:57.493230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5" event={"ID":"d8be7021-3e8f-42a9-bac9-beb126b7c717","Type":"ContainerStarted","Data":"087f86d7186147dd7758c7d728310f3ef163032cb1ba821e2285d3dc2e281fce"}
Jul 18 02:07:57.493576 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:57.493276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:07:57.512148 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:07:57.512101    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5" podStartSLOduration=1.122531964 podStartE2EDuration="1.512084855s" totalImagesPullingTime="389.552891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:07:57.510401586 +0000 UTC m=+1032.147654867" watchObservedRunningTime="2026-07-18 02:07:57.512084855 +0000 UTC m=+1032.149338135"
Jul 18 02:08:08.506676 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:08:08.506642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ff5bb5c77-v9sd5"
Jul 18 02:10:45.847082 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:10:45.847026    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:10:45.849999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:10:45.849975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:12:40.710988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:40.710950    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:12:40.713442 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:40.711173    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" podUID="4280246f-c6ba-4eed-b082-d7431b3a827d" containerName="manager" containerID="cri-o://103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1" gracePeriod=10
Jul 18 02:12:43.871672 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:43.871646    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:12:43.983628 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:43.983548    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume\") pod \"4280246f-c6ba-4eed-b082-d7431b3a827d\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") "
Jul 18 02:12:43.983628 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:43.983625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68ddp\" (UniqueName: \"kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp\") pod \"4280246f-c6ba-4eed-b082-d7431b3a827d\" (UID: \"4280246f-c6ba-4eed-b082-d7431b3a827d\") "
Jul 18 02:12:43.983910 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:43.983885    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4280246f-c6ba-4eed-b082-d7431b3a827d" (UID: "4280246f-c6ba-4eed-b082-d7431b3a827d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 02:12:43.985596 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:43.985569    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp" (OuterVolumeSpecName: "kube-api-access-68ddp") pod "4280246f-c6ba-4eed-b082-d7431b3a827d" (UID: "4280246f-c6ba-4eed-b082-d7431b3a827d"). InnerVolumeSpecName "kube-api-access-68ddp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:12:44.059232 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.059199    2563 generic.go:356] "Generic (PLEG): container finished" podID="4280246f-c6ba-4eed-b082-d7431b3a827d" containerID="103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1" exitCode=0
Jul 18 02:12:44.059232 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.059233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"
Jul 18 02:12:44.059428 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.059229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" event={"ID":"4280246f-c6ba-4eed-b082-d7431b3a827d","Type":"ContainerDied","Data":"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"}
Jul 18 02:12:44.059428 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.059290    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b" event={"ID":"4280246f-c6ba-4eed-b082-d7431b3a827d","Type":"ContainerDied","Data":"7c57044dc5c3eefde86bf5123e24b54ca4be607d718fec13a29a768b505ce431"}
Jul 18 02:12:44.059428 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.059312    2563 scope.go:117] "RemoveContainer" containerID="103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"
Jul 18 02:12:44.068723 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.068706    2563 scope.go:117] "RemoveContainer" containerID="103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"
Jul 18 02:12:44.068976 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:12:44.068959    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1\": container with ID starting with 103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1 not found: ID does not exist" containerID="103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"
Jul 18 02:12:44.069059 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.068990    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1"} err="failed to get container status \"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1\": rpc error: code = NotFound desc = could not find container \"103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1\": container with ID starting with 103585b762731b3e8d2feee74c8b88b60f55a1f2e551d80eb2adc49db6985ea1 not found: ID does not exist"
Jul 18 02:12:44.081456 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.081434    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:12:44.085110 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.085087    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4280246f-c6ba-4eed-b082-d7431b3a827d-extensions-socket-volume\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:12:44.085199 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.085114    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68ddp\" (UniqueName: \"kubernetes.io/projected/4280246f-c6ba-4eed-b082-d7431b3a827d-kube-api-access-68ddp\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:12:44.085250 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:44.085196    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-skl4b"]
Jul 18 02:12:45.892500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:12:45.892469    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4280246f-c6ba-4eed-b082-d7431b3a827d" path="/var/lib/kubelet/pods/4280246f-c6ba-4eed-b082-d7431b3a827d/volumes"
Jul 18 02:13:41.850131 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.850021    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"]
Jul 18 02:13:41.850620 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.850500    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4280246f-c6ba-4eed-b082-d7431b3a827d" containerName="manager"
Jul 18 02:13:41.850620 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.850515    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4280246f-c6ba-4eed-b082-d7431b3a827d" containerName="manager"
Jul 18 02:13:41.850620 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.850607    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4280246f-c6ba-4eed-b082-d7431b3a827d" containerName="manager"
Jul 18 02:13:41.853613 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.853597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:41.856521 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.856500    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-glnkl\""
Jul 18 02:13:41.865019 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:41.864995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"]
Jul 18 02:13:42.021039 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.021004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e397f6-6ca5-42c6-aaaa-272b410e5245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.021219 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.021122    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrg9\" (UniqueName: \"kubernetes.io/projected/32e397f6-6ca5-42c6-aaaa-272b410e5245-kube-api-access-hkrg9\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.121814 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.121775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrg9\" (UniqueName: \"kubernetes.io/projected/32e397f6-6ca5-42c6-aaaa-272b410e5245-kube-api-access-hkrg9\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.121955 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.121840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e397f6-6ca5-42c6-aaaa-272b410e5245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.122202 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.122185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32e397f6-6ca5-42c6-aaaa-272b410e5245-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.133853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.133827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrg9\" (UniqueName: \"kubernetes.io/projected/32e397f6-6ca5-42c6-aaaa-272b410e5245-kube-api-access-hkrg9\") pod \"kuadrant-operator-controller-manager-86878c769f-jxx8h\" (UID: \"32e397f6-6ca5-42c6-aaaa-272b410e5245\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.164814 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.164791    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:42.303529 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.303507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"]
Jul 18 02:13:42.305636 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:13:42.305608    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e397f6_6ca5_42c6_aaaa_272b410e5245.slice/crio-b2a563015fc7c69d1805428d60d9699fc7bf3d8835e15ae9a215bc56be6a91c8 WatchSource:0}: Error finding container b2a563015fc7c69d1805428d60d9699fc7bf3d8835e15ae9a215bc56be6a91c8: Status 404 returned error can't find the container with id b2a563015fc7c69d1805428d60d9699fc7bf3d8835e15ae9a215bc56be6a91c8
Jul 18 02:13:42.377110 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:42.377077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h" event={"ID":"32e397f6-6ca5-42c6-aaaa-272b410e5245","Type":"ContainerStarted","Data":"b2a563015fc7c69d1805428d60d9699fc7bf3d8835e15ae9a215bc56be6a91c8"}
Jul 18 02:13:43.383863 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:43.383824    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h" event={"ID":"32e397f6-6ca5-42c6-aaaa-272b410e5245","Type":"ContainerStarted","Data":"64dc49b29b8855fa8c8935cdacfd335d37c33c401e908d8e46e3a53ab96a7ba5"}
Jul 18 02:13:43.384373 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:43.383898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:13:43.405491 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:43.405444    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h" podStartSLOduration=2.4054297 podStartE2EDuration="2.4054297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:13:43.402098981 +0000 UTC m=+1378.039352258" watchObservedRunningTime="2026-07-18 02:13:43.4054297 +0000 UTC m=+1378.042682980"
Jul 18 02:13:54.392188 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:13:54.392157    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jxx8h"
Jul 18 02:15:00.140932 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.140898    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"]
Jul 18 02:15:00.145185 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.145167    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"
Jul 18 02:15:00.147829 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.147796    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:15:00.149746 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.149721    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"]
Jul 18 02:15:00.156796 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.156772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"
Jul 18 02:15:00.495321 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.495298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"]
Jul 18 02:15:00.497188 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:15:00.497159    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5da3b59_0341_4d46_83fc_71f5a8d019d3.slice/crio-9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0 WatchSource:0}: Error finding container 9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0: Status 404 returned error can't find the container with id 9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0
Jul 18 02:15:00.498914 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.498896    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:15:00.798435 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:00.798349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f" event={"ID":"d5da3b59-0341-4d46-83fc-71f5a8d019d3","Type":"ContainerStarted","Data":"9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0"}
Jul 18 02:15:03.816210 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:03.816129    2563 generic.go:356] "Generic (PLEG): container finished" podID="d5da3b59-0341-4d46-83fc-71f5a8d019d3" containerID="cf76ebb4f08f6bb03099bab65ea041ba9e5bfcc66e21ff90fc633fe0730413d5" exitCode=0
Jul 18 02:15:03.816539 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:03.816212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f" event={"ID":"d5da3b59-0341-4d46-83fc-71f5a8d019d3","Type":"ContainerDied","Data":"cf76ebb4f08f6bb03099bab65ea041ba9e5bfcc66e21ff90fc633fe0730413d5"}
Jul 18 02:15:04.956836 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:04.956811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"
Jul 18 02:15:05.828147 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:05.828104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f"
Jul 18 02:15:05.828147 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:05.828142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739015-z2r7f" event={"ID":"d5da3b59-0341-4d46-83fc-71f5a8d019d3","Type":"ContainerDied","Data":"9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0"}
Jul 18 02:15:05.828382 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:05.828207    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a1cc0d2082d753b8855ece90e40c5b217d2050a65dd73ddfbf1cc8f78429ce0"
Jul 18 02:15:45.883494 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:45.883469    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:15:45.889934 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:15:45.889909    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:20:18.568067 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.568016    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:18.568582 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.568506    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5da3b59-0341-4d46-83fc-71f5a8d019d3" containerName="cleanup"
Jul 18 02:20:18.568582 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.568522    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5da3b59-0341-4d46-83fc-71f5a8d019d3" containerName="cleanup"
Jul 18 02:20:18.568681 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.568599    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5da3b59-0341-4d46-83fc-71f5a8d019d3" containerName="cleanup"
Jul 18 02:20:18.571725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.571705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.574450 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.574427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c90146c5-serving-cert\""
Jul 18 02:20:18.585326 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.585304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:18.691175 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.691146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.691368 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.691180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bphgm\" (UniqueName: \"kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.691368 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.691288    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.792538 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.792509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.792710 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.792544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bphgm\" (UniqueName: \"kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.792710 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.792588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.793255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.793231    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.794746 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.794727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.801386 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.801360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bphgm\" (UniqueName: \"kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm\") pod \"maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:18.884077 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:18.884033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:19.026788 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:19.026759    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:19.028019 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:20:19.027991    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd84e762_2e16_46bf_9fcb_378a2693e1ca.slice/crio-00376284165bf86309d1b9cd1aa5a276a2d8c5fe4a4486eaf937243ad451ace6 WatchSource:0}: Error finding container 00376284165bf86309d1b9cd1aa5a276a2d8c5fe4a4486eaf937243ad451ace6: Status 404 returned error can't find the container with id 00376284165bf86309d1b9cd1aa5a276a2d8c5fe4a4486eaf937243ad451ace6
Jul 18 02:20:19.029564 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:19.029540    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:20:19.531795 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:19.531768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" event={"ID":"bd84e762-2e16-46bf-9fcb-378a2693e1ca","Type":"ContainerStarted","Data":"00376284165bf86309d1b9cd1aa5a276a2d8c5fe4a4486eaf937243ad451ace6"}
Jul 18 02:20:20.540563 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:20.540528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" event={"ID":"bd84e762-2e16-46bf-9fcb-378a2693e1ca","Type":"ContainerStarted","Data":"f43203899d0ec208bcc483f4cc7351cb4e2f96d34479da8b15e95f5895ee68bb"}
Jul 18 02:20:20.540943 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:20.540594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:20.557257 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:20.557209    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" podStartSLOduration=2.109369972 podStartE2EDuration="2.557193465s" totalImagesPullingTime="447.823493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:20:20.556460298 +0000 UTC m=+1775.193713579" watchObservedRunningTime="2026-07-18 02:20:20.557193465 +0000 UTC m=+1775.194446797"
Jul 18 02:20:26.551670 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:26.551585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:44.057290 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.057258    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"]
Jul 18 02:20:44.060862 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.060840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:44.063938 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.063902    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:20:44.069090 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.069034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"]
Jul 18 02:20:44.081005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.080982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc\" (UID: \"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:44.182271 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.182240    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc\" (UID: \"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:44.182857 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.182837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc\" (UID: \"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:44.375482 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.375460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:44.514210 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:20:44.514167    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c61655_98e1_4fe9_a32d_3ceb8b3adfe8.slice/crio-b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1 WatchSource:0}: Error finding container b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1: Status 404 returned error can't find the container with id b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1
Jul 18 02:20:44.514442 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.514416    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"]
Jul 18 02:20:44.677095 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:44.677021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc" event={"ID":"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8","Type":"ContainerStarted","Data":"b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1"}
Jul 18 02:20:45.683405 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:45.683371    2563 generic.go:356] "Generic (PLEG): container finished" podID="31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" containerID="3e7abad7ddaf28354a4de7a68a116636494191f29440a212ddd6fbc4b2f596b2" exitCode=0
Jul 18 02:20:45.683754 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:45.683427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc" event={"ID":"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8","Type":"ContainerDied","Data":"3e7abad7ddaf28354a4de7a68a116636494191f29440a212ddd6fbc4b2f596b2"}
Jul 18 02:20:45.921444 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:45.921420    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:20:45.933258 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:45.933230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:20:46.823091 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:46.823070    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:46.901830 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:46.901803    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca\") pod \"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8\" (UID: \"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8\") "
Jul 18 02:20:46.902201 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:46.902180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" (UID: "31c61655-98e1-4fe9-a32d-3ceb8b3adfe8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:20:47.002531 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:47.002475    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:20:47.695697 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:47.695671    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"
Jul 18 02:20:47.695871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:47.695671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc" event={"ID":"31c61655-98e1-4fe9-a32d-3ceb8b3adfe8","Type":"ContainerDied","Data":"b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1"}
Jul 18 02:20:47.695871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:47.695789    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b36b4d7580e6fd4d7eda9ce2bb5189ee78604c51e7945b9a79c3ea6b6dc505f1"
Jul 18 02:20:54.501596 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.501563    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:54.502067 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.501757    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" podUID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" containerName="maas-api" containerID="cri-o://f43203899d0ec208bcc483f4cc7351cb4e2f96d34479da8b15e95f5895ee68bb" gracePeriod=30
Jul 18 02:20:54.739412 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.739380    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" containerID="f43203899d0ec208bcc483f4cc7351cb4e2f96d34479da8b15e95f5895ee68bb" exitCode=0
Jul 18 02:20:54.739545 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.739468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" event={"ID":"bd84e762-2e16-46bf-9fcb-378a2693e1ca","Type":"ContainerDied","Data":"f43203899d0ec208bcc483f4cc7351cb4e2f96d34479da8b15e95f5895ee68bb"}
Jul 18 02:20:54.757423 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.757368    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:54.859984 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.859950    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls\") pod \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") "
Jul 18 02:20:54.860171 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.859991    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca\") pod \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") "
Jul 18 02:20:54.860171 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.860026    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bphgm\" (UniqueName: \"kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm\") pod \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\" (UID: \"bd84e762-2e16-46bf-9fcb-378a2693e1ca\") "
Jul 18 02:20:54.860397 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.860371    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd84e762-2e16-46bf-9fcb-378a2693e1ca" (UID: "bd84e762-2e16-46bf-9fcb-378a2693e1ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:20:54.862206 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.862184    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm" (OuterVolumeSpecName: "kube-api-access-bphgm") pod "bd84e762-2e16-46bf-9fcb-378a2693e1ca" (UID: "bd84e762-2e16-46bf-9fcb-378a2693e1ca"). InnerVolumeSpecName "kube-api-access-bphgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:20:54.862289 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.862210    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd84e762-2e16-46bf-9fcb-378a2693e1ca" (UID: "bd84e762-2e16-46bf-9fcb-378a2693e1ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:20:54.961624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.961599    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd84e762-2e16-46bf-9fcb-378a2693e1ca-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:20:54.961624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.961621    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd84e762-2e16-46bf-9fcb-378a2693e1ca-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:20:54.961624 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:54.961631    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bphgm\" (UniqueName: \"kubernetes.io/projected/bd84e762-2e16-46bf-9fcb-378a2693e1ca-kube-api-access-bphgm\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:20:55.747351 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.747324    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"
Jul 18 02:20:55.747749 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.747322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9" event={"ID":"bd84e762-2e16-46bf-9fcb-378a2693e1ca","Type":"ContainerDied","Data":"00376284165bf86309d1b9cd1aa5a276a2d8c5fe4a4486eaf937243ad451ace6"}
Jul 18 02:20:55.747749 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.747460    2563 scope.go:117] "RemoveContainer" containerID="f43203899d0ec208bcc483f4cc7351cb4e2f96d34479da8b15e95f5895ee68bb"
Jul 18 02:20:55.770717 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.770690    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:55.775573 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.775553    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c90146c5-67fdbccf84-8fxx9"]
Jul 18 02:20:55.891974 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:55.891952    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" path="/var/lib/kubelet/pods/bd84e762-2e16-46bf-9fcb-378a2693e1ca/volumes"
Jul 18 02:20:59.153707 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:59.153671    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"]
Jul 18 02:20:59.159813 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:59.159784    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c90146c5-tcvpc"]
Jul 18 02:20:59.891955 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:20:59.891925    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" path="/var/lib/kubelet/pods/31c61655-98e1-4fe9-a32d-3ceb8b3adfe8/volumes"
Jul 18 02:21:02.903356 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903322    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:02.903743 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903729    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" containerName="revoke-keys"
Jul 18 02:21:02.903788 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903746    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" containerName="revoke-keys"
Jul 18 02:21:02.903788 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903766    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" containerName="maas-api"
Jul 18 02:21:02.903788 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903772    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" containerName="maas-api"
Jul 18 02:21:02.903886 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903851    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd84e762-2e16-46bf-9fcb-378a2693e1ca" containerName="maas-api"
Jul 18 02:21:02.903886 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.903859    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="31c61655-98e1-4fe9-a32d-3ceb8b3adfe8" containerName="revoke-keys"
Jul 18 02:21:02.908663 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.908642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:02.911745 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.911721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-e5648ebb-serving-cert\""
Jul 18 02:21:02.919738 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.919713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:02.921438 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.921408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:02.921545 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.921478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkrzh\" (UniqueName: \"kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:02.921640 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:02.921621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.022117 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.022089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.022249 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.022130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.022249 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:21:03.022234    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-serving-cert: secret "maas-api-e2e-migrate-e5648ebb-serving-cert" not found
Jul 18 02:21:03.022328 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:21:03.022307    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls podName:39d55e81-c13e-4fd3-9ded-a63db2ce7d1f nodeName:}" failed. No retries permitted until 2026-07-18 02:21:03.522285098 +0000 UTC m=+1818.159538367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls") pod "maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" (UID: "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f") : secret "maas-api-e2e-migrate-e5648ebb-serving-cert" not found
Jul 18 02:21:03.022381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.022330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkrzh\" (UniqueName: \"kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.022814 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.022796    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.036916 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.036882    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkrzh\" (UniqueName: \"kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.526854 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.526823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.529218 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.529195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") pod \"maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.822706 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.822631    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:03.969194 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:03.969166    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:03.970153 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:21:03.970126    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d55e81_c13e_4fd3_9ded_a63db2ce7d1f.slice/crio-c5a38d788c62f7d553f8c75e2b13171d7098638eea5344b8022a72c4d255b59a WatchSource:0}: Error finding container c5a38d788c62f7d553f8c75e2b13171d7098638eea5344b8022a72c4d255b59a: Status 404 returned error can't find the container with id c5a38d788c62f7d553f8c75e2b13171d7098638eea5344b8022a72c4d255b59a
Jul 18 02:21:04.801819 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:04.801738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" event={"ID":"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f","Type":"ContainerStarted","Data":"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"}
Jul 18 02:21:04.801819 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:04.801793    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" event={"ID":"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f","Type":"ContainerStarted","Data":"c5a38d788c62f7d553f8c75e2b13171d7098638eea5344b8022a72c4d255b59a"}
Jul 18 02:21:04.802023 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:04.801835    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:04.820178 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:04.820131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" podStartSLOduration=2.325976689 podStartE2EDuration="2.820115922s" totalImagesPullingTime="494.139233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:21:04.819244118 +0000 UTC m=+1819.456497411" watchObservedRunningTime="2026-07-18 02:21:04.820115922 +0000 UTC m=+1819.457369238"
Jul 18 02:21:10.813166 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:10.813136    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:27.839289 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:27.839254    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"]
Jul 18 02:21:27.842766 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:27.842748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:27.845780 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:27.845757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:21:27.854703 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:27.854637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"]
Jul 18 02:21:27.922833 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:27.922804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn\" (UID: \"1784dab1-bd9d-4d33-ae62-cddfbf63cee4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:28.023695 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.023667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn\" (UID: \"1784dab1-bd9d-4d33-ae62-cddfbf63cee4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:28.024281 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.024257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn\" (UID: \"1784dab1-bd9d-4d33-ae62-cddfbf63cee4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:28.155507 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.155487    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:28.288842 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.288810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"]
Jul 18 02:21:28.291515 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:21:28.291490    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1784dab1_bd9d_4d33_ae62_cddfbf63cee4.slice/crio-c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a WatchSource:0}: Error finding container c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a: Status 404 returned error can't find the container with id c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a
Jul 18 02:21:28.936003 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.935954    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn" event={"ID":"1784dab1-bd9d-4d33-ae62-cddfbf63cee4","Type":"ContainerStarted","Data":"e4c2e0572e096dd3fb46adb1a9bfe818051a1458947407cd32ef1933d3aaf1c6"}
Jul 18 02:21:28.936392 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.936030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn" event={"ID":"1784dab1-bd9d-4d33-ae62-cddfbf63cee4","Type":"ContainerStarted","Data":"c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a"}
Jul 18 02:21:28.952742 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:28.952696    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn" podStartSLOduration=1.952679064 podStartE2EDuration="1.952679064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:21:28.951780903 +0000 UTC m=+1843.589034184" watchObservedRunningTime="2026-07-18 02:21:28.952679064 +0000 UTC m=+1843.589932549"
Jul 18 02:21:29.942257 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:29.942223    2563 generic.go:356] "Generic (PLEG): container finished" podID="1784dab1-bd9d-4d33-ae62-cddfbf63cee4" containerID="e4c2e0572e096dd3fb46adb1a9bfe818051a1458947407cd32ef1933d3aaf1c6" exitCode=0
Jul 18 02:21:29.942688 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:29.942278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn" event={"ID":"1784dab1-bd9d-4d33-ae62-cddfbf63cee4","Type":"ContainerDied","Data":"e4c2e0572e096dd3fb46adb1a9bfe818051a1458947407cd32ef1933d3aaf1c6"}
Jul 18 02:21:31.088067 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.088031    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:31.147324 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.147296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca\") pod \"1784dab1-bd9d-4d33-ae62-cddfbf63cee4\" (UID: \"1784dab1-bd9d-4d33-ae62-cddfbf63cee4\") "
Jul 18 02:21:31.147640 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.147617    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1784dab1-bd9d-4d33-ae62-cddfbf63cee4" (UID: "1784dab1-bd9d-4d33-ae62-cddfbf63cee4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:21:31.248085 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.248005    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1784dab1-bd9d-4d33-ae62-cddfbf63cee4-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:21:31.953354 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.953326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"
Jul 18 02:21:31.953454 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.953332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn" event={"ID":"1784dab1-bd9d-4d33-ae62-cddfbf63cee4","Type":"ContainerDied","Data":"c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a"}
Jul 18 02:21:31.953509 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:31.953453    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8a9e726102492fcefa2428803d621e348816c50140bae489f8faf4f9515ba8a"
Jul 18 02:21:38.582802 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.582771    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:38.583260 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.582972    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" podUID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" containerName="maas-api" containerID="cri-o://9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc" gracePeriod=30
Jul 18 02:21:38.826638 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.826615    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:38.903868 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.903842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca\") pod \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") "
Jul 18 02:21:38.903999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.903944    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkrzh\" (UniqueName: \"kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh\") pod \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") "
Jul 18 02:21:38.903999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.903966    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") pod \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\" (UID: \"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f\") "
Jul 18 02:21:38.904203 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.904180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" (UID: "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:21:38.905949 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.905918    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" (UID: "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:21:38.906083 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.905949    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh" (OuterVolumeSpecName: "kube-api-access-xkrzh") pod "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" (UID: "39d55e81-c13e-4fd3-9ded-a63db2ce7d1f"). InnerVolumeSpecName "kube-api-access-xkrzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:21:38.992400 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.992370    2563 generic.go:356] "Generic (PLEG): container finished" podID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" containerID="9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc" exitCode=0
Jul 18 02:21:38.992514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.992409    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"
Jul 18 02:21:38.992514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.992413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" event={"ID":"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f","Type":"ContainerDied","Data":"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"}
Jul 18 02:21:38.992514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.992471    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674" event={"ID":"39d55e81-c13e-4fd3-9ded-a63db2ce7d1f","Type":"ContainerDied","Data":"c5a38d788c62f7d553f8c75e2b13171d7098638eea5344b8022a72c4d255b59a"}
Jul 18 02:21:38.992514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:38.992499    2563 scope.go:117] "RemoveContainer" containerID="9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"
Jul 18 02:21:39.004347 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.004325    2563 scope.go:117] "RemoveContainer" containerID="9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"
Jul 18 02:21:39.004663 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.004636    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:21:39.004753 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.004671    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkrzh\" (UniqueName: \"kubernetes.io/projected/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-kube-api-access-xkrzh\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:21:39.004753 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.004688    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:21:39.004753 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:21:39.004639    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc\": container with ID starting with 9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc not found: ID does not exist" containerID="9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"
Jul 18 02:21:39.004753 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.004711    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc"} err="failed to get container status \"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc\": rpc error: code = NotFound desc = could not find container \"9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc\": container with ID starting with 9d0bd026d7c9aa00e7e57b986d4f7796507339bb5fb06fd4ee7d8ec0c8bb7cbc not found: ID does not exist"
Jul 18 02:21:39.039468 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.039446    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:39.048133 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.048114    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-e5648ebb-5b89c78475-4l674"]
Jul 18 02:21:39.892862 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:39.892830    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" path="/var/lib/kubelet/pods/39d55e81-c13e-4fd3-9ded-a63db2ce7d1f/volumes"
Jul 18 02:21:42.968645 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:42.968612    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"]
Jul 18 02:21:42.973667 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:42.973643    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e5648ebb-dxsmn"]
Jul 18 02:21:43.891854 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:43.891822    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1784dab1-bd9d-4d33-ae62-cddfbf63cee4" path="/var/lib/kubelet/pods/1784dab1-bd9d-4d33-ae62-cddfbf63cee4/volumes"
Jul 18 02:21:46.185493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.185454    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:21:46.186062 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186030    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1784dab1-bd9d-4d33-ae62-cddfbf63cee4" containerName="revoke-keys"
Jul 18 02:21:46.186168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186066    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1784dab1-bd9d-4d33-ae62-cddfbf63cee4" containerName="revoke-keys"
Jul 18 02:21:46.186168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186087    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" containerName="maas-api"
Jul 18 02:21:46.186168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186095    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" containerName="maas-api"
Jul 18 02:21:46.186323 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186196    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d55e81-c13e-4fd3-9ded-a63db2ce7d1f" containerName="maas-api"
Jul 18 02:21:46.186323 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.186214    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1784dab1-bd9d-4d33-ae62-cddfbf63cee4" containerName="revoke-keys"
Jul 18 02:21:46.191078 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.191057    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.193691 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.193660    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-602fb62c-serving-cert\""
Jul 18 02:21:46.202124 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.202099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:21:46.272850 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.272781    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.272850 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.272817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrh2\" (UniqueName: \"kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.272996 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.272849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.374143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.374118    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.374270 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.374147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrh2\" (UniqueName: \"kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.374270 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.374167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.374398 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:21:46.374306    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-serving-cert: secret "maas-api-e2e-ait-602fb62c-serving-cert" not found
Jul 18 02:21:46.374398 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:21:46.374363    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls podName:3520b6d1-d9dc-4fac-a6a8-66d0874a87b5 nodeName:}" failed. No retries permitted until 2026-07-18 02:21:46.874348738 +0000 UTC m=+1861.511601996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls") pod "maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" (UID: "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5") : secret "maas-api-e2e-ait-602fb62c-serving-cert" not found
Jul 18 02:21:46.374878 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.374853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.394685 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.394662    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrh2\" (UniqueName: \"kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.878400 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.878366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:46.880659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:46.880642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") pod \"maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:47.103394 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:47.103361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:47.266015 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:47.265964    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:21:47.268477 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:21:47.268446    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3520b6d1_d9dc_4fac_a6a8_66d0874a87b5.slice/crio-b4e24bb824be53b86828ac5fc80dbfdf5781c8c14542b59ad6a664260072ad47 WatchSource:0}: Error finding container b4e24bb824be53b86828ac5fc80dbfdf5781c8c14542b59ad6a664260072ad47: Status 404 returned error can't find the container with id b4e24bb824be53b86828ac5fc80dbfdf5781c8c14542b59ad6a664260072ad47
Jul 18 02:21:48.044853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:48.044769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" event={"ID":"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5","Type":"ContainerStarted","Data":"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"}
Jul 18 02:21:48.044853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:48.044828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" event={"ID":"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5","Type":"ContainerStarted","Data":"b4e24bb824be53b86828ac5fc80dbfdf5781c8c14542b59ad6a664260072ad47"}
Jul 18 02:21:48.044853 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:48.044852    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:21:48.077213 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:48.077098    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" podStartSLOduration=1.65265592 podStartE2EDuration="2.077079869s" totalImagesPullingTime="424.423949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:21:48.072469915 +0000 UTC m=+1862.709723195" watchObservedRunningTime="2026-07-18 02:21:48.077079869 +0000 UTC m=+1862.714333151"
Jul 18 02:21:54.055469 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:21:54.055440    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:22:11.877775 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:11.877697    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"]
Jul 18 02:22:11.882417 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:11.882398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:11.886329 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:11.886307    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:22:11.901950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:11.901929    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"]
Jul 18 02:22:11.973631 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:11.973604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj\" (UID: \"4979e823-93e2-490b-826f-e64315c9b5e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:12.075015 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:12.074987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj\" (UID: \"4979e823-93e2-490b-826f-e64315c9b5e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:12.075561 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:12.075541    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj\" (UID: \"4979e823-93e2-490b-826f-e64315c9b5e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:12.193151 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:12.193103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:12.367341 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:12.367313    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"]
Jul 18 02:22:12.369126 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:22:12.369100    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979e823_93e2_490b_826f_e64315c9b5e2.slice/crio-bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05 WatchSource:0}: Error finding container bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05: Status 404 returned error can't find the container with id bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05
Jul 18 02:22:13.183401 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:13.183365    2563 generic.go:356] "Generic (PLEG): container finished" podID="4979e823-93e2-490b-826f-e64315c9b5e2" containerID="3990245fbcab1d88057e77cf3bab4795cf1a9e45492849e38b3ed5a3f3b7f77d" exitCode=0
Jul 18 02:22:13.183710 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:13.183408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj" event={"ID":"4979e823-93e2-490b-826f-e64315c9b5e2","Type":"ContainerDied","Data":"3990245fbcab1d88057e77cf3bab4795cf1a9e45492849e38b3ed5a3f3b7f77d"}
Jul 18 02:22:13.183710 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:13.183470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj" event={"ID":"4979e823-93e2-490b-826f-e64315c9b5e2","Type":"ContainerStarted","Data":"bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05"}
Jul 18 02:22:14.321564 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:14.321538    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:14.392130 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:14.392104    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca\") pod \"4979e823-93e2-490b-826f-e64315c9b5e2\" (UID: \"4979e823-93e2-490b-826f-e64315c9b5e2\") "
Jul 18 02:22:14.392434 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:14.392415    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4979e823-93e2-490b-826f-e64315c9b5e2" (UID: "4979e823-93e2-490b-826f-e64315c9b5e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:22:14.493068 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:14.492961    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979e823-93e2-490b-826f-e64315c9b5e2-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:22:15.195429 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:15.195395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj" event={"ID":"4979e823-93e2-490b-826f-e64315c9b5e2","Type":"ContainerDied","Data":"bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05"}
Jul 18 02:22:15.195429 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:15.195427    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"
Jul 18 02:22:15.195634 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:15.195444    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc2dcfdc235a6da557be2201c7659a88b4398c2b9b05cae87b228ce2df6bbc05"
Jul 18 02:22:22.698373 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:22.698341    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:22:22.698830 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:22.698575    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" podUID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" containerName="maas-api" containerID="cri-o://e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904" gracePeriod=30
Jul 18 02:22:22.959336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:22.959281    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:22:23.058697 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.058670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca\") pod \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") "
Jul 18 02:22:23.058851 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.058715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrrh2\" (UniqueName: \"kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2\") pod \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") "
Jul 18 02:22:23.058851 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.058757    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") pod \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\" (UID: \"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5\") "
Jul 18 02:22:23.059096 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.059073    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" (UID: "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:22:23.060802 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.060774    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" (UID: "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:22:23.060889 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.060823    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2" (OuterVolumeSpecName: "kube-api-access-qrrh2") pod "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" (UID: "3520b6d1-d9dc-4fac-a6a8-66d0874a87b5"). InnerVolumeSpecName "kube-api-access-qrrh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:22:23.159523 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.159495    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:22:23.159523 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.159518    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrrh2\" (UniqueName: \"kubernetes.io/projected/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-kube-api-access-qrrh2\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:22:23.159651 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.159528    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:22:23.242334 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.242271    2563 generic.go:356] "Generic (PLEG): container finished" podID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" containerID="e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904" exitCode=0
Jul 18 02:22:23.242334 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.242315    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"
Jul 18 02:22:23.242453 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.242360    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" event={"ID":"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5","Type":"ContainerDied","Data":"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"}
Jul 18 02:22:23.242453 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.242411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v" event={"ID":"3520b6d1-d9dc-4fac-a6a8-66d0874a87b5","Type":"ContainerDied","Data":"b4e24bb824be53b86828ac5fc80dbfdf5781c8c14542b59ad6a664260072ad47"}
Jul 18 02:22:23.242453 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.242434    2563 scope.go:117] "RemoveContainer" containerID="e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"
Jul 18 02:22:23.251831 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.251814    2563 scope.go:117] "RemoveContainer" containerID="e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"
Jul 18 02:22:23.252125 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:22:23.252096    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904\": container with ID starting with e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904 not found: ID does not exist" containerID="e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"
Jul 18 02:22:23.252191 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.252133    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904"} err="failed to get container status \"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904\": rpc error: code = NotFound desc = could not find container \"e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904\": container with ID starting with e401fd0a1ddff995b6c863054925cf4c9c63670a2f6340fda7aabccf02685904 not found: ID does not exist"
Jul 18 02:22:23.285100 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.285077    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:22:23.292394 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.292373    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-602fb62c-6584d45b4d-ts47v"]
Jul 18 02:22:23.891839 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:23.891807    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" path="/var/lib/kubelet/pods/3520b6d1-d9dc-4fac-a6a8-66d0874a87b5/volumes"
Jul 18 02:22:27.036939 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:27.036906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"]
Jul 18 02:22:27.041539 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:27.041513    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-602fb62c-mhvdj"]
Jul 18 02:22:27.891885 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:27.891853    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4979e823-93e2-490b-826f-e64315c9b5e2" path="/var/lib/kubelet/pods/4979e823-93e2-490b-826f-e64315c9b5e2/volumes"
Jul 18 02:22:32.501261 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501224    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:22:32.501812 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501798    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979e823-93e2-490b-826f-e64315c9b5e2" containerName="revoke-keys"
Jul 18 02:22:32.501857 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501815    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979e823-93e2-490b-826f-e64315c9b5e2" containerName="revoke-keys"
Jul 18 02:22:32.501857 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501849    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" containerName="maas-api"
Jul 18 02:22:32.501930 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501858    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" containerName="maas-api"
Jul 18 02:22:32.501967 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501947    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3520b6d1-d9dc-4fac-a6a8-66d0874a87b5" containerName="maas-api"
Jul 18 02:22:32.501967 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.501960    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4979e823-93e2-490b-826f-e64315c9b5e2" containerName="revoke-keys"
Jul 18 02:22:32.506763 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.506744    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.516162 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.516141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-218ab5db-serving-cert\""
Jul 18 02:22:32.527426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.527401    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:22:32.637150 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.637114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.637335 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.637208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.637335 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.637237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvj7\" (UniqueName: \"kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.738666 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.738622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.738666 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.738668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvj7\" (UniqueName: \"kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.738899 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.738753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.738959 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:22:32.738902    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-serving-cert: secret "maas-api-e2e-derive-218ab5db-serving-cert" not found
Jul 18 02:22:32.739016 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:22:32.738967    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls podName:6903a872-753b-4d48-8b5d-82ac0068a205 nodeName:}" failed. No retries permitted until 2026-07-18 02:22:33.238941303 +0000 UTC m=+1907.876194560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls") pod "maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" (UID: "6903a872-753b-4d48-8b5d-82ac0068a205") : secret "maas-api-e2e-derive-218ab5db-serving-cert" not found
Jul 18 02:22:32.739298 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.739275    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:32.756407 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:32.756346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvj7\" (UniqueName: \"kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:33.242844 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:33.242802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:33.245235 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:33.245209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") pod \"maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:33.417398 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:33.417371    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:33.573751 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:22:33.573713    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6903a872_753b_4d48_8b5d_82ac0068a205.slice/crio-a501f0e3703fb8d57ff2e0b89e4224ef383bbebc2309119ef8428be9ff8d2d2e WatchSource:0}: Error finding container a501f0e3703fb8d57ff2e0b89e4224ef383bbebc2309119ef8428be9ff8d2d2e: Status 404 returned error can't find the container with id a501f0e3703fb8d57ff2e0b89e4224ef383bbebc2309119ef8428be9ff8d2d2e
Jul 18 02:22:33.577448 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:33.577422    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:22:34.307438 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:34.307338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" event={"ID":"6903a872-753b-4d48-8b5d-82ac0068a205","Type":"ContainerStarted","Data":"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"}
Jul 18 02:22:34.307601 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:34.307493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:34.307601 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:34.307514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" event={"ID":"6903a872-753b-4d48-8b5d-82ac0068a205","Type":"ContainerStarted","Data":"a501f0e3703fb8d57ff2e0b89e4224ef383bbebc2309119ef8428be9ff8d2d2e"}
Jul 18 02:22:34.359477 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:34.359428    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" podStartSLOduration=1.95098797 podStartE2EDuration="2.359413431s" totalImagesPullingTime="408.425461ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:22:34.357614586 +0000 UTC m=+1908.994867865" watchObservedRunningTime="2026-07-18 02:22:34.359413431 +0000 UTC m=+1908.996666711"
Jul 18 02:22:40.317597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:40.317569    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:22:57.277524 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.277489    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"]
Jul 18 02:22:57.281116 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.281099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:22:57.289095 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.289075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:22:57.312250 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.312222    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"]
Jul 18 02:22:57.440285 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.440252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n\" (UID: \"95d6d524-5f64-44be-8624-fad52a5c1617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:22:57.541381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.541306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n\" (UID: \"95d6d524-5f64-44be-8624-fad52a5c1617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:22:57.541940 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.541916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n\" (UID: \"95d6d524-5f64-44be-8624-fad52a5c1617\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:22:57.591377 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.591354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:22:57.743687 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:57.743661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"]
Jul 18 02:22:57.745597 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:22:57.745569    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d6d524_5f64_44be_8624_fad52a5c1617.slice/crio-969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8 WatchSource:0}: Error finding container 969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8: Status 404 returned error can't find the container with id 969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8
Jul 18 02:22:58.438389 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:58.438354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n" event={"ID":"95d6d524-5f64-44be-8624-fad52a5c1617","Type":"ContainerStarted","Data":"5c2e452cb732d6ab6db7b11f78d1b611ec8cf187f1b5baaf0c351a41c0818790"}
Jul 18 02:22:58.438781 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:58.438408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n" event={"ID":"95d6d524-5f64-44be-8624-fad52a5c1617","Type":"ContainerStarted","Data":"969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8"}
Jul 18 02:22:59.445737 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:59.445707    2563 generic.go:356] "Generic (PLEG): container finished" podID="95d6d524-5f64-44be-8624-fad52a5c1617" containerID="5c2e452cb732d6ab6db7b11f78d1b611ec8cf187f1b5baaf0c351a41c0818790" exitCode=0
Jul 18 02:22:59.446146 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:22:59.445775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n" event={"ID":"95d6d524-5f64-44be-8624-fad52a5c1617","Type":"ContainerDied","Data":"5c2e452cb732d6ab6db7b11f78d1b611ec8cf187f1b5baaf0c351a41c0818790"}
Jul 18 02:23:00.586995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:00.586972    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:23:00.664029 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:00.664003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca\") pod \"95d6d524-5f64-44be-8624-fad52a5c1617\" (UID: \"95d6d524-5f64-44be-8624-fad52a5c1617\") "
Jul 18 02:23:00.664319 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:00.664299    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "95d6d524-5f64-44be-8624-fad52a5c1617" (UID: "95d6d524-5f64-44be-8624-fad52a5c1617"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:23:00.764587 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:00.764531    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95d6d524-5f64-44be-8624-fad52a5c1617-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:23:01.457373 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:01.457341    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"
Jul 18 02:23:01.457583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:01.457388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n" event={"ID":"95d6d524-5f64-44be-8624-fad52a5c1617","Type":"ContainerDied","Data":"969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8"}
Jul 18 02:23:01.457583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:01.457459    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="969a2ba63a79930d37b7b088707260775746706571a71da1b95abaf9e5960ef8"
Jul 18 02:23:07.957114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:07.957078    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:23:07.957534 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:07.957285    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" podUID="6903a872-753b-4d48-8b5d-82ac0068a205" containerName="maas-api" containerID="cri-o://4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d" gracePeriod=30
Jul 18 02:23:08.207436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.207383    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:23:08.327058 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.327018    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") pod \"6903a872-753b-4d48-8b5d-82ac0068a205\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") "
Jul 18 02:23:08.327241 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.327107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqvj7\" (UniqueName: \"kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7\") pod \"6903a872-753b-4d48-8b5d-82ac0068a205\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") "
Jul 18 02:23:08.327241 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.327178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca\") pod \"6903a872-753b-4d48-8b5d-82ac0068a205\" (UID: \"6903a872-753b-4d48-8b5d-82ac0068a205\") "
Jul 18 02:23:08.327523 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.327499    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6903a872-753b-4d48-8b5d-82ac0068a205" (UID: "6903a872-753b-4d48-8b5d-82ac0068a205"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:23:08.329036 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.329005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7" (OuterVolumeSpecName: "kube-api-access-nqvj7") pod "6903a872-753b-4d48-8b5d-82ac0068a205" (UID: "6903a872-753b-4d48-8b5d-82ac0068a205"). InnerVolumeSpecName "kube-api-access-nqvj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:23:08.329142 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.329036    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6903a872-753b-4d48-8b5d-82ac0068a205" (UID: "6903a872-753b-4d48-8b5d-82ac0068a205"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:23:08.427999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.427960    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6903a872-753b-4d48-8b5d-82ac0068a205-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:23:08.427999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.427994    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6903a872-753b-4d48-8b5d-82ac0068a205-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:23:08.427999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.428005    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqvj7\" (UniqueName: \"kubernetes.io/projected/6903a872-753b-4d48-8b5d-82ac0068a205-kube-api-access-nqvj7\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:23:08.496992 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.496919    2563 generic.go:356] "Generic (PLEG): container finished" podID="6903a872-753b-4d48-8b5d-82ac0068a205" containerID="4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d" exitCode=0
Jul 18 02:23:08.496992 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.496964    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"
Jul 18 02:23:08.497187 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.497007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" event={"ID":"6903a872-753b-4d48-8b5d-82ac0068a205","Type":"ContainerDied","Data":"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"}
Jul 18 02:23:08.497187 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.497072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz" event={"ID":"6903a872-753b-4d48-8b5d-82ac0068a205","Type":"ContainerDied","Data":"a501f0e3703fb8d57ff2e0b89e4224ef383bbebc2309119ef8428be9ff8d2d2e"}
Jul 18 02:23:08.497187 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.497101    2563 scope.go:117] "RemoveContainer" containerID="4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"
Jul 18 02:23:08.506890 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.506875    2563 scope.go:117] "RemoveContainer" containerID="4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"
Jul 18 02:23:08.507158 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:23:08.507140    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d\": container with ID starting with 4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d not found: ID does not exist" containerID="4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"
Jul 18 02:23:08.507230 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.507165    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d"} err="failed to get container status \"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d\": rpc error: code = NotFound desc = could not find container \"4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d\": container with ID starting with 4e23700a31ae31772724aa059705afd6977d9e14013227dd6575daabc334953d not found: ID does not exist"
Jul 18 02:23:08.533058 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.533022    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:23:08.545656 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:08.545635    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-218ab5db-f8456d78c-r2pmz"]
Jul 18 02:23:09.891399 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:09.891365    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6903a872-753b-4d48-8b5d-82ac0068a205" path="/var/lib/kubelet/pods/6903a872-753b-4d48-8b5d-82ac0068a205/volumes"
Jul 18 02:23:12.403172 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:12.403142    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"]
Jul 18 02:23:12.408515 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:12.408489    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-218ab5db-tcv7n"]
Jul 18 02:23:13.891874 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:23:13.891838    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d6d524-5f64-44be-8624-fad52a5c1617" path="/var/lib/kubelet/pods/95d6d524-5f64-44be-8624-fad52a5c1617/volumes"
Jul 18 02:25:08.935333 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.935249    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:08.935891 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.935867    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d6d524-5f64-44be-8624-fad52a5c1617" containerName="revoke-keys"
Jul 18 02:25:08.936108 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.936081    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d6d524-5f64-44be-8624-fad52a5c1617" containerName="revoke-keys"
Jul 18 02:25:08.936226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.936119    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6903a872-753b-4d48-8b5d-82ac0068a205" containerName="maas-api"
Jul 18 02:25:08.936226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.936129    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6903a872-753b-4d48-8b5d-82ac0068a205" containerName="maas-api"
Jul 18 02:25:08.936341 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.936304    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d6d524-5f64-44be-8624-fad52a5c1617" containerName="revoke-keys"
Jul 18 02:25:08.936341 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.936320    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6903a872-753b-4d48-8b5d-82ac0068a205" containerName="maas-api"
Jul 18 02:25:08.939740 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.939716    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:08.952331 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.952309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8d54aea0-serving-cert\""
Jul 18 02:25:08.974121 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:08.974096    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:09.026338 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.026299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn696\" (UniqueName: \"kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.026532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.026433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.026532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.026481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.127225 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.127182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.127432 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.127236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.127432 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.127284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn696\" (UniqueName: \"kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.127432 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:25:09.127414    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-serving-cert: secret "maas-api-e2e-mt-8d54aea0-serving-cert" not found
Jul 18 02:25:09.127619 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:25:09.127492    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls podName:acf537a4-569a-4775-b24c-f2eb80bbf50d nodeName:}" failed. No retries permitted until 2026-07-18 02:25:09.627470701 +0000 UTC m=+2064.264723958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls") pod "maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" (UID: "acf537a4-569a-4775-b24c-f2eb80bbf50d") : secret "maas-api-e2e-mt-8d54aea0-serving-cert" not found
Jul 18 02:25:09.127939 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.127915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.145328 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.145302    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn696\" (UniqueName: \"kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.633641 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.633605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.636177 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.636148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") pod \"maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:09.851528 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:09.851492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:10.006542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:10.006507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:10.007002 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:25:10.006979    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf537a4_569a_4775_b24c_f2eb80bbf50d.slice/crio-9b25c7c13d8d996232c99bf7fdf1df7833dfcbbac69176a5484ce7d0405138c4 WatchSource:0}: Error finding container 9b25c7c13d8d996232c99bf7fdf1df7833dfcbbac69176a5484ce7d0405138c4: Status 404 returned error can't find the container with id 9b25c7c13d8d996232c99bf7fdf1df7833dfcbbac69176a5484ce7d0405138c4
Jul 18 02:25:10.183844 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:10.183762    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" event={"ID":"acf537a4-569a-4775-b24c-f2eb80bbf50d","Type":"ContainerStarted","Data":"9b25c7c13d8d996232c99bf7fdf1df7833dfcbbac69176a5484ce7d0405138c4"}
Jul 18 02:25:11.190308 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:11.190267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" event={"ID":"acf537a4-569a-4775-b24c-f2eb80bbf50d","Type":"ContainerStarted","Data":"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"}
Jul 18 02:25:11.190731 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:11.190426    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:11.243276 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:11.243224    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" podStartSLOduration=2.811051204 podStartE2EDuration="3.243203203s" totalImagesPullingTime="432.151999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:25:11.243083875 +0000 UTC m=+2065.880337156" watchObservedRunningTime="2026-07-18 02:25:11.243203203 +0000 UTC m=+2065.880456486"
Jul 18 02:25:17.201882 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:17.201850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:20.794795 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.794757    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"]
Jul 18 02:25:20.798247 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.798228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:20.800739 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.800719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:25:20.809224 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.809200    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"]
Jul 18 02:25:20.822189 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.822163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2\" (UID: \"57436ca6-9948-44ec-a8ff-61383c1ade0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:20.922634 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.922603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2\" (UID: \"57436ca6-9948-44ec-a8ff-61383c1ade0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:20.923227 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:20.923206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2\" (UID: \"57436ca6-9948-44ec-a8ff-61383c1ade0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:21.110672 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:21.110650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:21.246984 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:21.246943    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"]
Jul 18 02:25:21.247742 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:25:21.247717    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57436ca6_9948_44ec_a8ff_61383c1ade0d.slice/crio-090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a WatchSource:0}: Error finding container 090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a: Status 404 returned error can't find the container with id 090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a
Jul 18 02:25:22.258212 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:22.258137    2563 generic.go:356] "Generic (PLEG): container finished" podID="57436ca6-9948-44ec-a8ff-61383c1ade0d" containerID="fdf1a032c004c1eb299d913f1f95bba9fa912864d2ae689ff17df0cc88bf2684" exitCode=0
Jul 18 02:25:22.258555 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:22.258227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2" event={"ID":"57436ca6-9948-44ec-a8ff-61383c1ade0d","Type":"ContainerDied","Data":"fdf1a032c004c1eb299d913f1f95bba9fa912864d2ae689ff17df0cc88bf2684"}
Jul 18 02:25:22.258555 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:22.258283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2" event={"ID":"57436ca6-9948-44ec-a8ff-61383c1ade0d","Type":"ContainerStarted","Data":"090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a"}
Jul 18 02:25:23.396154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:23.396133    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:23.436658 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:23.436633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca\") pod \"57436ca6-9948-44ec-a8ff-61383c1ade0d\" (UID: \"57436ca6-9948-44ec-a8ff-61383c1ade0d\") "
Jul 18 02:25:23.436937 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:23.436915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57436ca6-9948-44ec-a8ff-61383c1ade0d" (UID: "57436ca6-9948-44ec-a8ff-61383c1ade0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:23.537477 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:23.537418    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57436ca6-9948-44ec-a8ff-61383c1ade0d-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:25:24.270259 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:24.270193    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"
Jul 18 02:25:24.270420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:24.270185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2" event={"ID":"57436ca6-9948-44ec-a8ff-61383c1ade0d","Type":"ContainerDied","Data":"090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a"}
Jul 18 02:25:24.270420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:24.270357    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="090044f444980659828413c05a2291e92abeb093c5de78ff84eee5e062c8949a"
Jul 18 02:25:31.294079 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.294023    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:31.294552 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.294276    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" podUID="acf537a4-569a-4775-b24c-f2eb80bbf50d" containerName="maas-api" containerID="cri-o://5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195" gracePeriod=30
Jul 18 02:25:31.559144 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.559093    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:31.597858 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.597814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn696\" (UniqueName: \"kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696\") pod \"acf537a4-569a-4775-b24c-f2eb80bbf50d\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") "
Jul 18 02:25:31.598005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.597901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") pod \"acf537a4-569a-4775-b24c-f2eb80bbf50d\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") "
Jul 18 02:25:31.598005 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.597949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca\") pod \"acf537a4-569a-4775-b24c-f2eb80bbf50d\" (UID: \"acf537a4-569a-4775-b24c-f2eb80bbf50d\") "
Jul 18 02:25:31.598349 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.598322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "acf537a4-569a-4775-b24c-f2eb80bbf50d" (UID: "acf537a4-569a-4775-b24c-f2eb80bbf50d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:25:31.599838 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.599816    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "acf537a4-569a-4775-b24c-f2eb80bbf50d" (UID: "acf537a4-569a-4775-b24c-f2eb80bbf50d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:25:31.600324 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.600308    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696" (OuterVolumeSpecName: "kube-api-access-nn696") pod "acf537a4-569a-4775-b24c-f2eb80bbf50d" (UID: "acf537a4-569a-4775-b24c-f2eb80bbf50d"). InnerVolumeSpecName "kube-api-access-nn696". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:25:31.698643 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.698621    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/acf537a4-569a-4775-b24c-f2eb80bbf50d-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:25:31.698734 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.698648    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/acf537a4-569a-4775-b24c-f2eb80bbf50d-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:25:31.698734 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:31.698663    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn696\" (UniqueName: \"kubernetes.io/projected/acf537a4-569a-4775-b24c-f2eb80bbf50d-kube-api-access-nn696\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:25:31.912010 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:25:31.911986    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf537a4_569a_4775_b24c_f2eb80bbf50d.slice\": RecentStats: unable to find data in memory cache]"
Jul 18 02:25:32.317449 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.317378    2563 generic.go:356] "Generic (PLEG): container finished" podID="acf537a4-569a-4775-b24c-f2eb80bbf50d" containerID="5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195" exitCode=0
Jul 18 02:25:32.317449 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.317419    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"
Jul 18 02:25:32.317883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.317474    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" event={"ID":"acf537a4-569a-4775-b24c-f2eb80bbf50d","Type":"ContainerDied","Data":"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"}
Jul 18 02:25:32.317883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.317526    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf" event={"ID":"acf537a4-569a-4775-b24c-f2eb80bbf50d","Type":"ContainerDied","Data":"9b25c7c13d8d996232c99bf7fdf1df7833dfcbbac69176a5484ce7d0405138c4"}
Jul 18 02:25:32.317883 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.317552    2563 scope.go:117] "RemoveContainer" containerID="5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"
Jul 18 02:25:32.326539 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.326520    2563 scope.go:117] "RemoveContainer" containerID="5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"
Jul 18 02:25:32.326806 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:25:32.326786    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195\": container with ID starting with 5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195 not found: ID does not exist" containerID="5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"
Jul 18 02:25:32.326852 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.326819    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195"} err="failed to get container status \"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195\": rpc error: code = NotFound desc = could not find container \"5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195\": container with ID starting with 5e41e4b40edd69a95f5cbb685c36387936d6247deb68ede1be29a88129aaf195 not found: ID does not exist"
Jul 18 02:25:32.343419 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.343397    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:32.345607 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:32.345586    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d54aea0-5688584bfd-pkswf"]
Jul 18 02:25:33.892440 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:33.892403    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acf537a4-569a-4775-b24c-f2eb80bbf50d" path="/var/lib/kubelet/pods/acf537a4-569a-4775-b24c-f2eb80bbf50d/volumes"
Jul 18 02:25:35.893633 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:35.893562    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"]
Jul 18 02:25:35.894059 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:35.894028    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8d54aea0-kz7x2"]
Jul 18 02:25:37.891777 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:37.891744    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57436ca6-9948-44ec-a8ff-61383c1ade0d" path="/var/lib/kubelet/pods/57436ca6-9948-44ec-a8ff-61383c1ade0d/volumes"
Jul 18 02:25:45.963457 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:45.963429    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:25:45.970630 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:25:45.970608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:26:06.005062 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005018    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:06.005470 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005455    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57436ca6-9948-44ec-a8ff-61383c1ade0d" containerName="revoke-keys"
Jul 18 02:26:06.005516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005472    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57436ca6-9948-44ec-a8ff-61383c1ade0d" containerName="revoke-keys"
Jul 18 02:26:06.005516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005488    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acf537a4-569a-4775-b24c-f2eb80bbf50d" containerName="maas-api"
Jul 18 02:26:06.005516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005493    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="acf537a4-569a-4775-b24c-f2eb80bbf50d" containerName="maas-api"
Jul 18 02:26:06.005617 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005559    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="acf537a4-569a-4775-b24c-f2eb80bbf50d" containerName="maas-api"
Jul 18 02:26:06.005617 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.005568    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57436ca6-9948-44ec-a8ff-61383c1ade0d" containerName="revoke-keys"
Jul 18 02:26:06.008581 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.008563    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.011291 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.011269    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2adafcc9-serving-cert\""
Jul 18 02:26:06.024500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.024476    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:06.071684 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.071661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftjt\" (UniqueName: \"kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.071804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.071740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.071804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.071778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.172656 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.172632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.172768 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.172683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.172768 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.172735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftjt\" (UniqueName: \"kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.172848 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:26:06.172792    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-serving-cert: secret "maas-api-e2e-mt-2adafcc9-serving-cert" not found
Jul 18 02:26:06.172884 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:26:06.172855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls podName:db15488d-7c07-43e9-b9b3-abca89c16b04 nodeName:}" failed. No retries permitted until 2026-07-18 02:26:06.672833783 +0000 UTC m=+2121.310087041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls") pod "maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" (UID: "db15488d-7c07-43e9-b9b3-abca89c16b04") : secret "maas-api-e2e-mt-2adafcc9-serving-cert" not found
Jul 18 02:26:06.173401 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.173382    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.181393 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.181373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftjt\" (UniqueName: \"kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.676395 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.676365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.678815 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.678787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") pod \"maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:06.919742 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:06.919712    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:07.059311 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.059282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:07.062575 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:26:07.062546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb15488d_7c07_43e9_b9b3_abca89c16b04.slice/crio-96517a808b9626dbaed0cd3ed4e0b89e2b659f30bac74acb0bd13cf972dbb9b1 WatchSource:0}: Error finding container 96517a808b9626dbaed0cd3ed4e0b89e2b659f30bac74acb0bd13cf972dbb9b1: Status 404 returned error can't find the container with id 96517a808b9626dbaed0cd3ed4e0b89e2b659f30bac74acb0bd13cf972dbb9b1
Jul 18 02:26:07.063903 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.063885    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:26:07.525720 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.525686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" event={"ID":"db15488d-7c07-43e9-b9b3-abca89c16b04","Type":"ContainerStarted","Data":"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"}
Jul 18 02:26:07.525876 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.525864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:07.525929 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.525892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" event={"ID":"db15488d-7c07-43e9-b9b3-abca89c16b04","Type":"ContainerStarted","Data":"96517a808b9626dbaed0cd3ed4e0b89e2b659f30bac74acb0bd13cf972dbb9b1"}
Jul 18 02:26:07.547426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:07.547373    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" podStartSLOduration=2.224640255 podStartE2EDuration="2.547358435s" totalImagesPullingTime="322.71818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:07.544274938 +0000 UTC m=+2122.181528219" watchObservedRunningTime="2026-07-18 02:26:07.547358435 +0000 UTC m=+2122.184611715"
Jul 18 02:26:13.537366 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:13.537339    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:38.466372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.466288    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"]
Jul 18 02:26:38.478452 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.478420    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"]
Jul 18 02:26:38.478629 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.478536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:38.481719 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.481698    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:26:38.535899 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.535872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8\" (UID: \"977c71a2-017d-417b-afc5-6d4b22374fc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:38.636876 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.636847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8\" (UID: \"977c71a2-017d-417b-afc5-6d4b22374fc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:38.637659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.637636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8\" (UID: \"977c71a2-017d-417b-afc5-6d4b22374fc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:38.789856 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:38.789782    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:39.135250 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:39.135216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"]
Jul 18 02:26:39.137385 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:26:39.137362    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod977c71a2_017d_417b_afc5_6d4b22374fc2.slice/crio-148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae WatchSource:0}: Error finding container 148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae: Status 404 returned error can't find the container with id 148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae
Jul 18 02:26:39.714444 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:39.714365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8" event={"ID":"977c71a2-017d-417b-afc5-6d4b22374fc2","Type":"ContainerStarted","Data":"48a0f3ca40e1644cb7ef221b45bf194e08bcfe4c0197c89ff8804b1b50d2b29b"}
Jul 18 02:26:39.714444 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:39.714412    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8" event={"ID":"977c71a2-017d-417b-afc5-6d4b22374fc2","Type":"ContainerStarted","Data":"148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae"}
Jul 18 02:26:39.734866 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:39.734809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8" podStartSLOduration=1.7347911040000001 podStartE2EDuration="1.734791104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:26:39.731276269 +0000 UTC m=+2154.368529550" watchObservedRunningTime="2026-07-18 02:26:39.734791104 +0000 UTC m=+2154.372044387"
Jul 18 02:26:40.733517 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:40.733478    2563 generic.go:356] "Generic (PLEG): container finished" podID="977c71a2-017d-417b-afc5-6d4b22374fc2" containerID="48a0f3ca40e1644cb7ef221b45bf194e08bcfe4c0197c89ff8804b1b50d2b29b" exitCode=0
Jul 18 02:26:40.733949 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:40.733635    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8" event={"ID":"977c71a2-017d-417b-afc5-6d4b22374fc2","Type":"ContainerDied","Data":"48a0f3ca40e1644cb7ef221b45bf194e08bcfe4c0197c89ff8804b1b50d2b29b"}
Jul 18 02:26:41.878383 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:41.878358    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:41.962437 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:41.962409    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca\") pod \"977c71a2-017d-417b-afc5-6d4b22374fc2\" (UID: \"977c71a2-017d-417b-afc5-6d4b22374fc2\") "
Jul 18 02:26:41.962726 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:41.962704    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "977c71a2-017d-417b-afc5-6d4b22374fc2" (UID: "977c71a2-017d-417b-afc5-6d4b22374fc2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:26:42.063270 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:42.063211    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/977c71a2-017d-417b-afc5-6d4b22374fc2-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:26:42.747572 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:42.747546    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"
Jul 18 02:26:42.747725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:42.747592    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8" event={"ID":"977c71a2-017d-417b-afc5-6d4b22374fc2","Type":"ContainerDied","Data":"148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae"}
Jul 18 02:26:42.747725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:42.747648    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="148883adfb3403642684e201668bd95de0cb1ad9f73a429143ba18b1daa9d1ae"
Jul 18 02:26:46.060109 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:46.060023    2563 scope.go:117] "RemoveContainer" containerID="3e7abad7ddaf28354a4de7a68a116636494191f29440a212ddd6fbc4b2f596b2"
Jul 18 02:26:53.948976 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:53.948944    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:53.949420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:53.949166    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" podUID="db15488d-7c07-43e9-b9b3-abca89c16b04" containerName="maas-api" containerID="cri-o://2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3" gracePeriod=30
Jul 18 02:26:54.197400 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.197371    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:54.270722 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.270659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca\") pod \"db15488d-7c07-43e9-b9b3-abca89c16b04\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") "
Jul 18 02:26:54.270842 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.270736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ftjt\" (UniqueName: \"kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt\") pod \"db15488d-7c07-43e9-b9b3-abca89c16b04\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") "
Jul 18 02:26:54.270842 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.270763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") pod \"db15488d-7c07-43e9-b9b3-abca89c16b04\" (UID: \"db15488d-7c07-43e9-b9b3-abca89c16b04\") "
Jul 18 02:26:54.270976 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.270955    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db15488d-7c07-43e9-b9b3-abca89c16b04" (UID: "db15488d-7c07-43e9-b9b3-abca89c16b04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:26:54.272731 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.272706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt" (OuterVolumeSpecName: "kube-api-access-6ftjt") pod "db15488d-7c07-43e9-b9b3-abca89c16b04" (UID: "db15488d-7c07-43e9-b9b3-abca89c16b04"). InnerVolumeSpecName "kube-api-access-6ftjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:26:54.272817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.272764    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db15488d-7c07-43e9-b9b3-abca89c16b04" (UID: "db15488d-7c07-43e9-b9b3-abca89c16b04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:26:54.371388 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.371357    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ftjt\" (UniqueName: \"kubernetes.io/projected/db15488d-7c07-43e9-b9b3-abca89c16b04-kube-api-access-6ftjt\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:26:54.371388 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.371387    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db15488d-7c07-43e9-b9b3-abca89c16b04-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:26:54.371532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.371402    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db15488d-7c07-43e9-b9b3-abca89c16b04-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:26:54.825148 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.825117    2563 generic.go:356] "Generic (PLEG): container finished" podID="db15488d-7c07-43e9-b9b3-abca89c16b04" containerID="2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3" exitCode=0
Jul 18 02:26:54.825311 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.825161    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"
Jul 18 02:26:54.825311 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.825212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" event={"ID":"db15488d-7c07-43e9-b9b3-abca89c16b04","Type":"ContainerDied","Data":"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"}
Jul 18 02:26:54.825311 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.825262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg" event={"ID":"db15488d-7c07-43e9-b9b3-abca89c16b04","Type":"ContainerDied","Data":"96517a808b9626dbaed0cd3ed4e0b89e2b659f30bac74acb0bd13cf972dbb9b1"}
Jul 18 02:26:54.825311 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.825286    2563 scope.go:117] "RemoveContainer" containerID="2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"
Jul 18 02:26:54.835362 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.835345    2563 scope.go:117] "RemoveContainer" containerID="2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"
Jul 18 02:26:54.835638 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:26:54.835618    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3\": container with ID starting with 2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3 not found: ID does not exist" containerID="2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"
Jul 18 02:26:54.835706 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.835645    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3"} err="failed to get container status \"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3\": rpc error: code = NotFound desc = could not find container \"2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3\": container with ID starting with 2fb2a1e68f41a5cfaed6f943777027a1e74a7394a39bfef605ae568b0c49c2c3 not found: ID does not exist"
Jul 18 02:26:54.851007 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.850983    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:54.855949 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:54.855927    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2adafcc9-6dbb87fb4f-xt2pg"]
Jul 18 02:26:55.890925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:55.890893    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db15488d-7c07-43e9-b9b3-abca89c16b04" path="/var/lib/kubelet/pods/db15488d-7c07-43e9-b9b3-abca89c16b04/volumes"
Jul 18 02:26:58.567775 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:58.567739    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"]
Jul 18 02:26:58.571510 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:58.571486    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2adafcc9-qz4r8"]
Jul 18 02:26:59.892229 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:26:59.892193    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="977c71a2-017d-417b-afc5-6d4b22374fc2" path="/var/lib/kubelet/pods/977c71a2-017d-417b-afc5-6d4b22374fc2/volumes"
Jul 18 02:27:46.080839 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:27:46.080809    2563 scope.go:117] "RemoveContainer" containerID="e4c2e0572e096dd3fb46adb1a9bfe818051a1458947407cd32ef1933d3aaf1c6"
Jul 18 02:28:46.106735 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:46.106702    2563 scope.go:117] "RemoveContainer" containerID="3990245fbcab1d88057e77cf3bab4795cf1a9e45492849e38b3ed5a3f3b7f77d"
Jul 18 02:28:50.886740 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.886705    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:28:50.887204 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887187    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db15488d-7c07-43e9-b9b3-abca89c16b04" containerName="maas-api"
Jul 18 02:28:50.887255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887206    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="db15488d-7c07-43e9-b9b3-abca89c16b04" containerName="maas-api"
Jul 18 02:28:50.887255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887220    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="977c71a2-017d-417b-afc5-6d4b22374fc2" containerName="revoke-keys"
Jul 18 02:28:50.887255 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887227    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="977c71a2-017d-417b-afc5-6d4b22374fc2" containerName="revoke-keys"
Jul 18 02:28:50.887361 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887291    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="977c71a2-017d-417b-afc5-6d4b22374fc2" containerName="revoke-keys"
Jul 18 02:28:50.887361 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.887303    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="db15488d-7c07-43e9-b9b3-abca89c16b04" containerName="maas-api"
Jul 18 02:28:50.890320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.890302    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:50.897298 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.897086    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-57b0da-serving-cert\""
Jul 18 02:28:50.918022 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.917993    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:28:50.925560 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.925531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:50.926516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.926100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:50.926516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:50.926148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rng6s\" (UniqueName: \"kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.026988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.026951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.027211 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.027005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rng6s\" (UniqueName: \"kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.027211 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.027158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.027835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.027804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.029705 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.029685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.042366 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.042336    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rng6s\" (UniqueName: \"kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s\") pod \"maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.201686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.201598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:51.368627 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.368600    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:28:51.370432 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:28:51.370401    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a6c46e_b219_4e0f_86ec_4c55fbec3d50.slice/crio-8b4ade51c527e53b9ad5d8d4d623d1a07e7bfde622ed1f2ac3de2a51f90451e0 WatchSource:0}: Error finding container 8b4ade51c527e53b9ad5d8d4d623d1a07e7bfde622ed1f2ac3de2a51f90451e0: Status 404 returned error can't find the container with id 8b4ade51c527e53b9ad5d8d4d623d1a07e7bfde622ed1f2ac3de2a51f90451e0
Jul 18 02:28:51.486022 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:51.485940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" event={"ID":"24a6c46e-b219-4e0f-86ec-4c55fbec3d50","Type":"ContainerStarted","Data":"8b4ade51c527e53b9ad5d8d4d623d1a07e7bfde622ed1f2ac3de2a51f90451e0"}
Jul 18 02:28:52.494918 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:52.494872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" event={"ID":"24a6c46e-b219-4e0f-86ec-4c55fbec3d50","Type":"ContainerStarted","Data":"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"}
Jul 18 02:28:52.495393 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:52.495116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:52.514372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:52.514323    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" podStartSLOduration=2.088954866 podStartE2EDuration="2.514304897s" totalImagesPullingTime="425.350031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:28:52.513021911 +0000 UTC m=+2287.150275193" watchObservedRunningTime="2026-07-18 02:28:52.514304897 +0000 UTC m=+2287.151558177"
Jul 18 02:28:58.507586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.507553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:28:58.823079 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.822984    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:28:58.826934 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.826914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:58.829925 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.829905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f6c952-serving-cert\""
Jul 18 02:28:58.840911 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.840887    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:28:58.902730 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.902699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:58.902864 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.902800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2h29\" (UniqueName: \"kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:58.902864 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:58.902832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.003930 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.003902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.003930 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.003951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.004301 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.004101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2h29\" (UniqueName: \"kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.004869 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.004845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.006927 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.006897    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.026695 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.026667    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2h29\" (UniqueName: \"kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29\") pod \"maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.137542 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.137515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:28:59.290529 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.290505    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:28:59.292172 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:28:59.292130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e70f83_ca44_443f_83ce_504072df50ae.slice/crio-de57ae27e7da7fe976d6847f171c7dca61dcba0ca2741ab0a8a97f5855e7d1c2 WatchSource:0}: Error finding container de57ae27e7da7fe976d6847f171c7dca61dcba0ca2741ab0a8a97f5855e7d1c2: Status 404 returned error can't find the container with id de57ae27e7da7fe976d6847f171c7dca61dcba0ca2741ab0a8a97f5855e7d1c2
Jul 18 02:28:59.540974 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:28:59.540890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" event={"ID":"48e70f83-ca44-443f-83ce-504072df50ae","Type":"ContainerStarted","Data":"de57ae27e7da7fe976d6847f171c7dca61dcba0ca2741ab0a8a97f5855e7d1c2"}
Jul 18 02:29:00.548381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:00.548351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" event={"ID":"48e70f83-ca44-443f-83ce-504072df50ae","Type":"ContainerStarted","Data":"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"}
Jul 18 02:29:00.548769 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:00.548418    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:29:00.571987 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:00.571932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" podStartSLOduration=2.213019582 podStartE2EDuration="2.571919865s" totalImagesPullingTime="358.900283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:29:00.56888031 +0000 UTC m=+2295.206133593" watchObservedRunningTime="2026-07-18 02:29:00.571919865 +0000 UTC m=+2295.209173144"
Jul 18 02:29:06.561033 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:06.561004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:29:46.132452 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:46.132371    2563 scope.go:117] "RemoveContainer" containerID="5c2e452cb732d6ab6db7b11f78d1b611ec8cf187f1b5baaf0c351a41c0818790"
Jul 18 02:29:57.748212 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.748175    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"]
Jul 18 02:29:57.752181 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.752161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:29:57.755194 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.755171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:29:57.761794 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.761773    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"]
Jul 18 02:29:57.799381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.799348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7\" (UID: \"5caf3bc3-688a-4c09-b299-e95b1db2b09b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:29:57.899996 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.899955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7\" (UID: \"5caf3bc3-688a-4c09-b299-e95b1db2b09b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:29:57.900589 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:57.900569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7\" (UID: \"5caf3bc3-688a-4c09-b299-e95b1db2b09b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:29:58.064143 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:58.064033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:29:58.212668 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:58.212640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"]
Jul 18 02:29:58.215620 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:29:58.215591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5caf3bc3_688a_4c09_b299_e95b1db2b09b.slice/crio-533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d WatchSource:0}: Error finding container 533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d: Status 404 returned error can't find the container with id 533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d
Jul 18 02:29:58.889956 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:58.889923    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7" event={"ID":"5caf3bc3-688a-4c09-b299-e95b1db2b09b","Type":"ContainerStarted","Data":"a4385f5161e082d1659f75a1aa567f73cb49d2a4abf2d03ab8bc4425e248124e"}
Jul 18 02:29:58.890354 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:58.889970    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7" event={"ID":"5caf3bc3-688a-4c09-b299-e95b1db2b09b","Type":"ContainerStarted","Data":"533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d"}
Jul 18 02:29:58.909263 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:58.909218    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7" podStartSLOduration=1.909204115 podStartE2EDuration="1.909204115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:29:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:29:58.906790367 +0000 UTC m=+2353.544043648" watchObservedRunningTime="2026-07-18 02:29:58.909204115 +0000 UTC m=+2353.546457394"
Jul 18 02:29:59.896060 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:59.896012    2563 generic.go:356] "Generic (PLEG): container finished" podID="5caf3bc3-688a-4c09-b299-e95b1db2b09b" containerID="a4385f5161e082d1659f75a1aa567f73cb49d2a4abf2d03ab8bc4425e248124e" exitCode=0
Jul 18 02:29:59.896427 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:29:59.896092    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7" event={"ID":"5caf3bc3-688a-4c09-b299-e95b1db2b09b","Type":"ContainerDied","Data":"a4385f5161e082d1659f75a1aa567f73cb49d2a4abf2d03ab8bc4425e248124e"}
Jul 18 02:30:00.142720 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.142684    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"]
Jul 18 02:30:00.149035 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.148965    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"]
Jul 18 02:30:00.151347 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.151315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"
Jul 18 02:30:00.154069 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.154024    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"]
Jul 18 02:30:00.154213 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.154098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"
Jul 18 02:30:00.158229 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.158206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"]
Jul 18 02:30:00.158395 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.158296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"
Jul 18 02:30:00.160847 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.160829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"]
Jul 18 02:30:00.164303 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.164206    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"]
Jul 18 02:30:00.168713 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.168691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"
Jul 18 02:30:00.178565 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.178547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"
Jul 18 02:30:00.214929 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.214909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"
Jul 18 02:30:00.364301 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.364267    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"]
Jul 18 02:30:00.366716 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:00.366684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd6e692_9511_4158_9a07_924f61e63de3.slice/crio-c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e WatchSource:0}: Error finding container c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e: Status 404 returned error can't find the container with id c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e
Jul 18 02:30:00.386211 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.386187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"]
Jul 18 02:30:00.386526 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:00.386501    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1b442ec_288b_4ff3_ae4e_45afa73cdc11.slice/crio-09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0 WatchSource:0}: Error finding container 09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0: Status 404 returned error can't find the container with id 09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0
Jul 18 02:30:00.539898 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.539875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"]
Jul 18 02:30:00.543168 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:00.543145    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f5e4b0_c23f_4b8f_a286_2f38811c7bed.slice/crio-33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89 WatchSource:0}: Error finding container 33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89: Status 404 returned error can't find the container with id 33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89
Jul 18 02:30:00.904059 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.904018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn" event={"ID":"e1b442ec-288b-4ff3-ae4e-45afa73cdc11","Type":"ContainerStarted","Data":"5e2ce76ddc9a136ba26786062b825f1987a058cdc6665dfad135cecb81521945"}
Jul 18 02:30:00.904446 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.904080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn" event={"ID":"e1b442ec-288b-4ff3-ae4e-45afa73cdc11","Type":"ContainerStarted","Data":"09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0"}
Jul 18 02:30:00.905576 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.905555    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l" event={"ID":"1cd6e692-9511-4158-9a07-924f61e63de3","Type":"ContainerStarted","Data":"426bc4648e4a45acbb0d8164f7b1f2c408bdf75b74e412dc0eeb36fcd02949f7"}
Jul 18 02:30:00.905695 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.905597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l" event={"ID":"1cd6e692-9511-4158-9a07-924f61e63de3","Type":"ContainerStarted","Data":"c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e"}
Jul 18 02:30:00.907012 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.906988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb" event={"ID":"27f5e4b0-c23f-4b8f-a286-2f38811c7bed","Type":"ContainerStarted","Data":"d97a8fda4832d9c1033638cbd16d69819e89d4b65e7db65c7b9e87cced50691e"}
Jul 18 02:30:00.907123 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.907035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb" event={"ID":"27f5e4b0-c23f-4b8f-a286-2f38811c7bed","Type":"ContainerStarted","Data":"33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89"}
Jul 18 02:30:00.921098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.921057    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn" podStartSLOduration=0.921028505 podStartE2EDuration="921.028505ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:00.919219547 +0000 UTC m=+2355.556472829" watchObservedRunningTime="2026-07-18 02:30:00.921028505 +0000 UTC m=+2355.558281801"
Jul 18 02:30:00.936761 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.936094    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l" podStartSLOduration=0.936075487 podStartE2EDuration="936.075487ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:00.934934744 +0000 UTC m=+2355.572188021" watchObservedRunningTime="2026-07-18 02:30:00.936075487 +0000 UTC m=+2355.573328768"
Jul 18 02:30:00.952833 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:00.952795    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb" podStartSLOduration=0.952782871 podStartE2EDuration="952.782871ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:00.95031322 +0000 UTC m=+2355.587566500" watchObservedRunningTime="2026-07-18 02:30:00.952782871 +0000 UTC m=+2355.590036152"
Jul 18 02:30:01.036999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.036973    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:30:01.128015 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.127987    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca\") pod \"5caf3bc3-688a-4c09-b299-e95b1db2b09b\" (UID: \"5caf3bc3-688a-4c09-b299-e95b1db2b09b\") "
Jul 18 02:30:01.128340 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.128317    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5caf3bc3-688a-4c09-b299-e95b1db2b09b" (UID: "5caf3bc3-688a-4c09-b299-e95b1db2b09b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:30:01.229345 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.229311    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5caf3bc3-688a-4c09-b299-e95b1db2b09b-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:01.914686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.914654    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"
Jul 18 02:30:01.914686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.914670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7" event={"ID":"5caf3bc3-688a-4c09-b299-e95b1db2b09b","Type":"ContainerDied","Data":"533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d"}
Jul 18 02:30:01.915135 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.914714    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="533dbba1e94e000576f694ee861d8421302f5e20cb16edd628c3b731d2ee425d"
Jul 18 02:30:01.916366 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.916327    2563 generic.go:356] "Generic (PLEG): container finished" podID="e1b442ec-288b-4ff3-ae4e-45afa73cdc11" containerID="5e2ce76ddc9a136ba26786062b825f1987a058cdc6665dfad135cecb81521945" exitCode=0
Jul 18 02:30:01.916595 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.916494    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn" event={"ID":"e1b442ec-288b-4ff3-ae4e-45afa73cdc11","Type":"ContainerDied","Data":"5e2ce76ddc9a136ba26786062b825f1987a058cdc6665dfad135cecb81521945"}
Jul 18 02:30:01.917956 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.917930    2563 generic.go:356] "Generic (PLEG): container finished" podID="1cd6e692-9511-4158-9a07-924f61e63de3" containerID="426bc4648e4a45acbb0d8164f7b1f2c408bdf75b74e412dc0eeb36fcd02949f7" exitCode=0
Jul 18 02:30:01.918104 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.917998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l" event={"ID":"1cd6e692-9511-4158-9a07-924f61e63de3","Type":"ContainerDied","Data":"426bc4648e4a45acbb0d8164f7b1f2c408bdf75b74e412dc0eeb36fcd02949f7"}
Jul 18 02:30:01.919369 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.919346    2563 generic.go:356] "Generic (PLEG): container finished" podID="27f5e4b0-c23f-4b8f-a286-2f38811c7bed" containerID="d97a8fda4832d9c1033638cbd16d69819e89d4b65e7db65c7b9e87cced50691e" exitCode=0
Jul 18 02:30:01.919435 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:01.919418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb" event={"ID":"27f5e4b0-c23f-4b8f-a286-2f38811c7bed","Type":"ContainerDied","Data":"d97a8fda4832d9c1033638cbd16d69819e89d4b65e7db65c7b9e87cced50691e"}
Jul 18 02:30:03.083269 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.083242    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"
Jul 18 02:30:03.125961 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.125938    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"
Jul 18 02:30:03.129277 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.129258    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"
Jul 18 02:30:03.932464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.932361    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn" event={"ID":"e1b442ec-288b-4ff3-ae4e-45afa73cdc11","Type":"ContainerDied","Data":"09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0"}
Jul 18 02:30:03.932464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.932381    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"
Jul 18 02:30:03.932464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.932414    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09267013bb14d9f3d89ce08a04e23792eddccccc02bf7bc66a120126d42d2cf0"
Jul 18 02:30:03.933988 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.933963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l" event={"ID":"1cd6e692-9511-4158-9a07-924f61e63de3","Type":"ContainerDied","Data":"c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e"}
Jul 18 02:30:03.934123 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.934010    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c257e0cfa767d58bc871461aa16ab89db29f8401b086498a5525cecc7f231f7e"
Jul 18 02:30:03.934123 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.934085    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29739030-drp8l"
Jul 18 02:30:03.936227 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.936207    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"
Jul 18 02:30:03.936336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.936240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb" event={"ID":"27f5e4b0-c23f-4b8f-a286-2f38811c7bed","Type":"ContainerDied","Data":"33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89"}
Jul 18 02:30:03.936336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:03.936279    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33e845cf3aa803e65a518d26a45dcb09e8ac760333586a18dd535bcf5ac18d89"
Jul 18 02:30:08.391405 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.391370    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:30:08.391811 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.391594    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerName="maas-api" containerID="cri-o://daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41" gracePeriod=30
Jul 18 02:30:08.459306 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.459280    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"]
Jul 18 02:30:08.470027 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.470006    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-57b0da-29739030-bmgsn"]
Jul 18 02:30:08.502836 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.502805    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.73:8443/health\": dial tcp 10.134.0.73:8443: connect: connection refused"
Jul 18 02:30:08.647258 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.647198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:30:08.695678 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.695652    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca\") pod \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") "
Jul 18 02:30:08.695822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.695706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls\") pod \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") "
Jul 18 02:30:08.695822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.695738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rng6s\" (UniqueName: \"kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s\") pod \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\" (UID: \"24a6c46e-b219-4e0f-86ec-4c55fbec3d50\") "
Jul 18 02:30:08.696081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.696038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "24a6c46e-b219-4e0f-86ec-4c55fbec3d50" (UID: "24a6c46e-b219-4e0f-86ec-4c55fbec3d50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:30:08.697763 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.697734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "24a6c46e-b219-4e0f-86ec-4c55fbec3d50" (UID: "24a6c46e-b219-4e0f-86ec-4c55fbec3d50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:30:08.697849 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.697794    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s" (OuterVolumeSpecName: "kube-api-access-rng6s") pod "24a6c46e-b219-4e0f-86ec-4c55fbec3d50" (UID: "24a6c46e-b219-4e0f-86ec-4c55fbec3d50"). InnerVolumeSpecName "kube-api-access-rng6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:30:08.796601 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.796575    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:08.796601 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.796599    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:08.796740 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.796609    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rng6s\" (UniqueName: \"kubernetes.io/projected/24a6c46e-b219-4e0f-86ec-4c55fbec3d50-kube-api-access-rng6s\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:08.966460 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.966397    2563 generic.go:356] "Generic (PLEG): container finished" podID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerID="daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41" exitCode=0
Jul 18 02:30:08.966460 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.966434    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"
Jul 18 02:30:08.966597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.966472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" event={"ID":"24a6c46e-b219-4e0f-86ec-4c55fbec3d50","Type":"ContainerDied","Data":"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"}
Jul 18 02:30:08.966597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.966519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd" event={"ID":"24a6c46e-b219-4e0f-86ec-4c55fbec3d50","Type":"ContainerDied","Data":"8b4ade51c527e53b9ad5d8d4d623d1a07e7bfde622ed1f2ac3de2a51f90451e0"}
Jul 18 02:30:08.966597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.966540    2563 scope.go:117] "RemoveContainer" containerID="daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"
Jul 18 02:30:08.976306 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.976291    2563 scope.go:117] "RemoveContainer" containerID="daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"
Jul 18 02:30:08.976556 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:30:08.976539    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41\": container with ID starting with daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41 not found: ID does not exist" containerID="daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"
Jul 18 02:30:08.976611 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.976565    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41"} err="failed to get container status \"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41\": rpc error: code = NotFound desc = could not find container \"daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41\": container with ID starting with daeee72a68cb8740abc29f8465d98e257486bd5e4479e0b056d0edf9562d0a41 not found: ID does not exist"
Jul 18 02:30:08.996397 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:08.996373    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:30:09.001088 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:09.001069    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-57b0da-679d748b69-lz8rd"]
Jul 18 02:30:09.891998 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:09.891956    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" path="/var/lib/kubelet/pods/24a6c46e-b219-4e0f-86ec-4c55fbec3d50/volumes"
Jul 18 02:30:09.892376 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:09.892284    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b442ec-288b-4ff3-ae4e-45afa73cdc11" path="/var/lib/kubelet/pods/e1b442ec-288b-4ff3-ae4e-45afa73cdc11/volumes"
Jul 18 02:30:12.863138 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:12.863104    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"]
Jul 18 02:30:12.865420 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:12.865401    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-57b0da-7vps7"]
Jul 18 02:30:13.891675 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:13.891643    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5caf3bc3-688a-4c09-b299-e95b1db2b09b" path="/var/lib/kubelet/pods/5caf3bc3-688a-4c09-b299-e95b1db2b09b/volumes"
Jul 18 02:30:20.548403 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.548361    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"]
Jul 18 02:30:20.549059 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549025    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd6e692-9511-4158-9a07-924f61e63de3" containerName="cleanup"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549064    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd6e692-9511-4158-9a07-924f61e63de3" containerName="cleanup"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549083    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b442ec-288b-4ff3-ae4e-45afa73cdc11" containerName="cleanup"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549092    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b442ec-288b-4ff3-ae4e-45afa73cdc11" containerName="cleanup"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549109    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5caf3bc3-688a-4c09-b299-e95b1db2b09b" containerName="revoke-keys"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549118    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5caf3bc3-688a-4c09-b299-e95b1db2b09b" containerName="revoke-keys"
Jul 18 02:30:20.549141 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549135    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerName="maas-api"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549145    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerName="maas-api"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549171    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27f5e4b0-c23f-4b8f-a286-2f38811c7bed" containerName="cleanup"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549180    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="27f5e4b0-c23f-4b8f-a286-2f38811c7bed" containerName="cleanup"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549292    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a6c46e-b219-4e0f-86ec-4c55fbec3d50" containerName="maas-api"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549305    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b442ec-288b-4ff3-ae4e-45afa73cdc11" containerName="cleanup"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549316    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5caf3bc3-688a-4c09-b299-e95b1db2b09b" containerName="revoke-keys"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549326    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd6e692-9511-4158-9a07-924f61e63de3" containerName="cleanup"
Jul 18 02:30:20.549421 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.549336    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="27f5e4b0-c23f-4b8f-a286-2f38811c7bed" containerName="cleanup"
Jul 18 02:30:20.552985 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.552967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:20.563913 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.563886    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:30:20.566242 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.566216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"]
Jul 18 02:30:20.699415 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.699387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd\" (UID: \"bebc649e-eb1e-443d-9475-e171f064a5a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:20.800719 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.800643    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd\" (UID: \"bebc649e-eb1e-443d-9475-e171f064a5a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:20.801372 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.801350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd\" (UID: \"bebc649e-eb1e-443d-9475-e171f064a5a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:20.863971 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:20.863944    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:21.005458 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:21.005424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"]
Jul 18 02:30:21.006521 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:21.006500    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebc649e_eb1e_443d_9475_e171f064a5a9.slice/crio-c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b WatchSource:0}: Error finding container c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b: Status 404 returned error can't find the container with id c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b
Jul 18 02:30:21.037114 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:21.037086    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd" event={"ID":"bebc649e-eb1e-443d-9475-e171f064a5a9","Type":"ContainerStarted","Data":"c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b"}
Jul 18 02:30:22.044795 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:22.044764    2563 generic.go:356] "Generic (PLEG): container finished" podID="bebc649e-eb1e-443d-9475-e171f064a5a9" containerID="6ac8d925a8fd341452344ba25300c4e943e7ee767431919cb47a7d51e94371c7" exitCode=0
Jul 18 02:30:22.045157 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:22.044835    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd" event={"ID":"bebc649e-eb1e-443d-9475-e171f064a5a9","Type":"ContainerDied","Data":"6ac8d925a8fd341452344ba25300c4e943e7ee767431919cb47a7d51e94371c7"}
Jul 18 02:30:23.189315 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:23.189292    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:23.320733 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:23.320662    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca\") pod \"bebc649e-eb1e-443d-9475-e171f064a5a9\" (UID: \"bebc649e-eb1e-443d-9475-e171f064a5a9\") "
Jul 18 02:30:23.321030 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:23.321009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bebc649e-eb1e-443d-9475-e171f064a5a9" (UID: "bebc649e-eb1e-443d-9475-e171f064a5a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:30:23.421506 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:23.421476    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bebc649e-eb1e-443d-9475-e171f064a5a9-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:24.057231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:24.057206    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"
Jul 18 02:30:24.057390 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:24.057200    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd" event={"ID":"bebc649e-eb1e-443d-9475-e171f064a5a9","Type":"ContainerDied","Data":"c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b"}
Jul 18 02:30:24.057390 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:24.057337    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c078387f6131daba285eb6fd9316e3877a5870e529f7940d67cc57bae445294b"
Jul 18 02:30:31.087665 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.087634    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:30:31.088184 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.087833    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" podUID="48e70f83-ca44-443f-83ce-504072df50ae" containerName="maas-api" containerID="cri-o://046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116" gracePeriod=30
Jul 18 02:30:31.166334 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.166297    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"]
Jul 18 02:30:31.172471 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.172435    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f6c952-29739030-q6hqb"]
Jul 18 02:30:31.353695 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.353639    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:30:31.481608 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.481580    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca\") pod \"48e70f83-ca44-443f-83ce-504072df50ae\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") "
Jul 18 02:30:31.481752 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.481613    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls\") pod \"48e70f83-ca44-443f-83ce-504072df50ae\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") "
Jul 18 02:30:31.481752 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.481681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2h29\" (UniqueName: \"kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29\") pod \"48e70f83-ca44-443f-83ce-504072df50ae\" (UID: \"48e70f83-ca44-443f-83ce-504072df50ae\") "
Jul 18 02:30:31.481966 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.481940    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48e70f83-ca44-443f-83ce-504072df50ae" (UID: "48e70f83-ca44-443f-83ce-504072df50ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:30:31.483723 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.483701    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48e70f83-ca44-443f-83ce-504072df50ae" (UID: "48e70f83-ca44-443f-83ce-504072df50ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:30:31.483807 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.483780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29" (OuterVolumeSpecName: "kube-api-access-f2h29") pod "48e70f83-ca44-443f-83ce-504072df50ae" (UID: "48e70f83-ca44-443f-83ce-504072df50ae"). InnerVolumeSpecName "kube-api-access-f2h29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:30:31.582499 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.582472    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48e70f83-ca44-443f-83ce-504072df50ae-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:31.582499 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.582497    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48e70f83-ca44-443f-83ce-504072df50ae-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:31.582625 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.582507    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2h29\" (UniqueName: \"kubernetes.io/projected/48e70f83-ca44-443f-83ce-504072df50ae-kube-api-access-f2h29\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:30:31.892086 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:31.892029    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f5e4b0-c23f-4b8f-a286-2f38811c7bed" path="/var/lib/kubelet/pods/27f5e4b0-c23f-4b8f-a286-2f38811c7bed/volumes"
Jul 18 02:30:32.102826 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.102792    2563 generic.go:356] "Generic (PLEG): container finished" podID="48e70f83-ca44-443f-83ce-504072df50ae" containerID="046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116" exitCode=0
Jul 18 02:30:32.103233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.102842    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"
Jul 18 02:30:32.103233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.102889    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" event={"ID":"48e70f83-ca44-443f-83ce-504072df50ae","Type":"ContainerDied","Data":"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"}
Jul 18 02:30:32.103233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.102940    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl" event={"ID":"48e70f83-ca44-443f-83ce-504072df50ae","Type":"ContainerDied","Data":"de57ae27e7da7fe976d6847f171c7dca61dcba0ca2741ab0a8a97f5855e7d1c2"}
Jul 18 02:30:32.103233 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.102966    2563 scope.go:117] "RemoveContainer" containerID="046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"
Jul 18 02:30:32.113980 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.113963    2563 scope.go:117] "RemoveContainer" containerID="046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"
Jul 18 02:30:32.114248 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:30:32.114228    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116\": container with ID starting with 046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116 not found: ID does not exist" containerID="046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"
Jul 18 02:30:32.114325 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.114257    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116"} err="failed to get container status \"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116\": rpc error: code = NotFound desc = could not find container \"046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116\": container with ID starting with 046f53f53b284f19f0a12fba38b6a35c1ba81556ecefb66ddcfacec2d96ad116 not found: ID does not exist"
Jul 18 02:30:32.127085 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.127060    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:30:32.130734 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:32.130713    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f6c952-6b7f8f84b8-264jl"]
Jul 18 02:30:33.891720 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:33.891687    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e70f83-ca44-443f-83ce-504072df50ae" path="/var/lib/kubelet/pods/48e70f83-ca44-443f-83ce-504072df50ae/volumes"
Jul 18 02:30:35.644427 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:35.644394    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"]
Jul 18 02:30:35.649125 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:35.649097    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f6c952-c4fdd"]
Jul 18 02:30:35.891296 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:35.891229    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebc649e-eb1e-443d-9475-e171f064a5a9" path="/var/lib/kubelet/pods/bebc649e-eb1e-443d-9475-e171f064a5a9/volumes"
Jul 18 02:30:45.999930 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:45.999904    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:30:46.008231 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:46.008209    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:30:47.357444 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.357409    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:30:47.358100 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358071    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e70f83-ca44-443f-83ce-504072df50ae" containerName="maas-api"
Jul 18 02:30:47.358100 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358100    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e70f83-ca44-443f-83ce-504072df50ae" containerName="maas-api"
Jul 18 02:30:47.358284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358132    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebc649e-eb1e-443d-9475-e171f064a5a9" containerName="revoke-keys"
Jul 18 02:30:47.358284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358142    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebc649e-eb1e-443d-9475-e171f064a5a9" containerName="revoke-keys"
Jul 18 02:30:47.358284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358244    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e70f83-ca44-443f-83ce-504072df50ae" containerName="maas-api"
Jul 18 02:30:47.358284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.358259    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebc649e-eb1e-443d-9475-e171f064a5a9" containerName="revoke-keys"
Jul 18 02:30:47.363478 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.363455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.367271 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.367249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b8fe6e-serving-cert\""
Jul 18 02:30:47.384414 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.384390    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:30:47.402358 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.402326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwshh\" (UniqueName: \"kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.402486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.402373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.402486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.402416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.503040 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.503012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.503205 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.503146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwshh\" (UniqueName: \"kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.503205 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.503175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.503786 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.503765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.505419 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.505400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.516998 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.516977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwshh\" (UniqueName: \"kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh\") pod \"maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.674723 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.674655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:47.824763 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:47.824734    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e20257_f916_4197_9acd_908b8aeb9c7d.slice/crio-ba5bb6ea1aa728c19d52471ef88a97ba6b631898fdaac80e64382f6b44949d79 WatchSource:0}: Error finding container ba5bb6ea1aa728c19d52471ef88a97ba6b631898fdaac80e64382f6b44949d79: Status 404 returned error can't find the container with id ba5bb6ea1aa728c19d52471ef88a97ba6b631898fdaac80e64382f6b44949d79
Jul 18 02:30:47.825678 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:47.825649    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:30:48.197105 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:48.197076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" event={"ID":"86e20257-f916-4197-9acd-908b8aeb9c7d","Type":"ContainerStarted","Data":"ba5bb6ea1aa728c19d52471ef88a97ba6b631898fdaac80e64382f6b44949d79"}
Jul 18 02:30:49.204982 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:49.204944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" event={"ID":"86e20257-f916-4197-9acd-908b8aeb9c7d","Type":"ContainerStarted","Data":"0f6cc56d40eb7e67d0976838efee1169ea9423b30b02cdf09d687ad157ba5cab"}
Jul 18 02:30:49.205377 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:49.205017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:49.229613 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:49.229566    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" podStartSLOduration=1.8887470020000001 podStartE2EDuration="2.229551812s" totalImagesPullingTime="340.80481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:49.228017402 +0000 UTC m=+2403.865270684" watchObservedRunningTime="2026-07-18 02:30:49.229551812 +0000 UTC m=+2403.866805091"
Jul 18 02:30:55.216621 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.216593    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:30:55.357135 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.357088    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:30:55.360793 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.360774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.365253 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.365231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-acf914-serving-cert\""
Jul 18 02:30:55.383800 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.383760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:30:55.470734 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.470656    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8c6\" (UniqueName: \"kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.470878 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.470758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.470878 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.470813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.571686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.571641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.571686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.571681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8c6\" (UniqueName: \"kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.571907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.571746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.572494 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.572470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.574240 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.574208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.581086 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.581057    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8c6\" (UniqueName: \"kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6\") pod \"maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.672498 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.672474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:55.815315 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:55.815275    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:30:55.817560 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:30:55.817529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e697839_405d_4cc1_b3b2_06c04505d571.slice/crio-136898e82d01497b32dd62e3f669b79a3bb8af24ab9b933a7ae49fdf6f20e04b WatchSource:0}: Error finding container 136898e82d01497b32dd62e3f669b79a3bb8af24ab9b933a7ae49fdf6f20e04b: Status 404 returned error can't find the container with id 136898e82d01497b32dd62e3f669b79a3bb8af24ab9b933a7ae49fdf6f20e04b
Jul 18 02:30:56.251186 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:56.251155    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" event={"ID":"4e697839-405d-4cc1-b3b2-06c04505d571","Type":"ContainerStarted","Data":"136898e82d01497b32dd62e3f669b79a3bb8af24ab9b933a7ae49fdf6f20e04b"}
Jul 18 02:30:57.258801 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:57.258770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" event={"ID":"4e697839-405d-4cc1-b3b2-06c04505d571","Type":"ContainerStarted","Data":"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"}
Jul 18 02:30:57.259208 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:57.258892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:30:57.278464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:30:57.278419    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" podStartSLOduration=1.766196723 podStartE2EDuration="2.278404084s" totalImagesPullingTime="512.207361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:30:57.277443637 +0000 UTC m=+2411.914696919" watchObservedRunningTime="2026-07-18 02:30:57.278404084 +0000 UTC m=+2411.915657363"
Jul 18 02:31:03.269313 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:03.269276    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:31:23.228147 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.228037    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:31:23.228590 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.228301    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" podUID="86e20257-f916-4197-9acd-908b8aeb9c7d" containerName="maas-api" containerID="cri-o://0f6cc56d40eb7e67d0976838efee1169ea9423b30b02cdf09d687ad157ba5cab" gracePeriod=30
Jul 18 02:31:23.412287 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.412254    2563 generic.go:356] "Generic (PLEG): container finished" podID="86e20257-f916-4197-9acd-908b8aeb9c7d" containerID="0f6cc56d40eb7e67d0976838efee1169ea9423b30b02cdf09d687ad157ba5cab" exitCode=0
Jul 18 02:31:23.412436 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.412330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" event={"ID":"86e20257-f916-4197-9acd-908b8aeb9c7d","Type":"ContainerDied","Data":"0f6cc56d40eb7e67d0976838efee1169ea9423b30b02cdf09d687ad157ba5cab"}
Jul 18 02:31:23.483835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.483782    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:31:23.609159 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.609131    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwshh\" (UniqueName: \"kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh\") pod \"86e20257-f916-4197-9acd-908b8aeb9c7d\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") "
Jul 18 02:31:23.609329 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.609214    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca\") pod \"86e20257-f916-4197-9acd-908b8aeb9c7d\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") "
Jul 18 02:31:23.609329 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.609277    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls\") pod \"86e20257-f916-4197-9acd-908b8aeb9c7d\" (UID: \"86e20257-f916-4197-9acd-908b8aeb9c7d\") "
Jul 18 02:31:23.609597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.609565    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86e20257-f916-4197-9acd-908b8aeb9c7d" (UID: "86e20257-f916-4197-9acd-908b8aeb9c7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:31:23.611278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.611257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86e20257-f916-4197-9acd-908b8aeb9c7d" (UID: "86e20257-f916-4197-9acd-908b8aeb9c7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:31:23.611366 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.611314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh" (OuterVolumeSpecName: "kube-api-access-lwshh") pod "86e20257-f916-4197-9acd-908b8aeb9c7d" (UID: "86e20257-f916-4197-9acd-908b8aeb9c7d"). InnerVolumeSpecName "kube-api-access-lwshh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:31:23.710369 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.710339    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86e20257-f916-4197-9acd-908b8aeb9c7d-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:23.710369 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.710363    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86e20257-f916-4197-9acd-908b8aeb9c7d-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:23.710538 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:23.710374    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwshh\" (UniqueName: \"kubernetes.io/projected/86e20257-f916-4197-9acd-908b8aeb9c7d-kube-api-access-lwshh\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:24.419356 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:24.419330    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"
Jul 18 02:31:24.419356 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:24.419334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln" event={"ID":"86e20257-f916-4197-9acd-908b8aeb9c7d","Type":"ContainerDied","Data":"ba5bb6ea1aa728c19d52471ef88a97ba6b631898fdaac80e64382f6b44949d79"}
Jul 18 02:31:24.419868 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:24.419411    2563 scope.go:117] "RemoveContainer" containerID="0f6cc56d40eb7e67d0976838efee1169ea9423b30b02cdf09d687ad157ba5cab"
Jul 18 02:31:24.439922 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:24.439901    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:31:24.445768 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:24.445745    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b8fe6e-bb5574d9f-2njln"]
Jul 18 02:31:25.894258 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:25.894230    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86e20257-f916-4197-9acd-908b8aeb9c7d" path="/var/lib/kubelet/pods/86e20257-f916-4197-9acd-908b8aeb9c7d/volumes"
Jul 18 02:31:34.792817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.792782    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"]
Jul 18 02:31:34.793305 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.793240    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86e20257-f916-4197-9acd-908b8aeb9c7d" containerName="maas-api"
Jul 18 02:31:34.793305 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.793255    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="86e20257-f916-4197-9acd-908b8aeb9c7d" containerName="maas-api"
Jul 18 02:31:34.793385 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.793326    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="86e20257-f916-4197-9acd-908b8aeb9c7d" containerName="maas-api"
Jul 18 02:31:34.797633 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.797615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:34.800264 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.800241    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:31:34.809402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.809376    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"]
Jul 18 02:31:34.903266 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:34.903233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-acf914-xrvcn\" (UID: \"0d7b38df-e29c-4eeb-986e-2a91bc4f4940\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:35.004152 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:35.004126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-acf914-xrvcn\" (UID: \"0d7b38df-e29c-4eeb-986e-2a91bc4f4940\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:35.004765 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:35.004745    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-acf914-xrvcn\" (UID: \"0d7b38df-e29c-4eeb-986e-2a91bc4f4940\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:35.108210 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:35.108187    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:35.253945 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:31:35.253908    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7b38df_e29c_4eeb_986e_2a91bc4f4940.slice/crio-9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1 WatchSource:0}: Error finding container 9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1: Status 404 returned error can't find the container with id 9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1
Jul 18 02:31:35.256086 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:35.256060    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"]
Jul 18 02:31:35.484133 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:35.484100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn" event={"ID":"0d7b38df-e29c-4eeb-986e-2a91bc4f4940","Type":"ContainerStarted","Data":"9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1"}
Jul 18 02:31:36.490441 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:36.490360    2563 generic.go:356] "Generic (PLEG): container finished" podID="0d7b38df-e29c-4eeb-986e-2a91bc4f4940" containerID="1902678a3e2bb639220b63035db58e40b25e913f9dcaa6b1737ec58d1f91ed59" exitCode=0
Jul 18 02:31:36.490773 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:36.490452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn" event={"ID":"0d7b38df-e29c-4eeb-986e-2a91bc4f4940","Type":"ContainerDied","Data":"1902678a3e2bb639220b63035db58e40b25e913f9dcaa6b1737ec58d1f91ed59"}
Jul 18 02:31:37.630671 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:37.630648    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:37.727999 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:37.727974    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca\") pod \"0d7b38df-e29c-4eeb-986e-2a91bc4f4940\" (UID: \"0d7b38df-e29c-4eeb-986e-2a91bc4f4940\") "
Jul 18 02:31:37.728349 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:37.728329    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0d7b38df-e29c-4eeb-986e-2a91bc4f4940" (UID: "0d7b38df-e29c-4eeb-986e-2a91bc4f4940"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:31:37.829621 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:37.829566    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d7b38df-e29c-4eeb-986e-2a91bc4f4940-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:38.503028 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:38.502995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"
Jul 18 02:31:38.503198 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:38.503029    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn" event={"ID":"0d7b38df-e29c-4eeb-986e-2a91bc4f4940","Type":"ContainerDied","Data":"9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1"}
Jul 18 02:31:38.503198 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:38.503095    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9741dc1b80229cda9e91e111d618eea1ddec307880fed0b52ba9aec1029db2f1"
Jul 18 02:31:46.172871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:46.172844    2563 scope.go:117] "RemoveContainer" containerID="fdf1a032c004c1eb299d913f1f95bba9fa912864d2ae689ff17df0cc88bf2684"
Jul 18 02:31:50.202084 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.202023    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:31:50.202571 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.202225    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" podUID="4e697839-405d-4cc1-b3b2-06c04505d571" containerName="maas-api" containerID="cri-o://1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e" gracePeriod=30
Jul 18 02:31:50.452699 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.452638    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:31:50.522149 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.522122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca\") pod \"4e697839-405d-4cc1-b3b2-06c04505d571\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") "
Jul 18 02:31:50.522293 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.522202    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf8c6\" (UniqueName: \"kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6\") pod \"4e697839-405d-4cc1-b3b2-06c04505d571\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") "
Jul 18 02:31:50.522293 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.522241    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls\") pod \"4e697839-405d-4cc1-b3b2-06c04505d571\" (UID: \"4e697839-405d-4cc1-b3b2-06c04505d571\") "
Jul 18 02:31:50.522549 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.522531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e697839-405d-4cc1-b3b2-06c04505d571" (UID: "4e697839-405d-4cc1-b3b2-06c04505d571"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:31:50.524284 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.524252    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6" (OuterVolumeSpecName: "kube-api-access-nf8c6") pod "4e697839-405d-4cc1-b3b2-06c04505d571" (UID: "4e697839-405d-4cc1-b3b2-06c04505d571"). InnerVolumeSpecName "kube-api-access-nf8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:31:50.524402 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.524364    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e697839-405d-4cc1-b3b2-06c04505d571" (UID: "4e697839-405d-4cc1-b3b2-06c04505d571"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:31:50.570682 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.570655    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e697839-405d-4cc1-b3b2-06c04505d571" containerID="1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e" exitCode=0
Jul 18 02:31:50.570817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.570719    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"
Jul 18 02:31:50.570817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.570741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" event={"ID":"4e697839-405d-4cc1-b3b2-06c04505d571","Type":"ContainerDied","Data":"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"}
Jul 18 02:31:50.570817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.570803    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57" event={"ID":"4e697839-405d-4cc1-b3b2-06c04505d571","Type":"ContainerDied","Data":"136898e82d01497b32dd62e3f669b79a3bb8af24ab9b933a7ae49fdf6f20e04b"}
Jul 18 02:31:50.570940 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.570829    2563 scope.go:117] "RemoveContainer" containerID="1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"
Jul 18 02:31:50.580641 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.580621    2563 scope.go:117] "RemoveContainer" containerID="1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"
Jul 18 02:31:50.580967 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:31:50.580946    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e\": container with ID starting with 1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e not found: ID does not exist" containerID="1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"
Jul 18 02:31:50.581062 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.580976    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e"} err="failed to get container status \"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e\": rpc error: code = NotFound desc = could not find container \"1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e\": container with ID starting with 1679d479826b695aff52eb32bcd4fbc824d71136f5ec5eee72643c1a89151f9e not found: ID does not exist"
Jul 18 02:31:50.587164 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:31:50.587145    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e697839_405d_4cc1_b3b2_06c04505d571.slice\": RecentStats: unable to find data in memory cache]"
Jul 18 02:31:50.599587 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.599554    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:31:50.602568 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.602547    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-acf914-55b8fbd87d-5zc57"]
Jul 18 02:31:50.623493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.623472    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e697839-405d-4cc1-b3b2-06c04505d571-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:50.623493 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.623491    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf8c6\" (UniqueName: \"kubernetes.io/projected/4e697839-405d-4cc1-b3b2-06c04505d571-kube-api-access-nf8c6\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:50.623598 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:50.623504    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e697839-405d-4cc1-b3b2-06c04505d571-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:31:51.892714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:51.892683    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e697839-405d-4cc1-b3b2-06c04505d571" path="/var/lib/kubelet/pods/4e697839-405d-4cc1-b3b2-06c04505d571/volumes"
Jul 18 02:31:54.858588 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:54.858550    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"]
Jul 18 02:31:54.862203 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:54.862170    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-acf914-xrvcn"]
Jul 18 02:31:55.891500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:31:55.891466    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7b38df-e29c-4eeb-986e-2a91bc4f4940" path="/var/lib/kubelet/pods/0d7b38df-e29c-4eeb-986e-2a91bc4f4940/volumes"
Jul 18 02:32:05.600843 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.600806    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:32:05.601384 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601322    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7b38df-e29c-4eeb-986e-2a91bc4f4940" containerName="revoke-keys"
Jul 18 02:32:05.601384 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601339    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7b38df-e29c-4eeb-986e-2a91bc4f4940" containerName="revoke-keys"
Jul 18 02:32:05.601384 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601356    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e697839-405d-4cc1-b3b2-06c04505d571" containerName="maas-api"
Jul 18 02:32:05.601384 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601363    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e697839-405d-4cc1-b3b2-06c04505d571" containerName="maas-api"
Jul 18 02:32:05.601612 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601428    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7b38df-e29c-4eeb-986e-2a91bc4f4940" containerName="revoke-keys"
Jul 18 02:32:05.601612 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.601437    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e697839-405d-4cc1-b3b2-06c04505d571" containerName="maas-api"
Jul 18 02:32:05.604741 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.604722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.607578 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.607558    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-4b0cf7-serving-cert\""
Jul 18 02:32:05.617391 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.617364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:32:05.644679 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.644643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.644846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.644768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bh2l\" (UniqueName: \"kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.644846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.644809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.745298 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.745259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.745456 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.745373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bh2l\" (UniqueName: \"kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.745456 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:05.745406    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-serving-cert: secret "maas-api-e2e-shared-a-4b0cf7-serving-cert" not found
Jul 18 02:32:05.745530 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:05.745475    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls podName:5940ecd5-7f55-4b7f-9abc-7144e29c2ecb nodeName:}" failed. No retries permitted until 2026-07-18 02:32:06.245460229 +0000 UTC m=+2480.882713491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls") pod "maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" (UID: "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb") : secret "maas-api-e2e-shared-a-4b0cf7-serving-cert" not found
Jul 18 02:32:05.745530 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.745410    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.746152 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.746134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:05.755393 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:05.755360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bh2l\" (UniqueName: \"kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:06.250816 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:06.250777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:06.250998 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:06.250926    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-serving-cert: secret "maas-api-e2e-shared-a-4b0cf7-serving-cert" not found
Jul 18 02:32:06.250998 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:06.250997    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls podName:5940ecd5-7f55-4b7f-9abc-7144e29c2ecb nodeName:}" failed. No retries permitted until 2026-07-18 02:32:07.250981631 +0000 UTC m=+2481.888234892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls") pod "maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" (UID: "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb") : secret "maas-api-e2e-shared-a-4b0cf7-serving-cert" not found
Jul 18 02:32:07.260336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.260301    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:07.262669 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.262637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:07.414971 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.414940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:07.548738 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.548714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:32:07.550271 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:32:07.550250    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5940ecd5_7f55_4b7f_9abc_7144e29c2ecb.slice/crio-0d8cb0bd133b0bee0562ab007baf7df5cefddb42179d344deaee2de041efd04b WatchSource:0}: Error finding container 0d8cb0bd133b0bee0562ab007baf7df5cefddb42179d344deaee2de041efd04b: Status 404 returned error can't find the container with id 0d8cb0bd133b0bee0562ab007baf7df5cefddb42179d344deaee2de041efd04b
Jul 18 02:32:07.552109 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.552090    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:32:07.669688 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:07.669629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" event={"ID":"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb","Type":"ContainerStarted","Data":"0d8cb0bd133b0bee0562ab007baf7df5cefddb42179d344deaee2de041efd04b"}
Jul 18 02:32:08.676954 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:08.676920    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" event={"ID":"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb","Type":"ContainerStarted","Data":"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"}
Jul 18 02:32:08.677440 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:08.677040    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:08.706188 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:08.706130    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" podStartSLOduration=3.349453893 podStartE2EDuration="3.706115347s" totalImagesPullingTime="356.661454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:32:08.697548849 +0000 UTC m=+2483.334802128" watchObservedRunningTime="2026-07-18 02:32:08.706115347 +0000 UTC m=+2483.343368626"
Jul 18 02:32:13.692752 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.692716    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:32:13.697735 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.697705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.701475 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.701439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-124cd9-serving-cert\""
Jul 18 02:32:13.708937 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.707985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:32:13.814730 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.814696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.814885 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.814751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.814885 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.814808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzqtj\" (UniqueName: \"kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.915907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.915881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.916122 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.915933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.916122 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:13.916086    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-serving-cert: secret "maas-api-e2e-shared-b-124cd9-serving-cert" not found
Jul 18 02:32:13.916122 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.916101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzqtj\" (UniqueName: \"kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.916269 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:32:13.916151    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls podName:8841866a-8b91-43b2-875b-bfd668a6e7ff nodeName:}" failed. No retries permitted until 2026-07-18 02:32:14.416130285 +0000 UTC m=+2489.053383548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls") pod "maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" (UID: "8841866a-8b91-43b2-875b-bfd668a6e7ff") : secret "maas-api-e2e-shared-b-124cd9-serving-cert" not found
Jul 18 02:32:13.916541 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.916524    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:13.928183 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:13.928158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzqtj\" (UniqueName: \"kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:14.420062 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:14.420023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:14.422565 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:14.422537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") pod \"maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:14.611091 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:14.611036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:14.689583 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:14.689513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:32:14.762957 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:14.762926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:32:14.764727 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:32:14.764694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8841866a_8b91_43b2_875b_bfd668a6e7ff.slice/crio-cead97907f530cc55b7825415d0de7b3a18b5a69006c06af6728841041836b4b WatchSource:0}: Error finding container cead97907f530cc55b7825415d0de7b3a18b5a69006c06af6728841041836b4b: Status 404 returned error can't find the container with id cead97907f530cc55b7825415d0de7b3a18b5a69006c06af6728841041836b4b
Jul 18 02:32:15.729319 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:15.729282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" event={"ID":"8841866a-8b91-43b2-875b-bfd668a6e7ff","Type":"ContainerStarted","Data":"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"}
Jul 18 02:32:15.729486 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:15.729339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" event={"ID":"8841866a-8b91-43b2-875b-bfd668a6e7ff","Type":"ContainerStarted","Data":"cead97907f530cc55b7825415d0de7b3a18b5a69006c06af6728841041836b4b"}
Jul 18 02:32:15.729552 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:15.729506    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:15.756171 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:15.756124    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" podStartSLOduration=2.397660923 podStartE2EDuration="2.756109839s" totalImagesPullingTime="358.448916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:32:15.752470769 +0000 UTC m=+2490.389724049" watchObservedRunningTime="2026-07-18 02:32:15.756109839 +0000 UTC m=+2490.393363135"
Jul 18 02:32:21.741395 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:21.741350    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:32:46.201374 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:32:46.201302    2563 scope.go:117] "RemoveContainer" containerID="48a0f3ca40e1644cb7ef221b45bf194e08bcfe4c0197c89ff8804b1b50d2b29b"
Jul 18 02:35:46.038144 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:35:46.038080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:35:46.048786 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:35:46.048764    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:36:46.253623 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:36:46.253595    2563 scope.go:117] "RemoveContainer" containerID="a4385f5161e082d1659f75a1aa567f73cb49d2a4abf2d03ab8bc4425e248124e"
Jul 18 02:36:46.262649 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:36:46.262629    2563 scope.go:117] "RemoveContainer" containerID="5e2ce76ddc9a136ba26786062b825f1987a058cdc6665dfad135cecb81521945"
Jul 18 02:36:46.270851 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:36:46.270834    2563 scope.go:117] "RemoveContainer" containerID="d97a8fda4832d9c1033638cbd16d69819e89d4b65e7db65c7b9e87cced50691e"
Jul 18 02:36:46.279455 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:36:46.279433    2563 scope.go:117] "RemoveContainer" containerID="6ac8d925a8fd341452344ba25300c4e943e7ee767431919cb47a7d51e94371c7"
Jul 18 02:37:45.647183 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.647110    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054736944"]
Jul 18 02:37:45.650500 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.650482    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:45.653335 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.653300    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-95qz8\""
Jul 18 02:37:45.656958 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.656933    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054736944"]
Jul 18 02:37:45.730812 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.730783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m2mc\" (UniqueName: \"kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc\") pod \"test-curl-7556-140493054736944\" (UID: \"9dec3773-1a90-4c08-83df-5db49ebbd081\") " pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:45.831369 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.831345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m2mc\" (UniqueName: \"kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc\") pod \"test-curl-7556-140493054736944\" (UID: \"9dec3773-1a90-4c08-83df-5db49ebbd081\") " pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:45.839926 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.839901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m2mc\" (UniqueName: \"kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc\") pod \"test-curl-7556-140493054736944\" (UID: \"9dec3773-1a90-4c08-83df-5db49ebbd081\") " pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:45.964798 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.964736    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-95qz8\""
Jul 18 02:37:45.972021 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:45.972004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:46.103063 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:46.103019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054736944"]
Jul 18 02:37:46.104553 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:37:46.104527    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dec3773_1a90_4c08_83df_5db49ebbd081.slice/crio-f30791d38c9d6aaad307b498b4e674ad5599364c373281a12e8a4516c2192431 WatchSource:0}: Error finding container f30791d38c9d6aaad307b498b4e674ad5599364c373281a12e8a4516c2192431: Status 404 returned error can't find the container with id f30791d38c9d6aaad307b498b4e674ad5599364c373281a12e8a4516c2192431
Jul 18 02:37:46.105936 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:46.105915    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 02:37:46.316958 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:46.316887    2563 scope.go:117] "RemoveContainer" containerID="1902678a3e2bb639220b63035db58e40b25e913f9dcaa6b1737ec58d1f91ed59"
Jul 18 02:37:46.627928 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:46.627881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054736944" event={"ID":"9dec3773-1a90-4c08-83df-5db49ebbd081","Type":"ContainerStarted","Data":"f30791d38c9d6aaad307b498b4e674ad5599364c373281a12e8a4516c2192431"}
Jul 18 02:37:47.635907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:47.635876    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dec3773-1a90-4c08-83df-5db49ebbd081" containerID="231b0d795963a14740d3477a5c0c8a77c269f3bd72feec77ebe192523018de6a" exitCode=0
Jul 18 02:37:47.636309 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:47.635972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054736944" event={"ID":"9dec3773-1a90-4c08-83df-5db49ebbd081","Type":"ContainerDied","Data":"231b0d795963a14740d3477a5c0c8a77c269f3bd72feec77ebe192523018de6a"}
Jul 18 02:37:48.781875 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.781854    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:48.818426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.818400    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054736944_9dec3773-1a90-4c08-83df-5db49ebbd081/test-curl-7556-140493054736944/0.log"
Jul 18 02:37:48.844724 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.844697    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054736944"]
Jul 18 02:37:48.847921 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.847898    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054736944"]
Jul 18 02:37:48.861528 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.861507    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m2mc\" (UniqueName: \"kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc\") pod \"9dec3773-1a90-4c08-83df-5db49ebbd081\" (UID: \"9dec3773-1a90-4c08-83df-5db49ebbd081\") "
Jul 18 02:37:48.863514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.863492    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc" (OuterVolumeSpecName: "kube-api-access-8m2mc") pod "9dec3773-1a90-4c08-83df-5db49ebbd081" (UID: "9dec3773-1a90-4c08-83df-5db49ebbd081"). InnerVolumeSpecName "kube-api-access-8m2mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:37:48.962686 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.962621    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m2mc\" (UniqueName: \"kubernetes.io/projected/9dec3773-1a90-4c08-83df-5db49ebbd081-kube-api-access-8m2mc\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:37:48.974443 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.974407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054736816"]
Jul 18 02:37:48.974812 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.974798    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dec3773-1a90-4c08-83df-5db49ebbd081" containerName="test-curl-7556-140493054736944"
Jul 18 02:37:48.974858 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.974813    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dec3773-1a90-4c08-83df-5db49ebbd081" containerName="test-curl-7556-140493054736944"
Jul 18 02:37:48.974903 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.974893    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dec3773-1a90-4c08-83df-5db49ebbd081" containerName="test-curl-7556-140493054736944"
Jul 18 02:37:48.977941 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.977927    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:48.983199 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:48.983174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054736816"]
Jul 18 02:37:49.063852 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.063820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pghc6\" (UniqueName: \"kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6\") pod \"test-curl-7556-140493054736816\" (UID: \"5ccff120-7c1d-4250-b3a0-3c43e7353db0\") " pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:49.164776 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.164750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pghc6\" (UniqueName: \"kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6\") pod \"test-curl-7556-140493054736816\" (UID: \"5ccff120-7c1d-4250-b3a0-3c43e7353db0\") " pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:49.173620 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.173591    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pghc6\" (UniqueName: \"kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6\") pod \"test-curl-7556-140493054736816\" (UID: \"5ccff120-7c1d-4250-b3a0-3c43e7353db0\") " pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:49.287799 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.287747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:49.419345 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.419324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054736816"]
Jul 18 02:37:49.420816 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:37:49.420790    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ccff120_7c1d_4250_b3a0_3c43e7353db0.slice/crio-d5cdda394192125a25e9d92186a1d70836b0398b71933271e27b884286f38f0d WatchSource:0}: Error finding container d5cdda394192125a25e9d92186a1d70836b0398b71933271e27b884286f38f0d: Status 404 returned error can't find the container with id d5cdda394192125a25e9d92186a1d70836b0398b71933271e27b884286f38f0d
Jul 18 02:37:49.648525 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.648490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054736816" event={"ID":"5ccff120-7c1d-4250-b3a0-3c43e7353db0","Type":"ContainerStarted","Data":"d5cdda394192125a25e9d92186a1d70836b0398b71933271e27b884286f38f0d"}
Jul 18 02:37:49.649692 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.649676    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f30791d38c9d6aaad307b498b4e674ad5599364c373281a12e8a4516c2192431"
Jul 18 02:37:49.649692 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.649680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:49.660640 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:37:49.660614    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140493054736944\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="9dec3773-1a90-4c08-83df-5db49ebbd081" pod="opendatahub/test-curl-7556-140493054736944"
Jul 18 02:37:49.892523 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:49.892497    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dec3773-1a90-4c08-83df-5db49ebbd081" path="/var/lib/kubelet/pods/9dec3773-1a90-4c08-83df-5db49ebbd081/volumes"
Jul 18 02:37:50.656836 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:50.656798    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ccff120-7c1d-4250-b3a0-3c43e7353db0" containerID="a2f7d509504402730d4930e00f6d5fb8aa7d5a9d9e8bcfde120101354aa2dd24" exitCode=0
Jul 18 02:37:50.657013 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:50.656878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054736816" event={"ID":"5ccff120-7c1d-4250-b3a0-3c43e7353db0","Type":"ContainerDied","Data":"a2f7d509504402730d4930e00f6d5fb8aa7d5a9d9e8bcfde120101354aa2dd24"}
Jul 18 02:37:51.802472 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.802449    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:51.824680 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.824660    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054736816_5ccff120-7c1d-4250-b3a0-3c43e7353db0/test-curl-7556-140493054736816/0.log"
Jul 18 02:37:51.852073 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.852036    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054736816"]
Jul 18 02:37:51.858185 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.858164    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054736816"]
Jul 18 02:37:51.886684 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.886658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pghc6\" (UniqueName: \"kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6\") pod \"5ccff120-7c1d-4250-b3a0-3c43e7353db0\" (UID: \"5ccff120-7c1d-4250-b3a0-3c43e7353db0\") "
Jul 18 02:37:51.888682 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.888656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6" (OuterVolumeSpecName: "kube-api-access-pghc6") pod "5ccff120-7c1d-4250-b3a0-3c43e7353db0" (UID: "5ccff120-7c1d-4250-b3a0-3c43e7353db0"). InnerVolumeSpecName "kube-api-access-pghc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:37:51.891917 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.891892    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccff120-7c1d-4250-b3a0-3c43e7353db0" path="/var/lib/kubelet/pods/5ccff120-7c1d-4250-b3a0-3c43e7353db0/volumes"
Jul 18 02:37:51.988137 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:51.988085    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pghc6\" (UniqueName: \"kubernetes.io/projected/5ccff120-7c1d-4250-b3a0-3c43e7353db0-kube-api-access-pghc6\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:37:52.019177 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.019149    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:52.019594 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.019576    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccff120-7c1d-4250-b3a0-3c43e7353db0" containerName="test-curl-7556-140493054736816"
Jul 18 02:37:52.019671 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.019597    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccff120-7c1d-4250-b3a0-3c43e7353db0" containerName="test-curl-7556-140493054736816"
Jul 18 02:37:52.019729 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.019714    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccff120-7c1d-4250-b3a0-3c43e7353db0" containerName="test-curl-7556-140493054736816"
Jul 18 02:37:52.022849 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.022830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:52.027215 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.027192    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:52.089332 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.089307    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2n9v\" (UniqueName: \"kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v\") pod \"test-curl-7556-140493054301072\" (UID: \"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:52.190320 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.190299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2n9v\" (UniqueName: \"kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v\") pod \"test-curl-7556-140493054301072\" (UID: \"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:52.198081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.198038    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2n9v\" (UniqueName: \"kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v\") pod \"test-curl-7556-140493054301072\" (UID: \"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:52.333223 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.333166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:52.469274 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.469251    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:52.470414 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:37:52.470388    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4e2fe67_6d18_48e3_9b1a_4176c77b70fb.slice/crio-08f507073858ab016c9514491455ec760f0bbc8e0ad3fc93680201a8a8cdd7b4 WatchSource:0}: Error finding container 08f507073858ab016c9514491455ec760f0bbc8e0ad3fc93680201a8a8cdd7b4: Status 404 returned error can't find the container with id 08f507073858ab016c9514491455ec760f0bbc8e0ad3fc93680201a8a8cdd7b4
Jul 18 02:37:52.670215 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.670178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054301072" event={"ID":"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb","Type":"ContainerStarted","Data":"08f507073858ab016c9514491455ec760f0bbc8e0ad3fc93680201a8a8cdd7b4"}
Jul 18 02:37:52.671403 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.671380    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054736816"
Jul 18 02:37:52.671507 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:52.671427    2563 scope.go:117] "RemoveContainer" containerID="a2f7d509504402730d4930e00f6d5fb8aa7d5a9d9e8bcfde120101354aa2dd24"
Jul 18 02:37:53.679762 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:53.679727    2563 generic.go:356] "Generic (PLEG): container finished" podID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" containerID="0152f77df09aca5a496756a8cddfaa361f04bbf32c9151277490126d544e263f" exitCode=0
Jul 18 02:37:53.680193 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:53.679805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054301072" event={"ID":"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb","Type":"ContainerDied","Data":"0152f77df09aca5a496756a8cddfaa361f04bbf32c9151277490126d544e263f"}
Jul 18 02:37:54.827834 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.827809    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:54.849376 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.849353    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054301072_d4e2fe67-6d18-48e3-9b1a-4176c77b70fb/test-curl-7556-140493054301072/0.log"
Jul 18 02:37:54.875177 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.875150    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:54.879426 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.879404    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:54.915714 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.915692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2n9v\" (UniqueName: \"kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v\") pod \"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb\" (UID: \"d4e2fe67-6d18-48e3-9b1a-4176c77b70fb\") "
Jul 18 02:37:54.917738 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:54.917706    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v" (OuterVolumeSpecName: "kube-api-access-b2n9v") pod "d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" (UID: "d4e2fe67-6d18-48e3-9b1a-4176c77b70fb"). InnerVolumeSpecName "kube-api-access-b2n9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:37:55.001940 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.001884    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:55.002332 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.002318    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:55.002382 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.002334    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:55.002416 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.002395    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:55.005330 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.005315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.011381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.011360    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:55.016812 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.016785    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2n9v\" (UniqueName: \"kubernetes.io/projected/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb-kube-api-access-b2n9v\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:37:55.117343 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.117321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqh96\" (UniqueName: \"kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96\") pod \"test-curl-7556-140493054301072\" (UID: \"b551e123-c5e2-4483-bcd7-502e966b2ceb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.218586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.218564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqh96\" (UniqueName: \"kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96\") pod \"test-curl-7556-140493054301072\" (UID: \"b551e123-c5e2-4483-bcd7-502e966b2ceb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.227503 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.227479    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqh96\" (UniqueName: \"kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96\") pod \"test-curl-7556-140493054301072\" (UID: \"b551e123-c5e2-4483-bcd7-502e966b2ceb\") " pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.315173 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.315121    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.653229 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.653197    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:55.654566 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:37:55.654539    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb551e123_c5e2_4483_bcd7_502e966b2ceb.slice/crio-ae217ddd81c83f7075a2a5e52b8c1d6c154214fd0d0afa7e567a823dadd34cbe WatchSource:0}: Error finding container ae217ddd81c83f7075a2a5e52b8c1d6c154214fd0d0afa7e567a823dadd34cbe: Status 404 returned error can't find the container with id ae217ddd81c83f7075a2a5e52b8c1d6c154214fd0d0afa7e567a823dadd34cbe
Jul 18 02:37:55.694874 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.694839    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054301072" event={"ID":"b551e123-c5e2-4483-bcd7-502e966b2ceb","Type":"ContainerStarted","Data":"ae217ddd81c83f7075a2a5e52b8c1d6c154214fd0d0afa7e567a823dadd34cbe"}
Jul 18 02:37:55.696027 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.696010    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:55.696027 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.696021    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08f507073858ab016c9514491455ec760f0bbc8e0ad3fc93680201a8a8cdd7b4"
Jul 18 02:37:55.708260 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.708232    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7556-140493054301072" oldPodUID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb"
Jul 18 02:37:55.893609 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:55.893578    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4e2fe67-6d18-48e3-9b1a-4176c77b70fb" path="/var/lib/kubelet/pods/d4e2fe67-6d18-48e3-9b1a-4176c77b70fb/volumes"
Jul 18 02:37:56.702470 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:56.702435    2563 generic.go:356] "Generic (PLEG): container finished" podID="b551e123-c5e2-4483-bcd7-502e966b2ceb" containerID="7e0534b791408414d7efdfaf303a3aff2109793d167d2eca51431842da5e2621" exitCode=0
Jul 18 02:37:56.702645 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:56.702521    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054301072" event={"ID":"b551e123-c5e2-4483-bcd7-502e966b2ceb","Type":"ContainerDied","Data":"7e0534b791408414d7efdfaf303a3aff2109793d167d2eca51431842da5e2621"}
Jul 18 02:37:57.859538 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.859515    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:57.885285 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.885234    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054301072_b551e123-c5e2-4483-bcd7-502e966b2ceb/test-curl-7556-140493054301072/0.log"
Jul 18 02:37:57.910698 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.910659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:57.916907 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.916882    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054301072"]
Jul 18 02:37:57.940797 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.940774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqh96\" (UniqueName: \"kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96\") pod \"b551e123-c5e2-4483-bcd7-502e966b2ceb\" (UID: \"b551e123-c5e2-4483-bcd7-502e966b2ceb\") "
Jul 18 02:37:57.942892 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:57.942867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96" (OuterVolumeSpecName: "kube-api-access-lqh96") pod "b551e123-c5e2-4483-bcd7-502e966b2ceb" (UID: "b551e123-c5e2-4483-bcd7-502e966b2ceb"). InnerVolumeSpecName "kube-api-access-lqh96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:37:58.042381 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.042307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqh96\" (UniqueName: \"kubernetes.io/projected/b551e123-c5e2-4483-bcd7-502e966b2ceb-kube-api-access-lqh96\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:37:58.042628 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.042603    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:37:58.043098 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.043081    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:58.043154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.043099    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:58.043198 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.043178    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" containerName="test-curl-7556-140493054301072"
Jul 18 02:37:58.046099 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.046082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:37:58.053261 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.053233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:37:58.142965 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.142931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xml92\" (UniqueName: \"kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92\") pod \"test-curl-7556-140493054302080\" (UID: \"3127f02e-cd3d-4df7-82fe-51e3969e46ae\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:37:58.244497 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.244462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xml92\" (UniqueName: \"kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92\") pod \"test-curl-7556-140493054302080\" (UID: \"3127f02e-cd3d-4df7-82fe-51e3969e46ae\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:37:58.253286 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.253261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xml92\" (UniqueName: \"kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92\") pod \"test-curl-7556-140493054302080\" (UID: \"3127f02e-cd3d-4df7-82fe-51e3969e46ae\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:37:58.357268 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.357235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:37:58.492101 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.492078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:37:58.493173 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:37:58.493145    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3127f02e_cd3d_4df7_82fe_51e3969e46ae.slice/crio-c78363f3041e9de82b7079270fe8343460896bb7dc882090e70b49210bceaf89 WatchSource:0}: Error finding container c78363f3041e9de82b7079270fe8343460896bb7dc882090e70b49210bceaf89: Status 404 returned error can't find the container with id c78363f3041e9de82b7079270fe8343460896bb7dc882090e70b49210bceaf89
Jul 18 02:37:58.715400 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.715318    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:58.715400 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.715337    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae217ddd81c83f7075a2a5e52b8c1d6c154214fd0d0afa7e567a823dadd34cbe"
Jul 18 02:37:58.716604 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:58.716576    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054302080" event={"ID":"3127f02e-cd3d-4df7-82fe-51e3969e46ae","Type":"ContainerStarted","Data":"c78363f3041e9de82b7079270fe8343460896bb7dc882090e70b49210bceaf89"}
Jul 18 02:37:58.726929 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:37:58.726898    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140493054301072\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:59.725089 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:59.725036    2563 generic.go:356] "Generic (PLEG): container finished" podID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" containerID="9a48984a1e8504be8c34d28c5bd33297385a2fee47a72e68a1ad914b777fc503" exitCode=0
Jul 18 02:37:59.725509 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:59.725090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054302080" event={"ID":"3127f02e-cd3d-4df7-82fe-51e3969e46ae","Type":"ContainerDied","Data":"9a48984a1e8504be8c34d28c5bd33297385a2fee47a72e68a1ad914b777fc503"}
Jul 18 02:37:59.727900 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:37:59.727872    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140493054301072\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" pod="opendatahub/test-curl-7556-140493054301072"
Jul 18 02:37:59.893280 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:37:59.893248    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b551e123-c5e2-4483-bcd7-502e966b2ceb" path="/var/lib/kubelet/pods/b551e123-c5e2-4483-bcd7-502e966b2ceb/volumes"
Jul 18 02:38:00.869607 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.869582    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:00.891586 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.891563    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054302080_3127f02e-cd3d-4df7-82fe-51e3969e46ae/test-curl-7556-140493054302080/0.log"
Jul 18 02:38:00.919077 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.919034    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:00.925195 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.925175    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:00.966031 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.966005    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xml92\" (UniqueName: \"kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92\") pod \"3127f02e-cd3d-4df7-82fe-51e3969e46ae\" (UID: \"3127f02e-cd3d-4df7-82fe-51e3969e46ae\") "
Jul 18 02:38:00.968104 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:00.968085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92" (OuterVolumeSpecName: "kube-api-access-xml92") pod "3127f02e-cd3d-4df7-82fe-51e3969e46ae" (UID: "3127f02e-cd3d-4df7-82fe-51e3969e46ae"). InnerVolumeSpecName "kube-api-access-xml92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:38:01.050637 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.050574    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:01.051077 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.051033    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:01.051077 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.051068    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:01.051237 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.051224    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:01.054288 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.054270    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.058777 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.058754    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:01.067555 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.067535    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xml92\" (UniqueName: \"kubernetes.io/projected/3127f02e-cd3d-4df7-82fe-51e3969e46ae-kube-api-access-xml92\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:01.168516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.168488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhvzf\" (UniqueName: \"kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf\") pod \"test-curl-7556-140493054302080\" (UID: \"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.269658 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.269631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhvzf\" (UniqueName: \"kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf\") pod \"test-curl-7556-140493054302080\" (UID: \"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.277470 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.277449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhvzf\" (UniqueName: \"kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf\") pod \"test-curl-7556-140493054302080\" (UID: \"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8\") " pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.364822 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.364802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.517817 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.517792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:01.519088 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:38:01.519061    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3c713d5_24ed_4c33_af16_abd8ec8a7fb8.slice/crio-69540ce17c2e40878eaa656971ef53d66dc818b9514b7fe9f91780b8321d72db WatchSource:0}: Error finding container 69540ce17c2e40878eaa656971ef53d66dc818b9514b7fe9f91780b8321d72db: Status 404 returned error can't find the container with id 69540ce17c2e40878eaa656971ef53d66dc818b9514b7fe9f91780b8321d72db
Jul 18 02:38:01.737737 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.737629    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:01.737737 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.737652    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c78363f3041e9de82b7079270fe8343460896bb7dc882090e70b49210bceaf89"
Jul 18 02:38:01.739278 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.739250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054302080" event={"ID":"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8","Type":"ContainerStarted","Data":"69540ce17c2e40878eaa656971ef53d66dc818b9514b7fe9f91780b8321d72db"}
Jul 18 02:38:01.752451 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.752428    2563 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7556-140493054302080" oldPodUID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8"
Jul 18 02:38:01.893869 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:01.893830    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3127f02e-cd3d-4df7-82fe-51e3969e46ae" path="/var/lib/kubelet/pods/3127f02e-cd3d-4df7-82fe-51e3969e46ae/volumes"
Jul 18 02:38:02.746216 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:02.746183    2563 generic.go:356] "Generic (PLEG): container finished" podID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" containerID="91ced5cd16b96a10ef777aa8a103eb5ee352252cc4fca8eeb70f1abd7ab15182" exitCode=0
Jul 18 02:38:02.746404 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:02.746277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7556-140493054302080" event={"ID":"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8","Type":"ContainerDied","Data":"91ced5cd16b96a10ef777aa8a103eb5ee352252cc4fca8eeb70f1abd7ab15182"}
Jul 18 02:38:03.900193 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.900167    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:03.920863 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.920837    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7556-140493054302080_f3c713d5-24ed-4c33-af16-abd8ec8a7fb8/test-curl-7556-140493054302080/0.log"
Jul 18 02:38:03.945213 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.945183    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:03.948890 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.948869    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7556-140493054302080"]
Jul 18 02:38:03.994449 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.994426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhvzf\" (UniqueName: \"kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf\") pod \"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8\" (UID: \"f3c713d5-24ed-4c33-af16-abd8ec8a7fb8\") "
Jul 18 02:38:03.996443 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:03.996420    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf" (OuterVolumeSpecName: "kube-api-access-qhvzf") pod "f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" (UID: "f3c713d5-24ed-4c33-af16-abd8ec8a7fb8"). InnerVolumeSpecName "kube-api-access-qhvzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:38:04.095804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:04.095743    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhvzf\" (UniqueName: \"kubernetes.io/projected/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8-kube-api-access-qhvzf\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:04.761946 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:04.761916    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:04.761946 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:04.761928    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="69540ce17c2e40878eaa656971ef53d66dc818b9514b7fe9f91780b8321d72db"
Jul 18 02:38:04.772339 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:38:04.772309    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140493054302080\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:05.891562 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:38:05.891528    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7556-140493054302080\" is forbidden: User \"system:node:ip-10-0-133-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-234.ec2.internal' and this object" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" pod="opendatahub/test-curl-7556-140493054302080"
Jul 18 02:38:05.892449 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:05.892429    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" path="/var/lib/kubelet/pods/f3c713d5-24ed-4c33-af16-abd8ec8a7fb8/volumes"
Jul 18 02:38:14.567252 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:14.567200    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:38:14.567689 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:14.567433    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerName="maas-api" containerID="cri-o://029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707" gracePeriod=30
Jul 18 02:38:14.683155 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:14.683115    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.83:8443/health\": dial tcp 10.134.0.83:8443: connect: connection refused"
Jul 18 02:38:15.034645 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.034617    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:38:15.184606 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.184570    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca\") pod \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") "
Jul 18 02:38:15.184757 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.184636    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") pod \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") "
Jul 18 02:38:15.184757 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.184679    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bh2l\" (UniqueName: \"kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l\") pod \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\" (UID: \"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb\") "
Jul 18 02:38:15.184950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.184920    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" (UID: "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:38:15.186517 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.186485    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" (UID: "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:38:15.186619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.186598    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l" (OuterVolumeSpecName: "kube-api-access-7bh2l") pod "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" (UID: "5940ecd5-7f55-4b7f-9abc-7144e29c2ecb"). InnerVolumeSpecName "kube-api-access-7bh2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:38:15.286309 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.286273    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:15.286309 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.286306    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:15.286309 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.286317    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bh2l\" (UniqueName: \"kubernetes.io/projected/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb-kube-api-access-7bh2l\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:15.825014 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.824980    2563 generic.go:356] "Generic (PLEG): container finished" podID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerID="029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707" exitCode=0
Jul 18 02:38:15.825511 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.825033    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"
Jul 18 02:38:15.825511 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.825084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" event={"ID":"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb","Type":"ContainerDied","Data":"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"}
Jul 18 02:38:15.825511 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.825178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp" event={"ID":"5940ecd5-7f55-4b7f-9abc-7144e29c2ecb","Type":"ContainerDied","Data":"0d8cb0bd133b0bee0562ab007baf7df5cefddb42179d344deaee2de041efd04b"}
Jul 18 02:38:15.825511 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.825210    2563 scope.go:117] "RemoveContainer" containerID="029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"
Jul 18 02:38:15.834931 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.834916    2563 scope.go:117] "RemoveContainer" containerID="029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"
Jul 18 02:38:15.835233 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:38:15.835215    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707\": container with ID starting with 029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707 not found: ID does not exist" containerID="029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"
Jul 18 02:38:15.835291 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.835241    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707"} err="failed to get container status \"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707\": rpc error: code = NotFound desc = could not find container \"029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707\": container with ID starting with 029bbf51b87d95ccb84efe345f66109357a97f0562cd4ed3d870459ebd7fd707 not found: ID does not exist"
Jul 18 02:38:15.848464 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.848438    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:38:15.852924 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.852904    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-4b0cf7-7fff9cc6fd-knkhp"]
Jul 18 02:38:15.891346 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:15.891324    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" path="/var/lib/kubelet/pods/5940ecd5-7f55-4b7f-9abc-7144e29c2ecb/volumes"
Jul 18 02:38:26.575256 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575219    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"]
Jul 18 02:38:26.575756 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575739    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:26.575804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575758    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:26.575804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575777    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerName="maas-api"
Jul 18 02:38:26.575804 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575783    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerName="maas-api"
Jul 18 02:38:26.575902 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5940ecd5-7f55-4b7f-9abc-7144e29c2ecb" containerName="maas-api"
Jul 18 02:38:26.575902 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.575864    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c713d5-24ed-4c33-af16-abd8ec8a7fb8" containerName="test-curl-7556-140493054302080"
Jul 18 02:38:26.578818 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.578802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:26.579435 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.579412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc\" (UID: \"dde583d2-5906-49cf-9921-3cfaf4b4417d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:26.581654 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.581637    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wnbx7\""
Jul 18 02:38:26.587597 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.587175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"]
Jul 18 02:38:26.680302 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.680271    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc\" (UID: \"dde583d2-5906-49cf-9921-3cfaf4b4417d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:26.680861 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.680840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc\" (UID: \"dde583d2-5906-49cf-9921-3cfaf4b4417d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:26.893146 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:26.893122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:27.239128 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:27.239099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"]
Jul 18 02:38:27.240631 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:38:27.240602    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde583d2_5906_49cf_9921_3cfaf4b4417d.slice/crio-7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def WatchSource:0}: Error finding container 7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def: Status 404 returned error can't find the container with id 7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def
Jul 18 02:38:27.894498 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:27.894465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc" event={"ID":"dde583d2-5906-49cf-9921-3cfaf4b4417d","Type":"ContainerStarted","Data":"73e95cfa64c7163f891da4331c28d5f4a5790f31ff1aa4faa5681fb6ebcaf2e9"}
Jul 18 02:38:27.894855 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:27.894513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc" event={"ID":"dde583d2-5906-49cf-9921-3cfaf4b4417d","Type":"ContainerStarted","Data":"7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def"}
Jul 18 02:38:27.920364 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:27.920315    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc" podStartSLOduration=1.920299488 podStartE2EDuration="1.920299488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:38:27.918022812 +0000 UTC m=+2862.555276106" watchObservedRunningTime="2026-07-18 02:38:27.920299488 +0000 UTC m=+2862.557552767"
Jul 18 02:38:28.901685 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:28.901654    2563 generic.go:356] "Generic (PLEG): container finished" podID="dde583d2-5906-49cf-9921-3cfaf4b4417d" containerID="73e95cfa64c7163f891da4331c28d5f4a5790f31ff1aa4faa5681fb6ebcaf2e9" exitCode=0
Jul 18 02:38:28.902107 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:28.901742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc" event={"ID":"dde583d2-5906-49cf-9921-3cfaf4b4417d","Type":"ContainerDied","Data":"73e95cfa64c7163f891da4331c28d5f4a5790f31ff1aa4faa5681fb6ebcaf2e9"}
Jul 18 02:38:30.042984 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.042952    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:30.106325 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.106296    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca\") pod \"dde583d2-5906-49cf-9921-3cfaf4b4417d\" (UID: \"dde583d2-5906-49cf-9921-3cfaf4b4417d\") "
Jul 18 02:38:30.106602 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.106581    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dde583d2-5906-49cf-9921-3cfaf4b4417d" (UID: "dde583d2-5906-49cf-9921-3cfaf4b4417d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:38:30.207580 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.207503    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dde583d2-5906-49cf-9921-3cfaf4b4417d-maas-api-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:30.913881 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.913850    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"
Jul 18 02:38:30.914102 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.913892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc" event={"ID":"dde583d2-5906-49cf-9921-3cfaf4b4417d","Type":"ContainerDied","Data":"7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def"}
Jul 18 02:38:30.914102 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:30.913931    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c9baf6675aed5cad19cd051d5fa19fd1a5582df0001d53c2a6562e251ec4def"
Jul 18 02:38:37.086978 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.086946    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:38:37.087455 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.087177    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" podUID="8841866a-8b91-43b2-875b-bfd668a6e7ff" containerName="maas-api" containerID="cri-o://61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda" gracePeriod=30
Jul 18 02:38:37.544529 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.544507    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:38:37.567619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.567512    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzqtj\" (UniqueName: \"kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj\") pod \"8841866a-8b91-43b2-875b-bfd668a6e7ff\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") "
Jul 18 02:38:37.567619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.567569    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca\") pod \"8841866a-8b91-43b2-875b-bfd668a6e7ff\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") "
Jul 18 02:38:37.567619 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.567613    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") pod \"8841866a-8b91-43b2-875b-bfd668a6e7ff\" (UID: \"8841866a-8b91-43b2-875b-bfd668a6e7ff\") "
Jul 18 02:38:37.568117 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.568093    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8841866a-8b91-43b2-875b-bfd668a6e7ff" (UID: "8841866a-8b91-43b2-875b-bfd668a6e7ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 02:38:37.569679 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.569658    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8841866a-8b91-43b2-875b-bfd668a6e7ff" (UID: "8841866a-8b91-43b2-875b-bfd668a6e7ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 02:38:37.569987 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.569971    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj" (OuterVolumeSpecName: "kube-api-access-rzqtj") pod "8841866a-8b91-43b2-875b-bfd668a6e7ff" (UID: "8841866a-8b91-43b2-875b-bfd668a6e7ff"). InnerVolumeSpecName "kube-api-access-rzqtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 02:38:37.668995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.668940    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzqtj\" (UniqueName: \"kubernetes.io/projected/8841866a-8b91-43b2-875b-bfd668a6e7ff-kube-api-access-rzqtj\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:37.668995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.668961    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8841866a-8b91-43b2-875b-bfd668a6e7ff-openshift-service-ca\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:37.668995 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.668971    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8841866a-8b91-43b2-875b-bfd668a6e7ff-maas-api-tls\") on node \"ip-10-0-133-234.ec2.internal\" DevicePath \"\""
Jul 18 02:38:37.957413 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.957351    2563 generic.go:356] "Generic (PLEG): container finished" podID="8841866a-8b91-43b2-875b-bfd668a6e7ff" containerID="61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda" exitCode=0
Jul 18 02:38:37.957413 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.957398    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"
Jul 18 02:38:37.957560 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.957397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" event={"ID":"8841866a-8b91-43b2-875b-bfd668a6e7ff","Type":"ContainerDied","Data":"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"}
Jul 18 02:38:37.957560 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.957512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k" event={"ID":"8841866a-8b91-43b2-875b-bfd668a6e7ff","Type":"ContainerDied","Data":"cead97907f530cc55b7825415d0de7b3a18b5a69006c06af6728841041836b4b"}
Jul 18 02:38:37.957560 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.957539    2563 scope.go:117] "RemoveContainer" containerID="61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"
Jul 18 02:38:37.966726 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.966708    2563 scope.go:117] "RemoveContainer" containerID="61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"
Jul 18 02:38:37.966988 ip-10-0-133-234 kubenswrapper[2563]: E0718 02:38:37.966970    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda\": container with ID starting with 61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda not found: ID does not exist" containerID="61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"
Jul 18 02:38:37.967032 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.966997    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda"} err="failed to get container status \"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda\": rpc error: code = NotFound desc = could not find container \"61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda\": container with ID starting with 61579213366bae625af1091ea02fbed3cfddbc4edee953371d4e71b8d4734cda not found: ID does not exist"
Jul 18 02:38:37.976950 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.976931    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:38:37.983516 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:37.983488    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-124cd9-6db4f4db96-hh86k"]
Jul 18 02:38:39.891694 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:39.891660    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8841866a-8b91-43b2-875b-bfd668a6e7ff" path="/var/lib/kubelet/pods/8841866a-8b91-43b2-875b-bfd668a6e7ff/volumes"
Jul 18 02:38:41.652081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:41.652036    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"]
Jul 18 02:38:41.654205 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:41.654186    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-124cd9-gr2mc"]
Jul 18 02:38:41.894581 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:41.894542    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dde583d2-5906-49cf-9921-3cfaf4b4417d" path="/var/lib/kubelet/pods/dde583d2-5906-49cf-9921-3cfaf4b4417d/volumes"
Jul 18 02:38:49.180126 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:49.180092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58778cdb86-5ssxf_70c468e5-87b1-4820-a068-2c1984efeeab/authorino/0.log"
Jul 18 02:38:54.589792 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:54.589759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b486h_94a2caf1-3b88-4904-b9fc-19bc790dd746/manager/0.log"
Jul 18 02:38:54.708532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:54.708509    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vc4m6_f941d57d-c646-4982-b3f5-e7f0f9147522/manager/0.log"
Jul 18 02:38:54.830694 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:54.830667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ff5bb5c77-v9sd5_d8be7021-3e8f-42a9-bac9-beb126b7c717/manager/0.log"
Jul 18 02:38:55.063352 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:55.063323    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fj4tw_a4f1c3a3-42bb-4d82-a658-9795c57bbee9/manager/0.log"
Jul 18 02:38:55.449900 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:55.449869    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-l2df8_8914f158-4680-47b4-b946-d3d6c167b106/copy-manifests/0.log"
Jul 18 02:38:55.462984 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:55.462962    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-l2df8_8914f158-4680-47b4-b946-d3d6c167b106/manager/0.log"
Jul 18 02:38:55.825576 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:55.825510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-644d7f5bc4-ztpx5_83a62dcc-ab5b-43de-8797-f679df732582/maas-api/0.log"
Jul 18 02:38:55.941692 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:55.941668    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739015-z2r7f_d5da3b59-0341-4d46-83fc-71f5a8d019d3/cleanup/0.log"
Jul 18 02:38:56.058093 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:56.058073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29739030-drp8l_1cd6e692-9511-4158-9a07-924f61e63de3/cleanup/0.log"
Jul 18 02:38:56.168219 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:56.168200    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-s6c75_f15f705d-75e5-4418-ab32-2ed97faf9366/postgres/0.log"
Jul 18 02:38:56.973175 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:56.973145    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/util/0.log"
Jul 18 02:38:56.980554 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:56.980532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/pull/0.log"
Jul 18 02:38:56.989462 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:56.989443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/extract/0.log"
Jul 18 02:38:57.107331 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.107308    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/pull/0.log"
Jul 18 02:38:57.113641 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.113617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/extract/0.log"
Jul 18 02:38:57.119688 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.119673    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/util/0.log"
Jul 18 02:38:57.235992 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.235931    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/pull/0.log"
Jul 18 02:38:57.242405 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.242386    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/extract/0.log"
Jul 18 02:38:57.248699 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.248680    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/util/0.log"
Jul 18 02:38:57.368872 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.368850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/extract/0.log"
Jul 18 02:38:57.376217 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.376201    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/util/0.log"
Jul 18 02:38:57.383210 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.383194    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/pull/0.log"
Jul 18 02:38:57.506564 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.506510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58778cdb86-5ssxf_70c468e5-87b1-4820-a068-2c1984efeeab/authorino/0.log"
Jul 18 02:38:57.621986 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.621963    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vqztv_09e03a04-7255-48d5-9dd0-a07c1eacf0a6/manager/0.log"
Jul 18 02:38:57.743319 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.743295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-88s8x_50ec202f-ea81-4d30-91b8-e3b9958b3dd4/manager/0.log"
Jul 18 02:38:57.857466 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.857449    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hdrxl_cc780088-3bfe-4c42-bfda-3fea4f2d88cf/kuadrant-console-plugin/0.log"
Jul 18 02:38:57.976638 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:57.976615    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjqkq_86a67634-49ea-41d4-9c62-2d60270f35df/registry-server/0.log"
Jul 18 02:38:58.096962 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:58.096938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jxx8h_32e397f6-6ca5-42c6-aaaa-272b410e5245/manager/0.log"
Jul 18 02:38:58.335985 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:58.335922    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4ns62_f161905f-c059-4b55-a53b-775364663002/manager/0.log"
Jul 18 02:38:59.068532 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:59.068504    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cb7b95cb-shtwn_5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f/kube-auth-proxy/0.log"
Jul 18 02:38:59.309431 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:59.309405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6c462_4776bc82-fb7b-4ddd-ad65-e0333f37b1a6/payload-pre-processing/0.log"
Jul 18 02:38:59.428351 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:38:59.428330    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lghxx_1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a/payload-processing/0.log"
Jul 18 02:39:00.015422 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:00.015393    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5f274_b9e4613d-73f8-4aca-b440-575545b54bf9/main/0.log"
Jul 18 02:39:05.982154 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982079    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsnmv/must-gather-qh8gq"]
Jul 18 02:39:05.982490 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982438    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8841866a-8b91-43b2-875b-bfd668a6e7ff" containerName="maas-api"
Jul 18 02:39:05.982490 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982449    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8841866a-8b91-43b2-875b-bfd668a6e7ff" containerName="maas-api"
Jul 18 02:39:05.982490 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982472    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dde583d2-5906-49cf-9921-3cfaf4b4417d" containerName="revoke-keys"
Jul 18 02:39:05.982490 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982478    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dde583d2-5906-49cf-9921-3cfaf4b4417d" containerName="revoke-keys"
Jul 18 02:39:05.982626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982535    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dde583d2-5906-49cf-9921-3cfaf4b4417d" containerName="revoke-keys"
Jul 18 02:39:05.982626 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.982546    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8841866a-8b91-43b2-875b-bfd668a6e7ff" containerName="maas-api"
Jul 18 02:39:05.985921 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.985904    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:05.989011 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.988989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsnmv\"/\"default-dockercfg-wpgd5\""
Jul 18 02:39:05.989170 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.989093    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsnmv\"/\"kube-root-ca.crt\""
Jul 18 02:39:05.990336 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:05.990313    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsnmv\"/\"openshift-service-ca.crt\""
Jul 18 02:39:06.000100 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.000079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/must-gather-qh8gq"]
Jul 18 02:39:06.093193 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.093169    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-must-gather-output\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.093289 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.093222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-kube-api-access-wxlqs\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.194416 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.194392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-must-gather-output\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.194508 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.194478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-kube-api-access-wxlqs\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.194615 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.194598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-must-gather-output\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.202768 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.202744    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlqs\" (UniqueName: \"kubernetes.io/projected/9436bc79-3ebb-4d7f-accb-d3d7edb0c596-kube-api-access-wxlqs\") pod \"must-gather-qh8gq\" (UID: \"9436bc79-3ebb-4d7f-accb-d3d7edb0c596\") " pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.295071 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.294998    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/must-gather-qh8gq"
Jul 18 02:39:06.427136 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:06.427108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/must-gather-qh8gq"]
Jul 18 02:39:06.428373 ip-10-0-133-234 kubenswrapper[2563]: W0718 02:39:06.428339    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9436bc79_3ebb_4d7f_accb_d3d7edb0c596.slice/crio-4bdcac042282c1a88c157d6e6a0209a45335457a06d59aa9fa66075f54d1ccdc WatchSource:0}: Error finding container 4bdcac042282c1a88c157d6e6a0209a45335457a06d59aa9fa66075f54d1ccdc: Status 404 returned error can't find the container with id 4bdcac042282c1a88c157d6e6a0209a45335457a06d59aa9fa66075f54d1ccdc
Jul 18 02:39:07.125443 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:07.125409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/must-gather-qh8gq" event={"ID":"9436bc79-3ebb-4d7f-accb-d3d7edb0c596","Type":"ContainerStarted","Data":"4bdcac042282c1a88c157d6e6a0209a45335457a06d59aa9fa66075f54d1ccdc"}
Jul 18 02:39:08.134526 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:08.134491    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/must-gather-qh8gq" event={"ID":"9436bc79-3ebb-4d7f-accb-d3d7edb0c596","Type":"ContainerStarted","Data":"7dd670d0cb6f97b0756629525622b13c95348dda586ee5404280719a20809f0a"}
Jul 18 02:39:08.134526 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:08.134534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/must-gather-qh8gq" event={"ID":"9436bc79-3ebb-4d7f-accb-d3d7edb0c596","Type":"ContainerStarted","Data":"48a3855ab445e3d1776faa2c81e20a484e2e65e4658f0d1b36ae5c0e06eba206"}
Jul 18 02:39:08.153142 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:08.153090    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsnmv/must-gather-qh8gq" podStartSLOduration=2.250315669 podStartE2EDuration="3.153075486s" totalImagesPullingTime="902.759817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 02:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:39:08.150801641 +0000 UTC m=+2902.788054920" watchObservedRunningTime="2026-07-18 02:39:08.153075486 +0000 UTC m=+2902.790328766"
Jul 18 02:39:08.901937 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:08.901894    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gnklm_8d5c6f0a-7d6e-4c68-86c6-2868bde955fb/global-pull-secret-syncer/0.log"
Jul 18 02:39:09.027835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:09.027809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z7snt_495c6e74-84f3-425b-9be7-1de591e92ae9/konnectivity-agent/0.log"
Jul 18 02:39:09.117621 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:09.117586    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-234.ec2.internal_219a4b19c1c000048ec0124b8e3868d9/haproxy/0.log"
Jul 18 02:39:12.844968 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.844934    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/extract/0.log"
Jul 18 02:39:12.872399 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.872356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/util/0.log"
Jul 18 02:39:12.895081 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.895034    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q7kkj_672ba340-c882-4a4b-9351-74aa852164b5/pull/0.log"
Jul 18 02:39:12.927024 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.926982    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/extract/0.log"
Jul 18 02:39:12.949676 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.949653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/util/0.log"
Jul 18 02:39:12.975252 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:12.975203    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0x67fw_b5cf3313-c598-4e1a-a6e3-cede43d6efcf/pull/0.log"
Jul 18 02:39:13.005659 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.005628    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/extract/0.log"
Jul 18 02:39:13.029886 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.029856    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/util/0.log"
Jul 18 02:39:13.053188 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.053148    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xhfwl_ae15a262-58ba-4846-a6e5-5d04728131af/pull/0.log"
Jul 18 02:39:13.081854 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.081825    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/extract/0.log"
Jul 18 02:39:13.102890 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.102815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/util/0.log"
Jul 18 02:39:13.125004 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.124968    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1nkm7s_9985899c-708a-4b2b-b732-dcd46aa61448/pull/0.log"
Jul 18 02:39:13.682846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.682811    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-58778cdb86-5ssxf_70c468e5-87b1-4820-a068-2c1984efeeab/authorino/0.log"
Jul 18 02:39:13.711108 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.711035    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vqztv_09e03a04-7255-48d5-9dd0-a07c1eacf0a6/manager/0.log"
Jul 18 02:39:13.737145 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.737111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-88s8x_50ec202f-ea81-4d30-91b8-e3b9958b3dd4/manager/0.log"
Jul 18 02:39:13.770168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.770133    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hdrxl_cc780088-3bfe-4c42-bfda-3fea4f2d88cf/kuadrant-console-plugin/0.log"
Jul 18 02:39:13.819632 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:13.819442    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qjqkq_86a67634-49ea-41d4-9c62-2d60270f35df/registry-server/0.log"
Jul 18 02:39:14.010628 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:14.010510    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-jxx8h_32e397f6-6ca5-42c6-aaaa-272b410e5245/manager/0.log"
Jul 18 02:39:14.132065 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:14.131647    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4ns62_f161905f-c059-4b55-a53b-775364663002/manager/0.log"
Jul 18 02:39:15.931345 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:15.931311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-25fzl_fd8c0d14-075e-4a56-bc11-5f551e6c7c06/kube-state-metrics/0.log"
Jul 18 02:39:15.952644 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:15.952605    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-25fzl_fd8c0d14-075e-4a56-bc11-5f551e6c7c06/kube-rbac-proxy-main/0.log"
Jul 18 02:39:15.980382 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:15.980352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-25fzl_fd8c0d14-075e-4a56-bc11-5f551e6c7c06/kube-rbac-proxy-self/0.log"
Jul 18 02:39:16.146689 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.146663    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7nsd_fef92f11-d578-4d99-a1db-a41a42c16f2b/node-exporter/0.log"
Jul 18 02:39:16.168174 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.168147    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7nsd_fef92f11-d578-4d99-a1db-a41a42c16f2b/kube-rbac-proxy/0.log"
Jul 18 02:39:16.189038 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.188967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7nsd_fef92f11-d578-4d99-a1db-a41a42c16f2b/init-textfile/0.log"
Jul 18 02:39:16.834594 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.834507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/thanos-query/0.log"
Jul 18 02:39:16.864514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.864485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/kube-rbac-proxy-web/0.log"
Jul 18 02:39:16.888495 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.888466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/kube-rbac-proxy/0.log"
Jul 18 02:39:16.912835 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.911720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/prom-label-proxy/0.log"
Jul 18 02:39:16.939437 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.939409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/kube-rbac-proxy-rules/0.log"
Jul 18 02:39:16.961234 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:16.961170    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64fc86bd87-ks6qp_c0ef030a-5dc6-45b5-9c14-306c478f0344/kube-rbac-proxy-metrics/0.log"
Jul 18 02:39:18.873568 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:18.873532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/1.log"
Jul 18 02:39:18.878807 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:18.878780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-mvhth_9d474542-3bf9-4478-8517-90d2f74d1117/console-operator/2.log"
Jul 18 02:39:19.028664 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.028628    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"]
Jul 18 02:39:19.036394 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.036364    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.044413 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.044382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"]
Jul 18 02:39:19.144385 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.144275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-sys\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.144667 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.144629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-lib-modules\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.144915 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.144898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-proc\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.145079 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.145063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hx96\" (UniqueName: \"kubernetes.io/projected/9c983479-77d6-4276-997b-5b28f6ad693a-kube-api-access-8hx96\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.145285 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.145263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-podres\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.246823 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.246792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-sys\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247104 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-lib-modules\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-proc\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247226 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hx96\" (UniqueName: \"kubernetes.io/projected/9c983479-77d6-4276-997b-5b28f6ad693a-kube-api-access-8hx96\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247314 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-podres\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247393 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.246936    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-sys\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247527 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-proc\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247527 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247424    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-podres\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.247688 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.247536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c983479-77d6-4276-997b-5b28f6ad693a-lib-modules\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.259140 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.259102    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hx96\" (UniqueName: \"kubernetes.io/projected/9c983479-77d6-4276-997b-5b28f6ad693a-kube-api-access-8hx96\") pod \"perf-node-gather-daemonset-jxgkv\" (UID: \"9c983479-77d6-4276-997b-5b28f6ad693a\") " pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.354267 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.354231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:19.561838 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:19.561109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"]
Jul 18 02:39:20.247622 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:20.247520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv" event={"ID":"9c983479-77d6-4276-997b-5b28f6ad693a","Type":"ContainerStarted","Data":"37e447cf84b4bf963b4ff434fc7f8c71963b52798f32a89a9dae1083f91ac054"}
Jul 18 02:39:20.247622 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:20.247587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv" event={"ID":"9c983479-77d6-4276-997b-5b28f6ad693a","Type":"ContainerStarted","Data":"cf23414577e6b78e13984704c671ab382c4fa91f1eaccf113969fe0e2d1def69"}
Jul 18 02:39:20.248129 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:20.247717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:20.264712 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:20.264666    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv" podStartSLOduration=1.264652113 podStartE2EDuration="1.264652113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 02:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 02:39:20.263362523 +0000 UTC m=+2914.900615804" watchObservedRunningTime="2026-07-18 02:39:20.264652113 +0000 UTC m=+2914.901905393"
Jul 18 02:39:21.197026 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:21.196997    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq949_18c83878-29b0-415d-a0d7-2c8536025616/dns/0.log"
Jul 18 02:39:21.221386 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:21.221349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq949_18c83878-29b0-415d-a0d7-2c8536025616/kube-rbac-proxy/0.log"
Jul 18 02:39:21.273433 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:21.273406    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9z8jw_f28ea0dd-69b9-44f7-a9d4-6243b6dd08a6/dns-node-resolver/0.log"
Jul 18 02:39:21.861949 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:21.861917    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b5c58b8fc-hkhmn_9e302226-165e-4550-8199-a84715a4a876/registry/0.log"
Jul 18 02:39:21.944138 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:21.944101    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zj9bp_2283afa0-0e65-4b29-9d2c-3ac6a11c339e/node-ca/0.log"
Jul 18 02:39:23.015530 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:23.015503    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cb7b95cb-shtwn_5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f/kube-auth-proxy/0.log"
Jul 18 02:39:23.106168 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:23.106134    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6c462_4776bc82-fb7b-4ddd-ad65-e0333f37b1a6/payload-pre-processing/0.log"
Jul 18 02:39:23.137442 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:23.137414    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lghxx_1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a/payload-processing/0.log"
Jul 18 02:39:23.876944 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:23.876913    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gxfjn_974d3e72-d838-42fa-9d70-893f456d3c63/serve-healthcheck-canary/0.log"
Jul 18 02:39:24.336433 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:24.336365    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xsww4_01669ad6-45a7-4e6f-bade-bd8b5f3efd00/insights-operator/0.log"
Jul 18 02:39:24.336901 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:24.336732    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-xsww4_01669ad6-45a7-4e6f-bade-bd8b5f3efd00/insights-operator/1.log"
Jul 18 02:39:24.427163 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:24.427127    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2nv7b_1367c12d-0a32-4e1d-bd1b-993728c23272/kube-rbac-proxy/0.log"
Jul 18 02:39:24.447922 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:24.447893    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2nv7b_1367c12d-0a32-4e1d-bd1b-993728c23272/exporter/0.log"
Jul 18 02:39:24.469060 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:24.469023    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2nv7b_1367c12d-0a32-4e1d-bd1b-993728c23272/extractor/0.log"
Jul 18 02:39:26.267029 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:26.266991    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsnmv/perf-node-gather-daemonset-jxgkv"
Jul 18 02:39:26.624446 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:26.624413    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b486h_94a2caf1-3b88-4904-b9fc-19bc790dd746/manager/0.log"
Jul 18 02:39:26.848514 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:26.848485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vc4m6_f941d57d-c646-4982-b3f5-e7f0f9147522/manager/0.log"
Jul 18 02:39:27.010647 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:27.010546    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ff5bb5c77-v9sd5_d8be7021-3e8f-42a9-bac9-beb126b7c717/manager/0.log"
Jul 18 02:39:27.128174 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:27.127985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-fj4tw_a4f1c3a3-42bb-4d82-a658-9795c57bbee9/manager/0.log"
Jul 18 02:39:27.327941 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:27.327851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-l2df8_8914f158-4680-47b4-b946-d3d6c167b106/manager/0.log"
Jul 18 02:39:27.344671 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:27.344641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75cddc5ddd-l2df8_8914f158-4680-47b4-b946-d3d6c167b106/copy-manifests/0.log"
Jul 18 02:39:29.537767 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:29.537657    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cb7b95cb-shtwn_5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f/kube-auth-proxy/0.log"
Jul 18 02:39:29.609871 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:29.609845    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6c462_4776bc82-fb7b-4ddd-ad65-e0333f37b1a6/payload-pre-processing/0.log"
Jul 18 02:39:29.630856 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:29.630828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lghxx_1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a/payload-processing/0.log"
Jul 18 02:39:30.977852 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:30.977745    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65cb7b95cb-shtwn_5c05c6f9-42f6-4e1d-af1a-aa86a9d7de9f/kube-auth-proxy/0.log"
Jul 18 02:39:31.051097 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:31.051073    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-6c462_4776bc82-fb7b-4ddd-ad65-e0333f37b1a6/payload-pre-processing/0.log"
Jul 18 02:39:31.074102 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:31.074074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-lghxx_1cbd9161-7b52-4f70-9a7e-7fd0aa4e425a/payload-processing/0.log"
Jul 18 02:39:34.002725 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:34.002700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wpzct_f8ab6325-bc54-4c7c-97b5-f797d0a9edfa/migrator/0.log"
Jul 18 02:39:34.022391 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:34.022368    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wpzct_f8ab6325-bc54-4c7c-97b5-f797d0a9edfa/graceful-termination/0.log"
Jul 18 02:39:35.499553 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.499526    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/kube-multus-additional-cni-plugins/0.log"
Jul 18 02:39:35.519834 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.519812    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/egress-router-binary-copy/0.log"
Jul 18 02:39:35.540742 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.540716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/cni-plugins/0.log"
Jul 18 02:39:35.560575 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.560553    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/bond-cni-plugin/0.log"
Jul 18 02:39:35.580764 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.580743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/routeoverride-cni/0.log"
Jul 18 02:39:35.601551 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.601512    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/whereabouts-cni-bincopy/0.log"
Jul 18 02:39:35.621846 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.621817    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sqx9l_80441402-2b11-47d8-9c78-d8870340abc6/whereabouts-cni/0.log"
Jul 18 02:39:35.819424 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.819391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jqh26_ef5d566a-41e7-4452-9d6a-0fcafe659b55/kube-multus/0.log"
Jul 18 02:39:35.988056 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:35.988027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w74kq_0a8884b5-cceb-42fb-93e3-8746a84034f9/network-metrics-daemon/0.log"
Jul 18 02:39:36.005321 ip-10-0-133-234 kubenswrapper[2563]: I0718 02:39:36.005293    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w74kq_0a8884b5-cceb-42fb-93e3-8746a84034f9/kube-rbac-proxy/0.log"