Jul 15 13:09:12.036966 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 13:09:12.036977 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 13:09:12.036985 ip-10-0-136-182 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 13:09:12.037275 ip-10-0-136-182 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 13:09:22.085752 ip-10-0-136-182 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 13:09:22.085771 ip-10-0-136-182 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1502807c54e74f8fb10260898cdfa587 --
Jul 15 13:11:29.952727 ip-10-0-136-182 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 13:11:30.398006 ip-10-0-136-182 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:30.398006 ip-10-0-136-182 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 13:11:30.398006 ip-10-0-136-182 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:30.398006 ip-10-0-136-182 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 13:11:30.398006 ip-10-0-136-182 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 13:11:30.398852 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.398021    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 13:11:30.404546 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404521    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.404546 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404541    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.404546 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404546    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.404546 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404551    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404556    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404561    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404566    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404570    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404575    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404578    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404583    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404587    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404591    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404595    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404600    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404604    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404610    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404625    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404632    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404638    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404644    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404649    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.404862 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404654    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404659    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404663    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404668    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404673    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404680    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404686    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404690    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404695    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404700    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404705    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404710    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404715    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404719    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404725    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404731    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404737    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404743    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404748    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.405687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404752    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404757    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404761    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404766    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404771    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404776    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404780    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404785    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404792    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404797    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404803    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404808    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404812    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404817    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404822    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404826    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404831    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404836    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404841    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404845    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.406527 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404850    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404855    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404859    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404864    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404868    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404873    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404877    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404882    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404887    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404892    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404897    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404905    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404911    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404916    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404920    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404925    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404930    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404935    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404940    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404945    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.407432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404950    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404957    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404962    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404966    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404971    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404976    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404981    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404985    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404990    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404994    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.404999    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405003    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405008    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405013    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405018    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405022    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405027    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.405033    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406324    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.408311 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406335    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406341    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406346    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406372    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406377    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406384    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406388    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406393    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406397    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406402    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406406    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406411    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406415    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406420    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406425    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406431    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406436    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406441    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406445    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.409175 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406450    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406455    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406460    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406465    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406469    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406475    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406479    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406484    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406489    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406494    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406498    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406506    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406512    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406517    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406523    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406528    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406533    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406537    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406543    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406547    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.410051 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406551    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406556    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406561    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406566    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406572    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406576    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406581    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406585    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406590    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406597    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406601    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406606    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406611    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406615    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406620    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406624    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406629    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406633    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406638    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406642    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.410664 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406647    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406651    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406656    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406661    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406669    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406675    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406681    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406686    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406691    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406696    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406700    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406705    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406710    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406714    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406719    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406724    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406728    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406732    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406737    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.411213 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406742    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406746    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406751    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406757    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406762    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406767    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406772    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406778    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406783    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406789    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406796    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406801    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406806    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406810    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406815    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406819    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406824    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406828    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406833    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.406838    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.411968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407562    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407572    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407577    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407582    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407586    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407591    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407596    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407601    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407605    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407611    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407616    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407621    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407625    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407629    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407634    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407640    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407646    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407650    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407655    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407659    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.412549 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407663    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407668    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407672    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407678    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407683    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407687    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407692    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407696    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407701    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407705    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407710    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407716    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407721    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407737    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407742    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407746    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407751    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407755    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407760    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407764    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.413071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407769    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407774    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407782    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407788    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407795    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407800    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407805    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407811    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407819    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407824    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407829    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407833    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407838    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407842    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407847    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407851    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407856    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407860    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407865    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.413687 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407870    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407875    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407879    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407884    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407888    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407892    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407897    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407902    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407907    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407914    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407920    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407925    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407930    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407936    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407941    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407950    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407959    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407963    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407969    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407973    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.414181 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407978    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407982    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407988    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407993    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.407999    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408005    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408009    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408014    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408018    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408022    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408027    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408031    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408036    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408043    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408048    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408052    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408057    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408061    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408066    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.408070    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.414728 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408187    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408205    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408216    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408223    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408230    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408236    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408244    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408251    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408259    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408264    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408270    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408276    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408282    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408287    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408292    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408298    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408303    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408308    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408315    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408320    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408326    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408331    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408337    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408344    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 13:11:30.415244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408370    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408380    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408386    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408392    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408397    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408402    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408407    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408413    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408421    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408426    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408431    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408436    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408442    2571 flags.go:64] FLAG: --enable-server="true"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408447    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408456    2571 flags.go:64] FLAG: --event-burst="100"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408461    2571 flags.go:64] FLAG: --event-qps="50"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408469    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408474    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408480    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408486    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408491    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408497    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408502    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408507    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408522    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 13:11:30.415944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408527    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408532    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408537    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408543    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408548    2571 flags.go:64] FLAG: --feature-gates=""
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408555    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408561    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408567    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408574    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408579    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408584    2571 flags.go:64] FLAG: --help="false"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408589    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408595    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408601    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408606    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408612    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408618    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408623    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408628    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408633    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408639    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408644    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408649    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408656    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 15 13:11:30.416620 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408662    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408666    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408672    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408676    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408682    2571 flags.go:64] FLAG: --lock-file=""
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408687    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408692    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408697    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408715    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408721    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408726    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408731    2571 flags.go:64] FLAG: --logging-format="text"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408736    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408742    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408747    2571 flags.go:64] FLAG: --manifest-url=""
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408751    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408761    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408766    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408773    2571 flags.go:64] FLAG: --max-pods="110"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408778    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408783    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408788    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408794    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408799    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408804    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 13:11:30.417323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408811    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408827    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408832    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408837    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408843    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408848    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408858    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408865    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408870    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408875    2571 flags.go:64] FLAG: --port="10250"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408880    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408886    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-027bfee21e1a516d5"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408891    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408897    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408902    2571 flags.go:64] FLAG: --register-node="true"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408907    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408921    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408927    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408932    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408937    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408944    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408949    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408954    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408961    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408966    2571 flags.go:64] FLAG: --runonce="false"
Jul 15 13:11:30.417992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408972    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408977    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408983    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408988    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408993    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.408998    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409004    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409009    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409014    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409019    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409024    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409029    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409035    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409040    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409046    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409056    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409061    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409066    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409072    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409078    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409083    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409088    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409093    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409098    2571 flags.go:64] FLAG: --v="2"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409116    2571 flags.go:64] FLAG: --version="false"
Jul 15 13:11:30.418763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409124    2571 flags.go:64] FLAG: --vmodule=""
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409131    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.409137    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409386    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409395    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409402    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409407    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409412    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409417    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409422    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409427    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409431    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409436    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409441    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409445    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409449    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409454    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409459    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409463    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.419475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409468    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409475    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409483    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409489    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409493    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409498    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409503    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409507    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409512    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409517    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409521    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409525    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409530    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409535    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409540    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409545    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409550    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409554    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409561    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409566    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.420325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409570    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409575    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409579    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409583    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409591    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409597    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409603    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409608    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409613    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409618    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409623    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409627    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409632    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409636    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409643    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409648    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409653    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409657    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409662    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409667    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.421109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409671    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409676    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409681    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409686    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409690    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409695    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409700    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409705    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409710    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409714    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409720    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409724    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409729    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409733    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409737    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409742    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409747    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409751    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409757    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.421650 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409763    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409768    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409776    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409782    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409788    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409793    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409798    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409805    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409810    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409815    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409820    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409825    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409830    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409835    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409840    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409845    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409849    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409854    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409858    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409863    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.422152 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409873    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409877    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409882    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.409889    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.410509    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.418544    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.418563    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.419407    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.419420    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419767    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419788    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419797    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419806    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419816    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419824    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.422699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419833    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419841    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419849    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419857    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419871    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419879    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419886    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419894    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419903    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419911    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419919    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419928    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419936    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419943    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419952    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419959    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419968    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419983    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.419991    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420000    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.423100 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420008    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420016    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420027    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420039    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420048    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420057    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420064    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420073    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420080    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420094    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420115    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420122    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420131    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420138    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420146    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420153    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420161    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420168    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420177    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.423692 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420186    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420193    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420201    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420212    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420216    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420222    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420227    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420232    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420237    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420241    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420246    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420252    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420257    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420262    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420267    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420276    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420281    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420286    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420291    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420295    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.424178 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420300    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420305    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420311    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420315    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420320    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420325    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420329    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420339    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420344    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420363    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420368    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420373    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420377    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420382    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420390    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420396    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420401    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420406    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420411    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.424719 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420416    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420426    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420431    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420436    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420442    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420447    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420452    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420456    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420461    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420466    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420470    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420475    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420480    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420490    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.425218 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420498    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.420508    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420903    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420913    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420919    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420924    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420935    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420939    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420944    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.420977    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421004    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421008    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421012    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421016    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 13:11:30.425616 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421019    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421022    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421026    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421029    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421041    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421142    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421146    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421150    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421153    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421157    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421159    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421163    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421166    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421169    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421172    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421178    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421183    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421187    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421190    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421193    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 13:11:30.425990 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421202    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421205    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421208    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421211    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421214    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421217    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421220    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421223    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421226    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421229    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421232    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421235    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421238    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421241    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421245    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421248    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421251    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421254    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421257    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 13:11:30.426528 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421260    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421264    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421266    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421270    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421275    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421279    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421283    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421286    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421290    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421293    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421296    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421299    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421303    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421309    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421312    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421315    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421319    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421323    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421326    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421330    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 13:11:30.427019 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421333    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421337    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421341    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421344    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421347    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421350    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421368    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421373    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421376    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421380    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421383    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421386    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421389    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421392    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421395    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421398    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421401    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421404    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421407    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421411    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 13:11:30.427568 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421414    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421417    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421419    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421422    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421425    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421428    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421431    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:30.421434    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.421441    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.421603    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.425608    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.427345    2571 server.go:1019] "Starting client certificate rotation"
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.427469    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:11:30.428075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.427514    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 13:11:30.431963 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.431944    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:11:30.433383 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.433356    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 13:11:30.447333 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.447308    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 15 13:11:30.449819 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.449802    2571 log.go:25] "Validated CRI v1 image API"
Jul 15 13:11:30.450684 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.450666    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 13:11:30.455306 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.455276    2571 fs.go:135] Filesystem UUIDs: map[1379913f-6e5c-4496-94cb-6bb1a828e5f4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ec25c858-687d-4959-aa61-5f58ae310fb8:/dev/nvme0n1p4]
Jul 15 13:11:30.455411 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.455304    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 13:11:30.461232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.461209    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:11:30.461599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.461472    2571 manager.go:216] Machine: {Timestamp:2026-07-15 13:11:30.459739558 +0000 UTC m=+0.376547000 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099487 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2254b4e5d8fd81b4f7a0d75ab3f46d SystemUUID:ec2254b4-e5d8-fd81-b4f7-a0d75ab3f46d BootID:1502807c-54e7-4f8f-b102-60898cdfa587 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:09:77:97:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:09:77:97:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:01:cc:29:c5:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 13:11:30.461599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.461592    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 13:11:30.461713 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.461693    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 13:11:30.465065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.465035    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 13:11:30.465223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.465068    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 13:11:30.465860 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.465849    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 13:11:30.465902 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.465862    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 13:11:30.465902 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.465874    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:11:30.466661 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.466647    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 13:11:30.468439 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.468425    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 13:11:30.471788 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.471771    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:11:30.472156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472144    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 13:11:30.472193 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472179    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 13:11:30.472232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472197    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 13:11:30.472232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472214    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 13:11:30.472232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472224    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 15 13:11:30.472328 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.472234    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 13:11:30.475269 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.475239    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:11:30.475377 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.475295    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 13:11:30.480388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.480345    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 13:11:30.483958 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.483942    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 13:11:30.484036 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.483975    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 13:11:30.484174 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484159    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 13:11:30.484207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484183    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 13:11:30.484207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484191    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 13:11:30.484207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484196    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 13:11:30.484207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484206    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 13:11:30.484314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484213    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 13:11:30.484771 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484761    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 13:11:30.484807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484772    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 13:11:30.484807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484781    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 13:11:30.484807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484788    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 13:11:30.484807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484797    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 13:11:30.484807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.484806    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 13:11:30.485442 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.485393    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 13:11:30.485442 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.485422    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 13:11:30.485644 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.485632    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 13:11:30.485692 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.485645    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 13:11:30.488487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.488466    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 13:11:30.489392 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.489377    2571 server.go:1268] "Started kubelet"
Jul 15 13:11:30.489515 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.489462    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 13:11:30.490029 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.489970    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 13:11:30.490107 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.490050    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 13:11:30.490602 ip-10-0-136-182 systemd[1]: Started Kubernetes Kubelet.
Jul 15 13:11:30.491202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.490666    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 13:11:30.491364 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.491268    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 13:11:30.496026 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.496001    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 13:11:30.498912 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.497748    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addae60cc2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.48932269 +0000 UTC m=+0.406130133,LastTimestamp:2026-07-15 13:11:30.48932269 +0000 UTC m=+0.406130133,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.500099 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.500081    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 13:11:30.500536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.500512    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 13:11:30.500684 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.500664    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:30.501259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501237    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 13:11:30.501259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501237    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 13:11:30.501436 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501274    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 13:11:30.501521 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501507    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 13:11:30.501580 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501523    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 13:11:30.501646 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501631    2571 factory.go:55] Registering systemd factory
Jul 15 13:11:30.501690 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501650    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 15 13:11:30.501887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501873    2571 factory.go:153] Registering CRI-O factory
Jul 15 13:11:30.501943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501890    2571 factory.go:223] Registration of the crio container factory successfully
Jul 15 13:11:30.501977 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501942    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 13:11:30.501977 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501966    2571 factory.go:103] Registering Raw factory
Jul 15 13:11:30.502048 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.501979    2571 manager.go:1196] Started watching for new ooms in manager
Jul 15 13:11:30.502484 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.502471    2571 manager.go:349] Starting recovery of all containers
Jul 15 13:11:30.503634 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.503609    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 13:11:30.503758 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.503735    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 13:11:30.514844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.514633    2571 manager.go:354] Recovery completed
Jul 15 13:11:30.520075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.520060    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.522319 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.522295    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.522410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.522335    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.522410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.522347    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.523013 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.522992    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 13:11:30.523100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523015    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 13:11:30.523100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523040    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 13:11:30.523100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523001    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.523808 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523788    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.523885 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523821    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.523885 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.523832    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.524892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.524878    2571 policy_none.go:49] "None policy: Start"
Jul 15 13:11:30.524948 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.524899    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 13:11:30.524948 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.524911    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 13:11:30.526204 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.526194    2571 policy_none.go:47] "Start"
Jul 15 13:11:30.533816 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.533745    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcdd8887  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522318983 +0000 UTC m=+0.439126426,LastTimestamp:2026-07-15 13:11:30.522318983 +0000 UTC m=+0.439126426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.536757 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.536684    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcdddda0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522340768 +0000 UTC m=+0.439148210,LastTimestamp:2026-07-15 13:11:30.522340768 +0000 UTC m=+0.439148210,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.544702 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.544630    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcde36d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522363604 +0000 UTC m=+0.439171046,LastTimestamp:2026-07-15 13:11:30.522363604 +0000 UTC m=+0.439171046,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.549369 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.549298    2571 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-182.ec2.internal.18c278addcdd8887\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcdd8887  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522318983 +0000 UTC m=+0.439126426,LastTimestamp:2026-07-15 13:11:30.523806753 +0000 UTC m=+0.440614196,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.556438 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.556349    2571 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-182.ec2.internal.18c278addcdddda0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcdddda0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522340768 +0000 UTC m=+0.439148210,LastTimestamp:2026-07-15 13:11:30.523826895 +0000 UTC m=+0.440634336,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.563083 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563064    2571 manager.go:337] "Starting Device Plugin manager"
Jul 15 13:11:30.563172 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.563122    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 13:11:30.563172 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563134    2571 server.go:87] "Starting device plugin registration server"
Jul 15 13:11:30.563473 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563456    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 13:11:30.563576 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563471    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 13:11:30.563633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563573    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 13:11:30.563684 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563662    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 13:11:30.563684 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.563672    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 13:11:30.564283 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.564255    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 13:11:30.564378 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.564343    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:30.568005 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.567935    2571 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-182.ec2.internal.18c278addcde36d4\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addcde36d4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-182.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.522363604 +0000 UTC m=+0.439171046,LastTimestamp:2026-07-15 13:11:30.523836486 +0000 UTC m=+0.440643927,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.578218 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.578135    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-182.ec2.internal.18c278addf6f13b1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-182.ec2.internal,UID:ip-10-0-136-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-182.ec2.internal,},FirstTimestamp:2026-07-15 13:11:30.565411761 +0000 UTC m=+0.482219193,LastTimestamp:2026-07-15 13:11:30.565411761 +0000 UTC m=+0.482219193,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-182.ec2.internal,}"
Jul 15 13:11:30.592918 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.592890    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-975sr"
Jul 15 13:11:30.604223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.604199    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-975sr"
Jul 15 13:11:30.664481 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.664407    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.665688 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.665670    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.665754 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.665709    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.665754 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.665724    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.665754 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.665751    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.683582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.683553    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.683683 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.683583    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-182.ec2.internal\": node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:30.704298 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.704251    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:30.708688 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.708662    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 13:11:30.710070 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.710041    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 13:11:30.710166 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.710094    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 13:11:30.710166 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.710121    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 13:11:30.710166 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.710159    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 13:11:30.712676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.712655    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:30.805058 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.805014    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:30.811331 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.811273    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"]
Jul 15 13:11:30.811401 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.811394    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.813557 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.813538    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.813648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.813574    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.813648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.813585    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.816083 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816068    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.816198 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816182    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.816268 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816258    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.816901 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816884    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.816966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816902    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.816966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816914    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.816966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816925    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.816966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816927    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.816966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.816938    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.818705 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.818688    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.818831 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.818715    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:30.819506 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.819490    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:30.819589 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.819512    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:30.819589 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.819522    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:30.846460 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.846426    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-182.ec2.internal\" not found" node="ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.851157 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.851138    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-182.ec2.internal\" not found" node="ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.902896 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.902833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.902896 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.902896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.903076 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:30.902920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30cc42da2b8d91e22106a50ef6e004ce-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"30cc42da2b8d91e22106a50ef6e004ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:30.905346 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:30.905327    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.003560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.003560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30cc42da2b8d91e22106a50ef6e004ce-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"30cc42da2b8d91e22106a50ef6e004ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.003560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.003560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003458    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.003868 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf4d14de3156ff0d50ee01acbbf3af52-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal\" (UID: \"cf4d14de3156ff0d50ee01acbbf3af52\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.003868 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.003599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30cc42da2b8d91e22106a50ef6e004ce-config\") pod \"kube-apiserver-proxy-ip-10-0-136-182.ec2.internal\" (UID: \"30cc42da2b8d91e22106a50ef6e004ce\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.005730 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.005706    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.106522 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.106478    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.152208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.152157    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.155584 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.155557    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:31.207452 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.207423    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.307622 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.307535    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.407687 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.407645    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.427258 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.427226    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 13:11:31.427437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.427417    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 13:11:31.508005 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.507965    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.546084 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.546046    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 13:11:31.547083 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.547062    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 13:11:31.547185 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.547096    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 13:11:31.547185 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.547107    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeHasSufficientPID"
Jul 15 13:11:31.608264 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.608167    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.609374 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.609333    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 13:06:30 +0000 UTC" deadline="2027-12-21 10:16:12.880312279 +0000 UTC"
Jul 15 13:11:31.609374 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.609366    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12573h4m41.270949814s"
Jul 15 13:11:31.655799 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.655776    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:31.709258 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.709208    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.780799 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.780753    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:31.810257 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.810219    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.825083 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:31.825025    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4d14de3156ff0d50ee01acbbf3af52.slice/crio-42d754f848af2cc784eb7099346e02a37d0660a2cafd8cfdbdbc9f418bbfedb1 WatchSource:0}: Error finding container 42d754f848af2cc784eb7099346e02a37d0660a2cafd8cfdbdbc9f418bbfedb1: Status 404 returned error can't find the container with id 42d754f848af2cc784eb7099346e02a37d0660a2cafd8cfdbdbc9f418bbfedb1
Jul 15 13:11:31.825341 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:31.825321    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30cc42da2b8d91e22106a50ef6e004ce.slice/crio-d1de88e00c8162e77331b926c300e8a595f640e6af55415be0d2d2ff64b1ed44 WatchSource:0}: Error finding container d1de88e00c8162e77331b926c300e8a595f640e6af55415be0d2d2ff64b1ed44: Status 404 returned error can't find the container with id d1de88e00c8162e77331b926c300e8a595f640e6af55415be0d2d2ff64b1ed44
Jul 15 13:11:31.829393 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.829374    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:11:31.911033 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:31.910936    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-182.ec2.internal\" not found"
Jul 15 13:11:31.989308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:31.989271    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:32.001570 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.001536    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:32.022845 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.022806    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:11:32.023729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.023710    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal"
Jul 15 13:11:32.039291 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.039250    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 13:11:32.475230 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.475181    2571 apiserver.go:52] "Watching apiserver"
Jul 15 13:11:32.485100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.485070    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 13:11:32.485846 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.485656    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8z6nt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl","openshift-dns/node-resolver-2rvnq","openshift-network-diagnostics/network-check-target-ntrtl","openshift-network-operator/iptables-alerter-78zrc","openshift-ovn-kubernetes/ovnkube-node-f8p8w","kube-system/konnectivity-agent-zmc85","kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mx697","openshift-image-registry/node-ca-sfm4n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal","openshift-multus/multus-2l8vf","openshift-multus/multus-additional-cni-plugins-bw425","openshift-multus/network-metrics-daemon-rbxkm"]
Jul 15 13:11:32.487847 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.487823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.489265 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.489147    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.491050 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.490709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.492326 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.491904    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:32.492326 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.491987    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:32.492326 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.492170    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tblgr\""
Jul 15 13:11:32.493183 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.493162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.494641 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.494621    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 13:11:32.494779 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.494755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.495285 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.495255    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 13:11:32.495943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.495911    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 13:11:32.496121 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496101    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.496209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496122    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 13:11:32.496209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496170    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 13:11:32.497054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496520    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.497054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496676    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.497054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496755    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.497054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496769    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kc98x\""
Jul 15 13:11:32.497054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.496882    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.498083 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.497809    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.498083 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.497847    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.498083 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.497918    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:32.498300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.498087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.498300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.498195    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.498300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.498298    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5b5lh\""
Jul 15 13:11:32.498531 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.498460    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdmbq\""
Jul 15 13:11:32.499275 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.499254    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 13:11:32.499275 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.499279    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q6mcc\""
Jul 15 13:11:32.499546 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.499526    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 13:11:32.509715 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.507574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.509916 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.508544    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.510017 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.509986    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:32.510157 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.508619    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 13:11:32.510351 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.510329    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.510437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.510375    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.510570 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.508723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 13:11:32.510822 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.510804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mpqds\""
Jul 15 13:11:32.510876 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.508805    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 13:11:32.510957 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.508866    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.511026 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.509140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.511221 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.509654    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 13:11:32.512679 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.512489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514494    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-hostroot\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-socket-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-registration-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-cnibin\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-systemd\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-etc-tuned\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-systemd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovn-node-metrics-cert\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-script-lib\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514789    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0981239-8d27-4987-852c-6987662e382f-serviceca\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cnibin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8660d488-98d3-4993-a39b-56b9743da74c-konnectivity-ca\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-host\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-sys-fs\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.516844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjjmh\" (UniqueName: \"kubernetes.io/projected/bdade2c0-147d-4bd9-b95e-d1694be1fd27-kube-api-access-cjjmh\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-system-cni-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514968    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.514991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-node-log\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-netd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wftfx\" (UniqueName: \"kubernetes.io/projected/5806175a-7db8-4cdb-84bf-a69611eeccf9-kube-api-access-wftfx\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-modprobe-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515120    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-host-slash\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbf7\" (UniqueName: \"kubernetes.io/projected/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-kube-api-access-mhbf7\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515198    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-multus\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-daemon-config\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-run\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515431    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.517787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-kubelet\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515484    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-kubernetes\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-conf\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515569    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-netns\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515627    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-var-lib-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-conf-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515692    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-etc-kubernetes\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l2m6\" (UniqueName: \"kubernetes.io/projected/2f76e682-004f-4c4f-a848-118433b612ff-kube-api-access-2l2m6\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-systemd-units\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515784    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-tmp\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-device-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515838    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-env-overrides\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.518744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515922    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbvbm\" (UniqueName: \"kubernetes.io/projected/e251d89e-806c-4d09-92e3-2d26535cab62-kube-api-access-bbvbm\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-hosts-file\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515954    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.515974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-slash\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-etc-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516054    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-ovn\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-log-socket\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516109    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-bin\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-netns\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516163    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-multus-certs\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516193    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-iptables-alerter-script\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-os-release\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8660d488-98d3-4993-a39b-56b9743da74c-agent-certs\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-lib-modules\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516397    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516563    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tb46p\""
Jul 15 13:11:32.519608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86sv\" (UniqueName: \"kubernetes.io/projected/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-kube-api-access-t86sv\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-kubelet-config\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516717    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516802    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cni-binary-copy\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np2zs\" (UniqueName: \"kubernetes.io/projected/ecb4110c-d62a-4594-93d0-401aad638d56-kube-api-access-np2zs\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516888    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-config\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x4m\" (UniqueName: \"kubernetes.io/projected/f0981239-8d27-4987-852c-6987662e382f-kube-api-access-j4x4m\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-var-lib-kubelet\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.516989    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-os-release\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-tmp-dir\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517077    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-dbus\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517103    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-bin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwmgm\" (UniqueName: \"kubernetes.io/projected/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-kube-api-access-fwmgm\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysconfig\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-sys\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:32.520664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517271    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-kubelet\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517288    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517310    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0981239-8d27-4987-852c-6987662e382f-host\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-system-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517369    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517309    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tnrlc\""
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517347    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-socket-dir-parent\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.517479    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q66df\""
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.518002    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 13:11:32.521648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.518029    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.531868 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.531770    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 13:11:32.558531 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.558499    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tgl4"
Jul 15 13:11:32.567704 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.567676    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tgl4"
Jul 15 13:11:32.603304 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.603268    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 13:11:32.617685 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-tmp\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617693    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-device-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-env-overrides\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbvbm\" (UniqueName: \"kubernetes.io/projected/e251d89e-806c-4d09-92e3-2d26535cab62-kube-api-access-bbvbm\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-hosts-file\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617837    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-slash\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617859    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-etc-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-device-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.617889 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-ovn\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617905    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-log-socket\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.617928    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-hosts-file\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-bin\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618006    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-slash\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.618016    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:33.117991753 +0000 UTC m=+3.034799195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.617929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-bin\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-ovn\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-etc-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618102    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-log-socket\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618288    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618327    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-netns\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618379    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-multus-certs\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.618443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-iptables-alerter-script\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-netns\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-env-overrides\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-multus-certs\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-os-release\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618747    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-os-release\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8660d488-98d3-4993-a39b-56b9743da74c-agent-certs\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-lib-modules\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86sv\" (UniqueName: \"kubernetes.io/projected/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-kube-api-access-t86sv\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618883    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-kubelet-config\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cni-binary-copy\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.618995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np2zs\" (UniqueName: \"kubernetes.io/projected/ecb4110c-d62a-4594-93d0-401aad638d56-kube-api-access-np2zs\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-config\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x4m\" (UniqueName: \"kubernetes.io/projected/f0981239-8d27-4987-852c-6987662e382f-kube-api-access-j4x4m\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-kubelet-config\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.619308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-var-lib-kubelet\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619183    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-os-release\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-tmp-dir\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619243    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-dbus\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.619256    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-bin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwmgm\" (UniqueName: \"kubernetes.io/projected/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-kube-api-access-fwmgm\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.619321    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:11:33.119300388 +0000 UTC m=+3.036107831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysconfig\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619387    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-sys\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619413    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-kubelet\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619441    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-iptables-alerter-script\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619521    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-sys\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0981239-8d27-4987-852c-6987662e382f-host\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-system-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.620218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-socket-dir-parent\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-hostroot\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619649    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-socket-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619694    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-registration-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619725    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-cnibin\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619751    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-systemd\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-etc-tuned\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-systemd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619870    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovn-node-metrics-cert\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-script-lib\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619924    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0981239-8d27-4987-852c-6987662e382f-serviceca\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cnibin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.619976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8660d488-98d3-4993-a39b-56b9743da74c-konnectivity-ca\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-host\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-sys-fs\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.621113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjjmh\" (UniqueName: \"kubernetes.io/projected/bdade2c0-147d-4bd9-b95e-d1694be1fd27-kube-api-access-cjjmh\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-system-cni-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-node-log\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-netd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620216    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cni-binary-copy\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wftfx\" (UniqueName: \"kubernetes.io/projected/5806175a-7db8-4cdb-84bf-a69611eeccf9-kube-api-access-wftfx\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620288    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-modprobe-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620316    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620324    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysconfig\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-host-slash\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620391    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0981239-8d27-4987-852c-6987662e382f-host\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620396    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbf7\" (UniqueName: \"kubernetes.io/projected/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-kube-api-access-mhbf7\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-system-cni-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.621995 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620511    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-multus\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620538    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-daemon-config\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620565    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-run\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-kubelet\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-kubernetes\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620674    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620702    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-conf\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620710    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-system-cni-dir\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-netns\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620765    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-var-lib-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-config\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620811    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-node-log\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-var-lib-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.622888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-conf-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-etc-kubernetes\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l2m6\" (UniqueName: \"kubernetes.io/projected/2f76e682-004f-4c4f-a848-118433b612ff-kube-api-access-2l2m6\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620974    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-systemd-units\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621004    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-cni-netd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-systemd-units\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-var-lib-kubelet\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-os-release\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621179    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-registration-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e251d89e-806c-4d09-92e3-2d26535cab62-cnibin\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-socket-dir\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621255    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621304    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-modprobe-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-tmp-dir\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621644    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-systemd\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621702    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-lib-modules\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621770    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-dbus\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-bin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.624769 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621130    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-socket-dir-parent\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621838    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621872    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-hostroot\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621894    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-host-slash\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-systemd\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.621965    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-host\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-run\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.620674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-kubelet\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622192    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622234    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-kubelet\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622480    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-kubernetes\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovnkube-script-lib\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-d\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622730    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f76e682-004f-4c4f-a848-118433b612ff-sys-fs\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-tmp\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-run-openvswitch\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622816    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-host-var-lib-cni-multus\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f0981239-8d27-4987-852c-6987662e382f-serviceca\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.626202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.622948    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5806175a-7db8-4cdb-84bf-a69611eeccf9-host-run-netns\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ecb4110c-d62a-4594-93d0-401aad638d56-etc-sysctl-conf\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-cnibin\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623195    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-etc-kubernetes\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-conf-dir\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-multus-daemon-config\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e251d89e-806c-4d09-92e3-2d26535cab62-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.623774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8660d488-98d3-4993-a39b-56b9743da74c-konnectivity-ca\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.624005    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8660d488-98d3-4993-a39b-56b9743da74c-agent-certs\") pod \"konnectivity-agent-zmc85\" (UID: \"8660d488-98d3-4993-a39b-56b9743da74c\") " pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.625891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5806175a-7db8-4cdb-84bf-a69611eeccf9-ovn-node-metrics-cert\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.626865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.626057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ecb4110c-d62a-4594-93d0-401aad638d56-etc-tuned\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.640809 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.639999    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:32.640809 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.640031    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:32.640809 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.640049    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:32.640809 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:32.640128    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:33.140102591 +0000 UTC m=+3.056910065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:32.642659 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.642557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbvbm\" (UniqueName: \"kubernetes.io/projected/e251d89e-806c-4d09-92e3-2d26535cab62-kube-api-access-bbvbm\") pod \"multus-additional-cni-plugins-bw425\" (UID: \"e251d89e-806c-4d09-92e3-2d26535cab62\") " pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.645599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.644397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np2zs\" (UniqueName: \"kubernetes.io/projected/ecb4110c-d62a-4594-93d0-401aad638d56-kube-api-access-np2zs\") pod \"tuned-mx697\" (UID: \"ecb4110c-d62a-4594-93d0-401aad638d56\") " pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.645599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.644422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjjmh\" (UniqueName: \"kubernetes.io/projected/bdade2c0-147d-4bd9-b95e-d1694be1fd27-kube-api-access-cjjmh\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:32.645599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.644850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwmgm\" (UniqueName: \"kubernetes.io/projected/ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9-kube-api-access-fwmgm\") pod \"multus-2l8vf\" (UID: \"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9\") " pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.645599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.644978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x4m\" (UniqueName: \"kubernetes.io/projected/f0981239-8d27-4987-852c-6987662e382f-kube-api-access-j4x4m\") pod \"node-ca-sfm4n\" (UID: \"f0981239-8d27-4987-852c-6987662e382f\") " pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.646145 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.646035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86sv\" (UniqueName: \"kubernetes.io/projected/d75a082e-0e66-4c34-8e7f-73b4bc26c8f5-kube-api-access-t86sv\") pod \"node-resolver-2rvnq\" (UID: \"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5\") " pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.646252 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.646228    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wftfx\" (UniqueName: \"kubernetes.io/projected/5806175a-7db8-4cdb-84bf-a69611eeccf9-kube-api-access-wftfx\") pod \"ovnkube-node-f8p8w\" (UID: \"5806175a-7db8-4cdb-84bf-a69611eeccf9\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.647489 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.647455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbf7\" (UniqueName: \"kubernetes.io/projected/cae0bdb9-f8c4-47f1-bf63-40792b66f31e-kube-api-access-mhbf7\") pod \"iptables-alerter-78zrc\" (UID: \"cae0bdb9-f8c4-47f1-bf63-40792b66f31e\") " pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.648347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.648298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l2m6\" (UniqueName: \"kubernetes.io/projected/2f76e682-004f-4c4f-a848-118433b612ff-kube-api-access-2l2m6\") pod \"aws-ebs-csi-driver-node-k44bl\" (UID: \"2f76e682-004f-4c4f-a848-118433b612ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.715676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.715600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" event={"ID":"30cc42da2b8d91e22106a50ef6e004ce","Type":"ContainerStarted","Data":"d1de88e00c8162e77331b926c300e8a595f640e6af55415be0d2d2ff64b1ed44"}
Jul 15 13:11:32.717460 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.717425    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"cf4d14de3156ff0d50ee01acbbf3af52","Type":"ContainerStarted","Data":"42d754f848af2cc784eb7099346e02a37d0660a2cafd8cfdbdbc9f418bbfedb1"}
Jul 15 13:11:32.810524 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.810436    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:32.821117 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.821080    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bw425"
Jul 15 13:11:32.829578 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.829552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2rvnq"
Jul 15 13:11:32.838006 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.837973    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78zrc"
Jul 15 13:11:32.846287 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.846257    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:11:32.855474 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.855441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mx697"
Jul 15 13:11:32.863973 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.863938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl"
Jul 15 13:11:32.874335 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.874291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfm4n"
Jul 15 13:11:32.881644 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.881612    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8vf"
Jul 15 13:11:32.987388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:32.987353    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 13:11:33.124711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:33.124611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:33.124711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:33.124657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:33.124880 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.124785    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:33.124880 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.124856    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:34.124837874 +0000 UTC m=+4.041645305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:33.124880 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.124785    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:33.125045 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.124905    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:11:34.124895804 +0000 UTC m=+4.041703233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:33.225755 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:33.225716    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:33.225949 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.225925    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:33.226026 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.225956    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:33.226026 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.225972    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:33.226095 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:33.226050    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:34.226028018 +0000 UTC m=+4.142835449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:33.570633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:33.570529    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:32 +0000 UTC" deadline="2028-03-21 19:58:00.56668637 +0000 UTC"
Jul 15 13:11:33.570633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:33.570576    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14766h46m26.996114523s"
Jul 15 13:11:33.832845 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.832797    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f76e682_004f_4c4f_a848_118433b612ff.slice/crio-9ae3faca7b9c95b39bc118035706318f012dd6335b2feae9a6b8145a7930efaf WatchSource:0}: Error finding container 9ae3faca7b9c95b39bc118035706318f012dd6335b2feae9a6b8145a7930efaf: Status 404 returned error can't find the container with id 9ae3faca7b9c95b39bc118035706318f012dd6335b2feae9a6b8145a7930efaf
Jul 15 13:11:33.834849 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.834823    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc6f5d2_8f29_43c7_8bc7_24f51c068ff9.slice/crio-ca4c6aecf6c04fa1c263be6b6147324f60ee365ecc678df67f398cb0de3fd3b7 WatchSource:0}: Error finding container ca4c6aecf6c04fa1c263be6b6147324f60ee365ecc678df67f398cb0de3fd3b7: Status 404 returned error can't find the container with id ca4c6aecf6c04fa1c263be6b6147324f60ee365ecc678df67f398cb0de3fd3b7
Jul 15 13:11:33.835597 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.835552    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0981239_8d27_4987_852c_6987662e382f.slice/crio-cf32fe406103876ddddda840c1086527e15f0a7b7d2378b6bb6e80abeb43a12e WatchSource:0}: Error finding container cf32fe406103876ddddda840c1086527e15f0a7b7d2378b6bb6e80abeb43a12e: Status 404 returned error can't find the container with id cf32fe406103876ddddda840c1086527e15f0a7b7d2378b6bb6e80abeb43a12e
Jul 15 13:11:33.837892 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.837416    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5806175a_7db8_4cdb_84bf_a69611eeccf9.slice/crio-f06b1b5b06bd16c467f70301b57ebfb0eac98ac74aa5efcae3dbe229262e7e79 WatchSource:0}: Error finding container f06b1b5b06bd16c467f70301b57ebfb0eac98ac74aa5efcae3dbe229262e7e79: Status 404 returned error can't find the container with id f06b1b5b06bd16c467f70301b57ebfb0eac98ac74aa5efcae3dbe229262e7e79
Jul 15 13:11:33.840274 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.840182    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae0bdb9_f8c4_47f1_bf63_40792b66f31e.slice/crio-5029fdf452b5ed6c8236e82eca16c02ce93e597a0e8b929a1675f4e1ada855e1 WatchSource:0}: Error finding container 5029fdf452b5ed6c8236e82eca16c02ce93e597a0e8b929a1675f4e1ada855e1: Status 404 returned error can't find the container with id 5029fdf452b5ed6c8236e82eca16c02ce93e597a0e8b929a1675f4e1ada855e1
Jul 15 13:11:33.840756 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.840735    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode251d89e_806c_4d09_92e3_2d26535cab62.slice/crio-29bf0bbf95b8d7ddaa857e0ce824acf3d8dbf5682baa4d9c8c3ded637c182715 WatchSource:0}: Error finding container 29bf0bbf95b8d7ddaa857e0ce824acf3d8dbf5682baa4d9c8c3ded637c182715: Status 404 returned error can't find the container with id 29bf0bbf95b8d7ddaa857e0ce824acf3d8dbf5682baa4d9c8c3ded637c182715
Jul 15 13:11:33.842606 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.842582    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb4110c_d62a_4594_93d0_401aad638d56.slice/crio-6e294126315b5a739bae113ee2b0723c7ef1873ee0bc429b0e38f7bb8e7e453f WatchSource:0}: Error finding container 6e294126315b5a739bae113ee2b0723c7ef1873ee0bc429b0e38f7bb8e7e453f: Status 404 returned error can't find the container with id 6e294126315b5a739bae113ee2b0723c7ef1873ee0bc429b0e38f7bb8e7e453f
Jul 15 13:11:33.843824 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.843796    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8660d488_98d3_4993_a39b_56b9743da74c.slice/crio-709037291f5323c5085077024b13dffabbb8382d1d8f8417dfeabec3e6525c87 WatchSource:0}: Error finding container 709037291f5323c5085077024b13dffabbb8382d1d8f8417dfeabec3e6525c87: Status 404 returned error can't find the container with id 709037291f5323c5085077024b13dffabbb8382d1d8f8417dfeabec3e6525c87
Jul 15 13:11:33.846486 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:11:33.846174    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75a082e_0e66_4c34_8e7f_73b4bc26c8f5.slice/crio-66c180516bc5ccd80f07b204a87055826c6756304745a651518f12880e853324 WatchSource:0}: Error finding container 66c180516bc5ccd80f07b204a87055826c6756304745a651518f12880e853324: Status 404 returned error can't find the container with id 66c180516bc5ccd80f07b204a87055826c6756304745a651518f12880e853324
Jul 15 13:11:34.135100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.134898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:34.135289 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.135113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:34.135289 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.135065    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:34.135289 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.135203    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:34.135289 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.135245    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.135223076 +0000 UTC m=+6.052030517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:34.135289 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.135266    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.13525634 +0000 UTC m=+6.052063772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:34.235555 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.235510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:34.235718 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.235694    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:34.235718 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.235715    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:34.235794 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.235727    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:34.235794 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.235785    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:36.235767399 +0000 UTC m=+6.152574848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:34.571863 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.571719    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 13:06:32 +0000 UTC" deadline="2027-12-28 07:39:19.847760582 +0000 UTC"
Jul 15 13:11:34.571863 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.571778    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12738h27m45.275986084s"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.712547    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.712551    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.712837    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.712705    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.712887    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:34.713020 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:34.712962    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:34.729012 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.728970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rvnq" event={"ID":"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5","Type":"ContainerStarted","Data":"66c180516bc5ccd80f07b204a87055826c6756304745a651518f12880e853324"}
Jul 15 13:11:34.734228 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.734191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mx697" event={"ID":"ecb4110c-d62a-4594-93d0-401aad638d56","Type":"ContainerStarted","Data":"6e294126315b5a739bae113ee2b0723c7ef1873ee0bc429b0e38f7bb8e7e453f"}
Jul 15 13:11:34.737716 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.737682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerStarted","Data":"29bf0bbf95b8d7ddaa857e0ce824acf3d8dbf5682baa4d9c8c3ded637c182715"}
Jul 15 13:11:34.743498 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.743457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"f06b1b5b06bd16c467f70301b57ebfb0eac98ac74aa5efcae3dbe229262e7e79"}
Jul 15 13:11:34.747577 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.747544    2571 generic.go:356] "Generic (PLEG): container finished" podID="cf4d14de3156ff0d50ee01acbbf3af52" containerID="9a79eef308180861e2866d434a9ad33cab353177f1f131aaeb28e845b047407e" exitCode=0
Jul 15 13:11:34.747701 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.747637    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"cf4d14de3156ff0d50ee01acbbf3af52","Type":"ContainerDied","Data":"9a79eef308180861e2866d434a9ad33cab353177f1f131aaeb28e845b047407e"}
Jul 15 13:11:34.753458 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.753159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmc85" event={"ID":"8660d488-98d3-4993-a39b-56b9743da74c","Type":"ContainerStarted","Data":"709037291f5323c5085077024b13dffabbb8382d1d8f8417dfeabec3e6525c87"}
Jul 15 13:11:34.758793 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.758669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78zrc" event={"ID":"cae0bdb9-f8c4-47f1-bf63-40792b66f31e","Type":"ContainerStarted","Data":"5029fdf452b5ed6c8236e82eca16c02ce93e597a0e8b929a1675f4e1ada855e1"}
Jul 15 13:11:34.768943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.768911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfm4n" event={"ID":"f0981239-8d27-4987-852c-6987662e382f","Type":"ContainerStarted","Data":"cf32fe406103876ddddda840c1086527e15f0a7b7d2378b6bb6e80abeb43a12e"}
Jul 15 13:11:34.782851 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.782790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8vf" event={"ID":"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9","Type":"ContainerStarted","Data":"ca4c6aecf6c04fa1c263be6b6147324f60ee365ecc678df67f398cb0de3fd3b7"}
Jul 15 13:11:34.787672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.787580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl" event={"ID":"2f76e682-004f-4c4f-a848-118433b612ff","Type":"ContainerStarted","Data":"9ae3faca7b9c95b39bc118035706318f012dd6335b2feae9a6b8145a7930efaf"}
Jul 15 13:11:34.794387 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.794157    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" event={"ID":"30cc42da2b8d91e22106a50ef6e004ce","Type":"ContainerStarted","Data":"87bd59dbe9710bb4ccb3021c4c6f076699d89e135beaf66a06cb0834ebedb0f7"}
Jul 15 13:11:34.817780 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:34.817047    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-182.ec2.internal" podStartSLOduration=2.817025443 podStartE2EDuration="2.817025443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:34.816531564 +0000 UTC m=+4.733339016" watchObservedRunningTime="2026-07-15 13:11:34.817025443 +0000 UTC m=+4.733832901"
Jul 15 13:11:35.809990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:35.809953    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" event={"ID":"cf4d14de3156ff0d50ee01acbbf3af52","Type":"ContainerStarted","Data":"8fd114ee60d44133d3bcaa456ba617bf5dddffa3aa527cdd4b59387679f3f9aa"}
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.154864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.154970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.155096    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.155134    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.155159    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:40.155141508 +0000 UTC m=+10.071948937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:36.155536 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.155201    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:11:40.155183281 +0000 UTC m=+10.071990722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:36.255691 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.255652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:36.255895 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.255843    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:36.255895 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.255898    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:36.256083 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.255915    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:36.256083 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.255984    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:40.255963501 +0000 UTC m=+10.172770946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:36.710619 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.710583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:36.710619 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.710618    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:36.710855 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:36.710586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:36.710855 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.710717    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:36.710855 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.710800    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:36.710990 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:36.710862    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:38.711101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:38.710996    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:38.711101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:38.711027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:38.711101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:38.711049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:38.711685 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:38.711145    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:38.711685 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:38.711401    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:38.711685 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:38.711498    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:40.186147 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.186113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:40.186561 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.186170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:40.186561 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.186354    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:40.186561 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.186423    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:11:48.186402909 +0000 UTC m=+18.103210338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:40.186840 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.186819    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:40.186903 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.186878    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:48.186863756 +0000 UTC m=+18.103671186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:40.287557 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.287355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:40.287717 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.287580    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:40.287717 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.287602    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:40.287717 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.287617    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:40.287717 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.287673    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:11:48.287654411 +0000 UTC m=+18.204462072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.711778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.711778    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.712917    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.712966    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.713033    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:40.713352 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:40.713119    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:40.826311 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.825643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfm4n" event={"ID":"f0981239-8d27-4987-852c-6987662e382f","Type":"ContainerStarted","Data":"ecd1a1b93d53f2f560d28b27979c2709c150c42ac86a62a09fb67fa76475b821"}
Jul 15 13:11:40.828893 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.828852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl" event={"ID":"2f76e682-004f-4c4f-a848-118433b612ff","Type":"ContainerStarted","Data":"029c2807a3c0d1a9e91fbffc8edfb8d00afa583b239481f00f9795f4e82d56f0"}
Jul 15 13:11:40.831338 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.831311    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2rvnq" event={"ID":"d75a082e-0e66-4c34-8e7f-73b4bc26c8f5","Type":"ContainerStarted","Data":"e394d3e3daa445016267670c206a56578f71e22785009409df9f6f1995445125"}
Jul 15 13:11:40.833946 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.833917    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="d725187c28d52caab2d574ac7fad2f9ada28b60b745bf6dd1060876101b420d3" exitCode=0
Jul 15 13:11:40.834055 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.833961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"d725187c28d52caab2d574ac7fad2f9ada28b60b745bf6dd1060876101b420d3"}
Jul 15 13:11:40.851189 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.851131    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-182.ec2.internal" podStartSLOduration=8.851111905 podStartE2EDuration="8.851111905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:35.828509087 +0000 UTC m=+5.745316572" watchObservedRunningTime="2026-07-15 13:11:40.851111905 +0000 UTC m=+10.767919354"
Jul 15 13:11:40.873464 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.873402    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sfm4n" podStartSLOduration=3.634323769 podStartE2EDuration="9.873376534s" totalImagesPullingTime="6.239052765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:40.851699556 +0000 UTC m=+10.768507005" watchObservedRunningTime="2026-07-15 13:11:40.873376534 +0000 UTC m=+10.790183983"
Jul 15 13:11:40.873976 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:40.873939    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2rvnq" podStartSLOduration=3.6447667519999998 podStartE2EDuration="9.8739285s" totalImagesPullingTime="6.229161748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:40.873596541 +0000 UTC m=+10.790403991" watchObservedRunningTime="2026-07-15 13:11:40.8739285 +0000 UTC m=+10.790735948"
Jul 15 13:11:42.254835 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.254622    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 13:11:42.571505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.570586    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T13:11:42.254833412Z","UUID":"3d43357a-86f2-4d81-b29e-4b8edb4d25d6","Handler":null,"Name":"","Endpoint":""}
Jul 15 13:11:42.572672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.572648    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 13:11:42.572783 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.572706    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 13:11:42.711432 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.711394    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:42.711580 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:42.711525    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:42.711882 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.711729    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:42.711882 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:42.711844    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:42.712069 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.711904    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:42.712069 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:42.711994    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:42.842483 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.842396    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zmc85" event={"ID":"8660d488-98d3-4993-a39b-56b9743da74c","Type":"ContainerStarted","Data":"4d07467ef6f183c1a4530032f02620d0f3f3f4826772811da0d64d3f336863e4"}
Jul 15 13:11:42.847290 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.846808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78zrc" event={"ID":"cae0bdb9-f8c4-47f1-bf63-40792b66f31e","Type":"ContainerStarted","Data":"1b5e4ab2944de42498faa9edc5bd23f8dad28f186c016d9c6c559a37e2266ee7"}
Jul 15 13:11:42.853526 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.853448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl" event={"ID":"2f76e682-004f-4c4f-a848-118433b612ff","Type":"ContainerStarted","Data":"bb1346a960cd6d0ee791582c0e94f051abb29913a49bed8c27ad4b2bd5948d0a"}
Jul 15 13:11:42.862656 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.862193    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zmc85" podStartSLOduration=3.615996522 podStartE2EDuration="11.862172387s" totalImagesPullingTime="8.246175865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:42.861879899 +0000 UTC m=+12.778687347" watchObservedRunningTime="2026-07-15 13:11:42.862172387 +0000 UTC m=+12.778979839"
Jul 15 13:11:42.878633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:42.878293    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-78zrc" podStartSLOduration=5.635258041 podStartE2EDuration="11.878256486s" totalImagesPullingTime="6.242998445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:42.877816156 +0000 UTC m=+12.794623605" watchObservedRunningTime="2026-07-15 13:11:42.878256486 +0000 UTC m=+12.795063935"
Jul 15 13:11:44.711397 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:44.711359    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:44.711397 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:44.711393    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:44.712169 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:44.711363    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:44.712169 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:44.711502    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:44.712169 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:44.711711    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:44.712169 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:44.711797    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:46.710969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:46.710882    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:46.711549 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:46.710882    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:46.711549 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:46.711021    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:46.711549 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:46.710887    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:46.711549 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:46.711094    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:46.711549 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:46.711167    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:47.805768 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:47.805726    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:47.806528 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:47.806505    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:48.257854 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.257779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:48.257854 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.257823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:48.258061 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.257930    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:48.258061 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.257997    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:04.257977916 +0000 UTC m=+34.174785343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:11:48.258061 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.258008    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:48.258061 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.258061    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:12:04.258049766 +0000 UTC m=+34.174857209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:11:48.358209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.358177    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:48.358408 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.358367    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:11:48.358408 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.358388    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:11:48.358408 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.358402    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:48.358558 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.358461    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:04.358442166 +0000 UTC m=+34.275249607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:11:48.711594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.711313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:48.711594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.711313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:48.711814 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:48.711313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:48.711814 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.711658    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:48.711814 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.711775    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:48.711966 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:48.711876    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:50.711254 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:50.711220    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:50.711733 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:50.711330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:50.711733 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:50.711337    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:50.711733 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:50.711374    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:50.711733 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:50.711460    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:50.711733 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:50.711543    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:52.710462 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:52.710425    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:52.711002 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:52.710429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:52.711002 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:52.710549    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:52.711002 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:52.710441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:52.711002 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:52.710635    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:52.711002 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:52.710687    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:54.710852 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:54.710765    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:54.710852 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:54.710814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:54.710852 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:54.710765    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:54.711552 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:54.710906    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:54.711552 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:54.711015    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:54.711552 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:54.711113    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:56.097382 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.097318    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:56.097689 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.097457    2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 13:11:56.098251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.098233    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zmc85"
Jul 15 13:11:56.710560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.710528    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:56.710725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.710533    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:56.710725 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:56.710643    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:56.710725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.710658    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:56.710892 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:56.710775    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:56.710892 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:56.710865    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:56.884967 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.884883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8vf" event={"ID":"ffc6f5d2-8f29-43c7-8bc7-24f51c068ff9","Type":"ContainerStarted","Data":"c77224de12d0eb50b523fed802df3c3437eb8f4d506326b3409c316b4252dd6e"}
Jul 15 13:11:56.886960 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.886930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl" event={"ID":"2f76e682-004f-4c4f-a848-118433b612ff","Type":"ContainerStarted","Data":"49da45d50220122d9ecfe52c25a42add75f23b25c97c15011c87de80d6c811b0"}
Jul 15 13:11:56.888309 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.888271    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mx697" event={"ID":"ecb4110c-d62a-4594-93d0-401aad638d56","Type":"ContainerStarted","Data":"3540d893a069ef52b07e3e5a6198a069b9ebc666615279302a20b397d38c056f"}
Jul 15 13:11:56.890020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.889996    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="c01a0e945b76e8ff7b21d8b1ed6aea5330fbb5f37cdb926e2b4e5feddb462bcd" exitCode=0
Jul 15 13:11:56.890098 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.890060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"c01a0e945b76e8ff7b21d8b1ed6aea5330fbb5f37cdb926e2b4e5feddb462bcd"}
Jul 15 13:11:56.892929 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.892912    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:11:56.893351 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893333    2571 generic.go:356] "Generic (PLEG): container finished" podID="5806175a-7db8-4cdb-84bf-a69611eeccf9" containerID="b42f706729e303fc9c6d6668ddc02ad4a71cacd9c6fb1c04970763b11e7f0f62" exitCode=1
Jul 15 13:11:56.893421 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893392    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"4893ae2d88bbd679b3b4a3cfd6e2f9a2b0fed785f78ba89c5166de0b5adfbe79"}
Jul 15 13:11:56.893485 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893457    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"b02cdd994d90e7ea219f181a6b19050b17c8304b50da8d9cf852c188bf7de3fd"}
Jul 15 13:11:56.893541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"ec241c69d1bdb00faf592f93e54eee7b60216448f2d7b5f67c71977d1a7d9a77"}
Jul 15 13:11:56.893541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893520    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"088621803c8f1346fa8b429e0c55733ab3d3332414e2432b620f64ea5225631e"}
Jul 15 13:11:56.893719 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893561    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerDied","Data":"b42f706729e303fc9c6d6668ddc02ad4a71cacd9c6fb1c04970763b11e7f0f62"}
Jul 15 13:11:56.893719 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.893590    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"1c10f1586d51bb7214583448afd705fd1747fc8afb80eee576c98c8e580fbe15"}
Jul 15 13:11:56.960927 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:56.960876    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2l8vf" podStartSLOduration=3.825579162 podStartE2EDuration="25.960860992s" totalImagesPullingTime="22.13528183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:56.931191894 +0000 UTC m=+26.847999353" watchObservedRunningTime="2026-07-15 13:11:56.960860992 +0000 UTC m=+26.877668454"
Jul 15 13:11:57.032460 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:57.032412    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mx697" podStartSLOduration=3.906697977 podStartE2EDuration="26.032387616s" totalImagesPullingTime="22.125689639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:56.999150895 +0000 UTC m=+26.915958343" watchObservedRunningTime="2026-07-15 13:11:57.032387616 +0000 UTC m=+26.949195105"
Jul 15 13:11:57.032745 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:57.032726    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k44bl" podStartSLOduration=4.347226883 podStartE2EDuration="26.032720619s" totalImagesPullingTime="21.685493736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:57.032323688 +0000 UTC m=+26.949131154" watchObservedRunningTime="2026-07-15 13:11:57.032720619 +0000 UTC m=+26.949528066"
Jul 15 13:11:58.710903 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:58.710874    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:11:58.710903 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:58.710892    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:11:58.711706 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:58.710874    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:11:58.711706 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:58.710987    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:11:58.711706 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:58.711057    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:11:58.711706 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:11:58.711157    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:11:58.900842 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:58.900815    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:11:58.901135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:11:58.901114    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"c9437d4c47aab27d230af2ef3a0f14fe8a0e708516c93c7c9bd11188556517ab"}
Jul 15 13:12:00.711388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.711348    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:00.711968 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.711454    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:00.711968 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.711476    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:00.711968 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:00.711456    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:12:00.711968 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:00.711551    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:12:00.711968 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:00.711600    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:12:00.908179 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.907974    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="050b93cd95aa25fe41bc0b75f9197faa230047c874bab2179a1a3a80b7d11807" exitCode=0
Jul 15 13:12:00.908232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.908049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"050b93cd95aa25fe41bc0b75f9197faa230047c874bab2179a1a3a80b7d11807"}
Jul 15 13:12:00.912336 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.912293    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:12:00.912785 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.912692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"6f0119344c78a08eed8bf8fe3c7b6c5c41cd1c0308492a8a830c8ef3db423ee4"}
Jul 15 13:12:00.913085 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.912966    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:00.913085 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.913055    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:00.913171 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.913107    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:00.913171 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.913166    2571 scope.go:117] "RemoveContainer" containerID="b42f706729e303fc9c6d6668ddc02ad4a71cacd9c6fb1c04970763b11e7f0f62"
Jul 15 13:12:00.929046 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.929022    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:00.929775 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:00.929756    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:01.917669 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:01.917635    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="cec97b955866ec084d75cd364b866cc33a032a9a877c227a5c30714b3151727b" exitCode=0
Jul 15 13:12:01.918141 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:01.917720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"cec97b955866ec084d75cd364b866cc33a032a9a877c227a5c30714b3151727b"}
Jul 15 13:12:01.921749 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:01.921732    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:12:01.922056 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:01.922036    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" event={"ID":"5806175a-7db8-4cdb-84bf-a69611eeccf9","Type":"ContainerStarted","Data":"b1dd17fde946848c3a7724ce7fa3ab70136c3f60f4c2f04d1a03f0fc2797cce2"}
Jul 15 13:12:02.710595 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:02.710561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:02.710799 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:02.710561    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:02.710799 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:02.710692    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:12:02.710799 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:02.710786    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:12:02.710925 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:02.710562    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:02.710925 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:02.710903    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:12:03.784739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.784401    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w" podStartSLOduration=10.609525589 podStartE2EDuration="32.784376804s" totalImagesPullingTime="22.174851215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:02.020889955 +0000 UTC m=+31.937697424" watchObservedRunningTime="2026-07-15 13:12:03.784376804 +0000 UTC m=+33.701184284"
Jul 15 13:12:03.785552 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.785523    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8z6nt"]
Jul 15 13:12:03.785704 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.785697    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:03.785843 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:03.785821    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:12:03.791339 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.791310    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbxkm"]
Jul 15 13:12:03.791478 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.791447    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:03.791592 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:03.791570    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:12:03.792050 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.792027    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ntrtl"]
Jul 15 13:12:03.792145 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:03.792127    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:03.792237 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:03.792218    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:12:04.265870 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:04.265831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:04.266152 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:04.265887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:04.266152 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.266005    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 13:12:04.266152 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.266081    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret podName:e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc nodeName:}" failed. No retries permitted until 2026-07-15 13:12:36.266065345 +0000 UTC m=+66.182872771 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret") pod "global-pull-secret-syncer-8z6nt" (UID: "e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc") : object "kube-system"/"original-pull-secret" not registered
Jul 15 13:12:04.266152 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.266005    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:12:04.266152 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.266146    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:36.266133811 +0000 UTC m=+66.182941242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 13:12:04.366971 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:04.366927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:04.367139 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.367098    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 13:12:04.367139 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.367121    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 13:12:04.367139 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.367135    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5n6f6 for pod openshift-network-diagnostics/network-check-target-ntrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:12:04.367294 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:04.367190    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6 podName:86314381-23cd-46b7-b857-72abd556b5e9 nodeName:}" failed. No retries permitted until 2026-07-15 13:12:36.36717546 +0000 UTC m=+66.283982894 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n6f6" (UniqueName: "kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6") pod "network-check-target-ntrtl" (UID: "86314381-23cd-46b7-b857-72abd556b5e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 13:12:05.710362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:05.710326    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:05.710944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:05.710327    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:05.710944 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:05.710457    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:12:05.710944 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:05.710327    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:05.710944 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:05.710541    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:12:05.710944 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:05.710588    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:12:06.937220 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:06.937189    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="9d5b0a2f737c8f165ae3de0941efae1708123c2261bf6b7a3ac19f362a6836a4" exitCode=0
Jul 15 13:12:06.937686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:06.937241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"9d5b0a2f737c8f165ae3de0941efae1708123c2261bf6b7a3ac19f362a6836a4"}
Jul 15 13:12:07.710515 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:07.710474    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:07.710515 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:07.710506    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:07.710735 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:07.710599    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8z6nt" podUID="e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc"
Jul 15 13:12:07.710735 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:07.710631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:07.710735 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:07.710696    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:12:07.710848 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:07.710737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ntrtl" podUID="86314381-23cd-46b7-b857-72abd556b5e9"
Jul 15 13:12:07.942480 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:07.942443    2571 generic.go:356] "Generic (PLEG): container finished" podID="e251d89e-806c-4d09-92e3-2d26535cab62" containerID="793cb83b77500ff4bdfdb39775e183a29914b0a249be543f6cc82dcfd4feeee2" exitCode=0
Jul 15 13:12:07.943044 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:07.942499    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerDied","Data":"793cb83b77500ff4bdfdb39775e183a29914b0a249be543f6cc82dcfd4feeee2"}
Jul 15 13:12:08.470558 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.470532    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-182.ec2.internal" event="NodeReady"
Jul 15 13:12:08.470688 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.470657    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 13:12:08.528201 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.528170    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6rpmd"]
Jul 15 13:12:08.543469 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.543440    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-khjzw"]
Jul 15 13:12:08.543607 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.543556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.546842 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.546817    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\""
Jul 15 13:12:08.547396 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.547370    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 13:12:08.547573 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.547406    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 13:12:08.553677 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.553656    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6rpmd"]
Jul 15 13:12:08.553764 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.553694    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-khjzw"]
Jul 15 13:12:08.553813 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.553766    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.557360 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.557342    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 13:12:08.557927 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.557905    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 13:12:08.558025 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.557962    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 13:12:08.558347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.558330    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jtsrm\""
Jul 15 13:12:08.699911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.699819    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.699911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.699874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5csp6\" (UniqueName: \"kubernetes.io/projected/dbdd5d91-be5d-42f3-94c6-81d754b3046c-kube-api-access-5csp6\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.699911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.699895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dec017-c5ab-4890-a581-3ada193a3432-cert\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.700141 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.699947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbdd5d91-be5d-42f3-94c6-81d754b3046c-config-volume\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.700141 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.699995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdd5d91-be5d-42f3-94c6-81d754b3046c-tmp-dir\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.700141 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.700021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7s4\" (UniqueName: \"kubernetes.io/projected/71dec017-c5ab-4890-a581-3ada193a3432-kube-api-access-cw7s4\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.801139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5csp6\" (UniqueName: \"kubernetes.io/projected/dbdd5d91-be5d-42f3-94c6-81d754b3046c-kube-api-access-5csp6\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.801139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801137    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dec017-c5ab-4890-a581-3ada193a3432-cert\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.801410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801166    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbdd5d91-be5d-42f3-94c6-81d754b3046c-config-volume\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.801410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdd5d91-be5d-42f3-94c6-81d754b3046c-tmp-dir\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.801410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7s4\" (UniqueName: \"kubernetes.io/projected/71dec017-c5ab-4890-a581-3ada193a3432-kube-api-access-cw7s4\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.801410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.801410 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:08.801378    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:08.801619 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:08.801441    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:09.301422269 +0000 UTC m=+39.218229697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:08.801681 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbdd5d91-be5d-42f3-94c6-81d754b3046c-tmp-dir\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.801946 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.801925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dbdd5d91-be5d-42f3-94c6-81d754b3046c-config-volume\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.805604 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.805585    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71dec017-c5ab-4890-a581-3ada193a3432-cert\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.812764 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.812732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5csp6\" (UniqueName: \"kubernetes.io/projected/dbdd5d91-be5d-42f3-94c6-81d754b3046c-kube-api-access-5csp6\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:08.813104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.813084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7s4\" (UniqueName: \"kubernetes.io/projected/71dec017-c5ab-4890-a581-3ada193a3432-kube-api-access-cw7s4\") pod \"ingress-canary-khjzw\" (UID: \"71dec017-c5ab-4890-a581-3ada193a3432\") " pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.861226 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.861182    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-khjzw"
Jul 15 13:12:08.947656 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.947414    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw425" event={"ID":"e251d89e-806c-4d09-92e3-2d26535cab62","Type":"ContainerStarted","Data":"a3c538d0111e7e34b4afd3165b77e192dac45939f9f9914193849db0088ac005"}
Jul 15 13:12:08.979545 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:08.979480    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bw425" podStartSLOduration=8.24927147 podStartE2EDuration="37.979454602s" totalImagesPullingTime="29.730183132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:08.977406901 +0000 UTC m=+38.894214353" watchObservedRunningTime="2026-07-15 13:12:08.979454602 +0000 UTC m=+38.896262095"
Jul 15 13:12:09.064468 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.064424    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-khjzw"]
Jul 15 13:12:09.069660 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:12:09.069627    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dec017_c5ab_4890_a581_3ada193a3432.slice/crio-eeb7a7ff8ae4c218373335860ead9c5d93d03f90c279c03c7a5ffc21f9c91ad1 WatchSource:0}: Error finding container eeb7a7ff8ae4c218373335860ead9c5d93d03f90c279c03c7a5ffc21f9c91ad1: Status 404 returned error can't find the container with id eeb7a7ff8ae4c218373335860ead9c5d93d03f90c279c03c7a5ffc21f9c91ad1
Jul 15 13:12:09.310222 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.310139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:09.310384 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:09.310253    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:09.310384 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:09.310327    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:10.310312311 +0000 UTC m=+40.227119740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:09.710780 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.710743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:09.710976 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.710743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:09.710976 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.710752    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:09.715317 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.715272    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:12:09.716589 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.716564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:12:09.716709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.716673    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\""
Jul 15 13:12:09.716771 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.716707    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:12:09.716771 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.716743    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:12:09.716867 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.716775    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\""
Jul 15 13:12:09.950729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:09.950694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-khjzw" event={"ID":"71dec017-c5ab-4890-a581-3ada193a3432","Type":"ContainerStarted","Data":"eeb7a7ff8ae4c218373335860ead9c5d93d03f90c279c03c7a5ffc21f9c91ad1"}
Jul 15 13:12:10.319188 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:10.319146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:10.319364 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:10.319327    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:10.319419 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:10.319390    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:12.319372694 +0000 UTC m=+42.236180120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:12.333198 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:12.333152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:12.333686 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:12.333334    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:12.333686 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:12.333408    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:16.333390808 +0000 UTC m=+46.250198245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:13.961952 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:13.961790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-khjzw" event={"ID":"71dec017-c5ab-4890-a581-3ada193a3432","Type":"ContainerStarted","Data":"3da82fe1c405e3d4b969bcfe2574173e7b992190cd0b50f64fc9ca89f627d991"}
Jul 15 13:12:14.982948 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:14.982888    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-khjzw" podStartSLOduration=2.229437479 podStartE2EDuration="6.982869676s" totalImagesPullingTime="4.753432197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:14.982251786 +0000 UTC m=+44.899059255" watchObservedRunningTime="2026-07-15 13:12:14.982869676 +0000 UTC m=+44.899677125"
Jul 15 13:12:16.364601 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:16.364553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:16.365402 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:16.365371    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:16.365591 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:16.365579    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:24.365558852 +0000 UTC m=+54.282366297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:24.417486 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:24.417443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:24.418079 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:24.417587    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:24.418079 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:24.417662    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:12:40.417644923 +0000 UTC m=+70.334452349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:32.935602 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:32.935574    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8p8w"
Jul 15 13:12:36.293027 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.292989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:12:36.293027 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.293034    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:36.296330 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.296308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 13:12:36.296479 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.296314    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 13:12:36.303191 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:36.303167    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:12:36.303314 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:36.303251    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:13:40.303228452 +0000 UTC m=+130.220035889 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : secret "metrics-daemon-secret" not found
Jul 15 13:12:36.306955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.306933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc-original-pull-secret\") pod \"global-pull-secret-syncer-8z6nt\" (UID: \"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc\") " pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:36.393934 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.393886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:36.397405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.397387    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 13:12:36.407913 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.407891    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 13:12:36.416919 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.416888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n6f6\" (UniqueName: \"kubernetes.io/projected/86314381-23cd-46b7-b857-72abd556b5e9-kube-api-access-5n6f6\") pod \"network-check-target-ntrtl\" (UID: \"86314381-23cd-46b7-b857-72abd556b5e9\") " pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:36.426951 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.426924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8z6nt"
Jul 15 13:12:36.433970 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.433948    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b9szj\""
Jul 15 13:12:36.441866 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.441828    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:36.559735 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.559639    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8z6nt"]
Jul 15 13:12:36.563134 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:12:36.563104    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a9d4b8_a4b7_44ac_9d8c_81ac8b50b6bc.slice/crio-bd54027990533ca97a8b9937abcfcb1d3a0127f73f893afc20d298beac31bd63 WatchSource:0}: Error finding container bd54027990533ca97a8b9937abcfcb1d3a0127f73f893afc20d298beac31bd63: Status 404 returned error can't find the container with id bd54027990533ca97a8b9937abcfcb1d3a0127f73f893afc20d298beac31bd63
Jul 15 13:12:36.575628 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:36.575603    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ntrtl"]
Jul 15 13:12:36.578491 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:12:36.578457    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86314381_23cd_46b7_b857_72abd556b5e9.slice/crio-6631a9021c8ff417832c86fa84dc999523f6d01ac3ffdd84d088cdbadba3f51d WatchSource:0}: Error finding container 6631a9021c8ff417832c86fa84dc999523f6d01ac3ffdd84d088cdbadba3f51d: Status 404 returned error can't find the container with id 6631a9021c8ff417832c86fa84dc999523f6d01ac3ffdd84d088cdbadba3f51d
Jul 15 13:12:37.019911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:37.019869    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ntrtl" event={"ID":"86314381-23cd-46b7-b857-72abd556b5e9","Type":"ContainerStarted","Data":"6631a9021c8ff417832c86fa84dc999523f6d01ac3ffdd84d088cdbadba3f51d"}
Jul 15 13:12:37.021159 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:37.021126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8z6nt" event={"ID":"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc","Type":"ContainerStarted","Data":"bd54027990533ca97a8b9937abcfcb1d3a0127f73f893afc20d298beac31bd63"}
Jul 15 13:12:40.424445 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:40.424406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:12:40.424875 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:40.424592    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:12:40.424875 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:12:40.424699    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:13:12.424678116 +0000 UTC m=+102.341485556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:12:41.033533 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:41.033496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ntrtl" event={"ID":"86314381-23cd-46b7-b857-72abd556b5e9","Type":"ContainerStarted","Data":"cca794996555bfab8326405038a823e6f2f53b4e3d35c92c1ae2d2887385ff91"}
Jul 15 13:12:41.033730 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:41.033599    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:12:41.034985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:41.034959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8z6nt" event={"ID":"e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc","Type":"ContainerStarted","Data":"68f5b3681558147c4c1cbfc8b61a655cd5ab45661c44b816711392255b36c6b2"}
Jul 15 13:12:41.060039 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:41.059987    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ntrtl" podStartSLOduration=65.759504605 podStartE2EDuration="1m10.059970278s" totalImagesPullingTime="4.300465673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:41.059641406 +0000 UTC m=+70.976448855" watchObservedRunningTime="2026-07-15 13:12:41.059970278 +0000 UTC m=+70.976777705"
Jul 15 13:12:41.085992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:12:41.085934    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8z6nt" podStartSLOduration=65.765482355 podStartE2EDuration="1m10.085914705s" totalImagesPullingTime="4.32043235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:12:41.085527353 +0000 UTC m=+71.002334820" watchObservedRunningTime="2026-07-15 13:12:41.085914705 +0000 UTC m=+71.002722154"
Jul 15 13:13:12.039676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:13:12.039639    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ntrtl"
Jul 15 13:13:12.441994 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:13:12.441952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:13:12.442153 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:13:12.442079    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:13:12.442153 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:13:12.442135    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:14:16.442119766 +0000 UTC m=+166.358927194 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:13:40.328575 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:13:40.328530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:13:40.329136 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:13:40.328708    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:13:40.329136 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:13:40.328797    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:42.328774913 +0000 UTC m=+252.245582340 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : secret "metrics-daemon-secret" not found
Jul 15 13:14:11.554115 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:14:11.554069    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6rpmd" podUID="dbdd5d91-be5d-42f3-94c6-81d754b3046c"
Jul 15 13:14:12.251111 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:14:12.251081    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:14:12.720806 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:14:12.720772    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:14:16.471694 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:14:16.471651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:14:16.472075 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:14:16.471769    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 13:14:16.472075 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:14:16.471831    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls podName:dbdd5d91-be5d-42f3-94c6-81d754b3046c nodeName:}" failed. No retries permitted until 2026-07-15 13:16:18.471816146 +0000 UTC m=+288.388623577 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls") pod "dns-default-6rpmd" (UID: "dbdd5d91-be5d-42f3-94c6-81d754b3046c") : secret "dns-default-metrics-tls" not found
Jul 15 13:14:27.710617 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:14:27.710527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:15:24.694723 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.694682    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"]
Jul 15 13:15:24.696728 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.696707    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.700122 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.700104    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 13:15:24.700604 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.700579    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.702121 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.702043    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 13:15:24.702238 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.702159    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.703898 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.703875    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"]
Jul 15 13:15:24.705887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.705871    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.710534 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.710265    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 13:15:24.710534 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.710342    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 13:15:24.710534 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.710414    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 13:15:24.710717 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.710699    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 13:15:24.710868 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.710853    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bhm8l\""
Jul 15 13:15:24.715471 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68deb73d-6690-477f-8427-836f664228b0-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.715540 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbbx\" (UniqueName: \"kubernetes.io/projected/02e7c110-2a6d-449d-bd4f-75493825f233-kube-api-access-2cbbx\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.715540 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68deb73d-6690-477f-8427-836f664228b0-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.715716 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e7c110-2a6d-449d-bd4f-75493825f233-tmp\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.715716 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e7c110-2a6d-449d-bd4f-75493825f233-klusterlet-config\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.715871 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.715733    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pswp5\" (UniqueName: \"kubernetes.io/projected/68deb73d-6690-477f-8427-836f664228b0-kube-api-access-pswp5\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.719160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.719114    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"]
Jul 15 13:15:24.719865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.719846    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"]
Jul 15 13:15:24.815770 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.815736    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:15:24.816863 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.816841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e7c110-2a6d-449d-bd4f-75493825f233-tmp\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.816990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.816872    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e7c110-2a6d-449d-bd4f-75493825f233-klusterlet-config\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.816990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.816913    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pswp5\" (UniqueName: \"kubernetes.io/projected/68deb73d-6690-477f-8427-836f664228b0-kube-api-access-pswp5\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.816990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.816981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68deb73d-6690-477f-8427-836f664228b0-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.817168 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.817143    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbbx\" (UniqueName: \"kubernetes.io/projected/02e7c110-2a6d-449d-bd4f-75493825f233-kube-api-access-2cbbx\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.817224 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.817180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68deb73d-6690-477f-8427-836f664228b0-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.817316 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.817272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02e7c110-2a6d-449d-bd4f-75493825f233-tmp\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.817598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.817580    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68deb73d-6690-477f-8427-836f664228b0-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.817734 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.817719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.819464 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.819442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68deb73d-6690-477f-8427-836f664228b0-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.819575 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.819557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02e7c110-2a6d-449d-bd4f-75493825f233-klusterlet-config\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.821214 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.821193    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9ff6l\""
Jul 15 13:15:24.821503 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.821487    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 13:15:24.821574 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.821490    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 13:15:24.821574 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.821547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 13:15:24.828981 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.828907    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 13:15:24.836113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.836090    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"]
Jul 15 13:15:24.838341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.838322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:24.841401 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.841376    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ntknp\""
Jul 15 13:15:24.841525 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.841437    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:15:24.841871 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.841844    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbbx\" (UniqueName: \"kubernetes.io/projected/02e7c110-2a6d-449d-bd4f-75493825f233-kube-api-access-2cbbx\") pod \"klusterlet-addon-workmgr-6767f58446-n4hhs\" (UID: \"02e7c110-2a6d-449d-bd4f-75493825f233\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:24.841977 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.841853    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 13:15:24.843321 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.843298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pswp5\" (UniqueName: \"kubernetes.io/projected/68deb73d-6690-477f-8427-836f664228b0-kube-api-access-pswp5\") pod \"kube-storage-version-migrator-operator-799cb7f958-c7lz2\" (UID: \"68deb73d-6690-477f-8427-836f664228b0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:24.853563 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.853531    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"]
Jul 15 13:15:24.917582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ee46870-b83e-4a48-89bc-5fa17dffee4d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:24.917582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smc7t\" (UniqueName: \"kubernetes.io/projected/8ee46870-b83e-4a48-89bc-5fa17dffee4d-kube-api-access-smc7t\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42jm8\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.917879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:24.918152 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:24.917905    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.006063 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.005972    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:25.018352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"
Jul 15 13:15:25.018514 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smc7t\" (UniqueName: \"kubernetes.io/projected/8ee46870-b83e-4a48-89bc-5fa17dffee4d-kube-api-access-smc7t\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:25.018564 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018564 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018664 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42jm8\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018799 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018772    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018980 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ee46870-b83e-4a48-89bc-5fa17dffee4d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:25.018980 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.018980 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.018943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.019125 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.019043    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:15:25.019125 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.019058    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646dfc66b-7n7bv: secret "image-registry-tls" not found
Jul 15 13:15:25.019125 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.019120    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls podName:0b55a3cc-fd77-4a5d-928e-98f017e9a529 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:25.519101088 +0000 UTC m=+235.435908521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls") pod "image-registry-6646dfc66b-7n7bv" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529") : secret "image-registry-tls" not found
Jul 15 13:15:25.019300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.019143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.019517 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.019477    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.019726 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.019701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.021975 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.021948    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.022075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.022064    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.022191 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.022173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8ee46870-b83e-4a48-89bc-5fa17dffee4d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:25.032836 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.032800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.034210 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.034181    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smc7t\" (UniqueName: \"kubernetes.io/projected/8ee46870-b83e-4a48-89bc-5fa17dffee4d-kube-api-access-smc7t\") pod \"managed-serviceaccount-addon-agent-bb6f6ffd6-4896b\" (UID: \"8ee46870-b83e-4a48-89bc-5fa17dffee4d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:25.034762 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.034745    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42jm8\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.149101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.149070    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"]
Jul 15 13:15:25.152289 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:25.152253    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e7c110_2a6d_449d_bd4f_75493825f233.slice/crio-b5c5de9cbe700eaa19ff334a1377e5f310f929ea453a1706d3101c1a851c7078 WatchSource:0}: Error finding container b5c5de9cbe700eaa19ff334a1377e5f310f929ea453a1706d3101c1a851c7078: Status 404 returned error can't find the container with id b5c5de9cbe700eaa19ff334a1377e5f310f929ea453a1706d3101c1a851c7078
Jul 15 13:15:25.162035 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.162010    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2"]
Jul 15 13:15:25.165205 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.165173    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"
Jul 15 13:15:25.165491 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:25.165470    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68deb73d_6690_477f_8427_836f664228b0.slice/crio-5130f7d6735a24ed698ccc9d916f317549d8c761b0cc23f82e5e4452c7b0992f WatchSource:0}: Error finding container 5130f7d6735a24ed698ccc9d916f317549d8c761b0cc23f82e5e4452c7b0992f: Status 404 returned error can't find the container with id 5130f7d6735a24ed698ccc9d916f317549d8c761b0cc23f82e5e4452c7b0992f
Jul 15 13:15:25.290950 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.290875    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b"]
Jul 15 13:15:25.294129 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:25.294101    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ee46870_b83e_4a48_89bc_5fa17dffee4d.slice/crio-635411c720077c5e102e193f86f4b8a7ba22074cfe42d6ac7dee6f0c218b6469 WatchSource:0}: Error finding container 635411c720077c5e102e193f86f4b8a7ba22074cfe42d6ac7dee6f0c218b6469: Status 404 returned error can't find the container with id 635411c720077c5e102e193f86f4b8a7ba22074cfe42d6ac7dee6f0c218b6469
Jul 15 13:15:25.427409 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.427373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2" event={"ID":"68deb73d-6690-477f-8427-836f664228b0","Type":"ContainerStarted","Data":"5130f7d6735a24ed698ccc9d916f317549d8c761b0cc23f82e5e4452c7b0992f"}
Jul 15 13:15:25.428393 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.428366    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b" event={"ID":"8ee46870-b83e-4a48-89bc-5fa17dffee4d","Type":"ContainerStarted","Data":"635411c720077c5e102e193f86f4b8a7ba22074cfe42d6ac7dee6f0c218b6469"}
Jul 15 13:15:25.429324 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.429303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs" event={"ID":"02e7c110-2a6d-449d-bd4f-75493825f233","Type":"ContainerStarted","Data":"b5c5de9cbe700eaa19ff334a1377e5f310f929ea453a1706d3101c1a851c7078"}
Jul 15 13:15:25.523355 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:25.523320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:25.523509 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.523478    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:15:25.523509 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.523498    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646dfc66b-7n7bv: secret "image-registry-tls" not found
Jul 15 13:15:25.523591 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:25.523555    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls podName:0b55a3cc-fd77-4a5d-928e-98f017e9a529 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:26.523538706 +0000 UTC m=+236.440346132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls") pod "image-registry-6646dfc66b-7n7bv" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529") : secret "image-registry-tls" not found
Jul 15 13:15:26.531791 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:26.531759    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:26.532149 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:26.531915    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:15:26.532149 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:26.531935    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646dfc66b-7n7bv: secret "image-registry-tls" not found
Jul 15 13:15:26.532149 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:26.531987    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls podName:0b55a3cc-fd77-4a5d-928e-98f017e9a529 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:28.531971351 +0000 UTC m=+238.448778781 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls") pod "image-registry-6646dfc66b-7n7bv" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529") : secret "image-registry-tls" not found
Jul 15 13:15:28.549272 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:28.549219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:28.549762 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:28.549375    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:15:28.549762 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:28.549401    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646dfc66b-7n7bv: secret "image-registry-tls" not found
Jul 15 13:15:28.549762 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:28.549472    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls podName:0b55a3cc-fd77-4a5d-928e-98f017e9a529 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.549451827 +0000 UTC m=+242.466259260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls") pod "image-registry-6646dfc66b-7n7bv" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529") : secret "image-registry-tls" not found
Jul 15 13:15:30.777510 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.777470    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8822v"]
Jul 15 13:15:30.780002 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.779979    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.786353 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.786026    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 13:15:30.786353 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.786065    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 13:15:30.786639 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.786602    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 13:15:30.786639 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.786610    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k8phr\""
Jul 15 13:15:30.788633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.788618    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 13:15:30.797093 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.797068    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8822v"]
Jul 15 13:15:30.866648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.866608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.866648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.866651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-data-volume\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.866905 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.866693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.866905 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.866774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-crio-socket\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.866905 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.866820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967537 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-data-volume\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-crio-socket\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967881 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:30.967729    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:30.967881 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:30.967767    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:30.967881 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.967784    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-crio-socket\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.967881 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:30.967830    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.467812162 +0000 UTC m=+241.384619607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:30.967881 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:30.967846    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:31.467838446 +0000 UTC m=+241.384645873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:30.968156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.968134    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-data-volume\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:30.986959 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:30.986926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg9zw\" (UniqueName: \"kubernetes.io/projected/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-api-access-qg9zw\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:31.455832 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.455782    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs" event={"ID":"02e7c110-2a6d-449d-bd4f-75493825f233","Type":"ContainerStarted","Data":"84e04e58e41f29f251489fef33d5ae031826a913c1b0ddfae26a4308f1a6e9ce"}
Jul 15 13:15:31.456037 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.455885    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:31.457343 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.457314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2" event={"ID":"68deb73d-6690-477f-8427-836f664228b0","Type":"ContainerStarted","Data":"a83355599295fef868f69e543c62bdcb39aab7d9af1c4d0c8ce3b84cf770c599"}
Jul 15 13:15:31.457820 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.457804    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs"
Jul 15 13:15:31.459057 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.459039    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b" event={"ID":"8ee46870-b83e-4a48-89bc-5fa17dffee4d","Type":"ContainerStarted","Data":"6a79d078d6dfd9987e3dcfcaf9a6f931442b6a9a19bb2aafee89d7ca17986c98"}
Jul 15 13:15:31.470585 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.470559    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:31.470761 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:31.470691    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:31.470761 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.470729    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:31.470761 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:31.470757    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.470735607 +0000 UTC m=+242.387543033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:31.470933 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:31.470830    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:31.470933 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:31.470884    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:32.470868237 +0000 UTC m=+242.387675666 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:31.480439 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.480392    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6767f58446-n4hhs" podStartSLOduration=2.040215105 podStartE2EDuration="7.48037738s" totalImagesPullingTime="5.440162275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:31.479655352 +0000 UTC m=+241.396462825" watchObservedRunningTime="2026-07-15 13:15:31.48037738 +0000 UTC m=+241.397184828"
Jul 15 13:15:31.510186 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.510134    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6f6ffd6-4896b" podStartSLOduration=2.228148436 podStartE2EDuration="7.510114784s" totalImagesPullingTime="5.281966348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:31.50917258 +0000 UTC m=+241.425980028" watchObservedRunningTime="2026-07-15 13:15:31.510114784 +0000 UTC m=+241.426922212"
Jul 15 13:15:31.555041 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:31.554987    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2" podStartSLOduration=2.1500152359999998 podStartE2EDuration="7.554971946s" totalImagesPullingTime="5.40495671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:31.553862534 +0000 UTC m=+241.470669982" watchObservedRunningTime="2026-07-15 13:15:31.554971946 +0000 UTC m=+241.471779415"
Jul 15 13:15:32.479725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.479688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:32.480102 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.479745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:32.480102 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.479819    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:32.480102 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.479881    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.479863945 +0000 UTC m=+244.396671374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:32.480102 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.479819    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:32.480102 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.479956    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:34.479943099 +0000 UTC m=+244.396750524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:32.539469 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.539442    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rvnq_d75a082e-0e66-4c34-8e7f-73b4bc26c8f5/dns-node-resolver/0.log"
Jul 15 13:15:32.580924 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.580885    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:32.581089 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.581039    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 13:15:32.581089 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.581056    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6646dfc66b-7n7bv: secret "image-registry-tls" not found
Jul 15 13:15:32.581201 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:32.581116    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls podName:0b55a3cc-fd77-4a5d-928e-98f017e9a529 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:40.581095825 +0000 UTC m=+250.497903253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls") pod "image-registry-6646dfc66b-7n7bv" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529") : secret "image-registry-tls" not found
Jul 15 13:15:32.942998 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.942965    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gb88p"]
Jul 15 13:15:32.945470 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.945452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:32.948535 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.948509    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 15 13:15:32.948535 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.948522    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 15 13:15:32.948709 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.948509    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lhphc\""
Jul 15 13:15:32.949836 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.949816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 15 13:15:32.949966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.949895    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 15 13:15:32.955178 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.955155    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gb88p"]
Jul 15 13:15:32.985172 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.985132    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79700edc-0bed-4285-9b50-fac1c626685d-signing-cabundle\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:32.985378 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.985194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79700edc-0bed-4285-9b50-fac1c626685d-signing-key\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:32.985378 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:32.985293    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24fq\" (UniqueName: \"kubernetes.io/projected/79700edc-0bed-4285-9b50-fac1c626685d-kube-api-access-z24fq\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.086541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.086502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79700edc-0bed-4285-9b50-fac1c626685d-signing-cabundle\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.086707 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.086558    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79700edc-0bed-4285-9b50-fac1c626685d-signing-key\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.086707 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.086589    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z24fq\" (UniqueName: \"kubernetes.io/projected/79700edc-0bed-4285-9b50-fac1c626685d-kube-api-access-z24fq\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.087304 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.087260    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/79700edc-0bed-4285-9b50-fac1c626685d-signing-cabundle\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.089058 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.089030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/79700edc-0bed-4285-9b50-fac1c626685d-signing-key\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.098727 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.098704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24fq\" (UniqueName: \"kubernetes.io/projected/79700edc-0bed-4285-9b50-fac1c626685d-kube-api-access-z24fq\") pod \"service-ca-79f68b9f4f-gb88p\" (UID: \"79700edc-0bed-4285-9b50-fac1c626685d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.255179 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.255080    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p"
Jul 15 13:15:33.378068 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.378036    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gb88p"]
Jul 15 13:15:33.381109 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:33.381080    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79700edc_0bed_4285_9b50_fac1c626685d.slice/crio-3d629d83a41bbc0bb0871806c528fcfe9ba3b9eea950a9bb3dda83581c1bc074 WatchSource:0}: Error finding container 3d629d83a41bbc0bb0871806c528fcfe9ba3b9eea950a9bb3dda83581c1bc074: Status 404 returned error can't find the container with id 3d629d83a41bbc0bb0871806c528fcfe9ba3b9eea950a9bb3dda83581c1bc074
Jul 15 13:15:33.465509 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.465472    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p" event={"ID":"79700edc-0bed-4285-9b50-fac1c626685d","Type":"ContainerStarted","Data":"3d629d83a41bbc0bb0871806c528fcfe9ba3b9eea950a9bb3dda83581c1bc074"}
Jul 15 13:15:33.936657 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:33.936628    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfm4n_f0981239-8d27-4987-852c-6987662e382f/node-ca/0.log"
Jul 15 13:15:34.499349 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:34.499298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:34.499558 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:34.499392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:34.499558 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:34.499424    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:34.499558 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:34.499489    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.49947243 +0000 UTC m=+248.416279859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:34.499558 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:34.499497    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:34.499558 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:34.499548    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:38.499535352 +0000 UTC m=+248.416342778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:34.735766 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:34.735732    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-khjzw_71dec017-c5ab-4890-a581-3ada193a3432/serve-healthcheck-canary/0.log"
Jul 15 13:15:36.476759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:36.476720    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p" event={"ID":"79700edc-0bed-4285-9b50-fac1c626685d","Type":"ContainerStarted","Data":"c3852c7152c12db6d6d7eb00c8b22622944a42c95633dd5d63916da67dd0f472"}
Jul 15 13:15:36.495727 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:36.495675    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-gb88p" podStartSLOduration=2.326394978 podStartE2EDuration="4.495657304s" totalImagesPullingTime="2.169262326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:36.495187422 +0000 UTC m=+246.411994872" watchObservedRunningTime="2026-07-15 13:15:36.495657304 +0000 UTC m=+246.412464752"
Jul 15 13:15:38.534041 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:38.534002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:38.534457 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:38.534058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:38.534457 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:38.534138    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 13:15:38.534457 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:38.534147    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:38.534457 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:38.534192    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.534178744 +0000 UTC m=+256.450986171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : configmap "kube-rbac-proxy" not found
Jul 15 13:15:38.534457 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:38.534204    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls podName:f00aee38-2c4a-4990-91ea-bd68a9cb9b57 nodeName:}" failed. No retries permitted until 2026-07-15 13:15:46.534198571 +0000 UTC m=+256.451005997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8822v" (UID: "f00aee38-2c4a-4990-91ea-bd68a9cb9b57") : secret "insights-runtime-extractor-tls" not found
Jul 15 13:15:40.652142 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:40.652096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:40.654535 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:40.654516    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"image-registry-6646dfc66b-7n7bv\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") " pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:40.735035 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:40.735003    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9ff6l\""
Jul 15 13:15:40.742669 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:40.742629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:40.879038 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:40.879008    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:15:40.882867 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:40.882840    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b55a3cc_fd77_4a5d_928e_98f017e9a529.slice/crio-a92cc2cadf6cc034058b95a9f5c7d2b6db2bb2d010e5add79270abca00fc3f87 WatchSource:0}: Error finding container a92cc2cadf6cc034058b95a9f5c7d2b6db2bb2d010e5add79270abca00fc3f87: Status 404 returned error can't find the container with id a92cc2cadf6cc034058b95a9f5c7d2b6db2bb2d010e5add79270abca00fc3f87
Jul 15 13:15:41.496224 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:41.496180    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" event={"ID":"0b55a3cc-fd77-4a5d-928e-98f017e9a529","Type":"ContainerStarted","Data":"9189421602c7363c7ddd4f097db3e51fe7ff4f89094e4bdf4881c907c72391a4"}
Jul 15 13:15:41.496458 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:41.496250    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" event={"ID":"0b55a3cc-fd77-4a5d-928e-98f017e9a529","Type":"ContainerStarted","Data":"a92cc2cadf6cc034058b95a9f5c7d2b6db2bb2d010e5add79270abca00fc3f87"}
Jul 15 13:15:41.496458 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:41.496330    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:15:42.364093 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:42.364057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:15:42.364508 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:42.364177    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 13:15:42.364508 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:15:42.364248    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs podName:bdade2c0-147d-4bd9-b95e-d1694be1fd27 nodeName:}" failed. No retries permitted until 2026-07-15 13:17:44.364234568 +0000 UTC m=+374.281041994 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs") pod "network-metrics-daemon-rbxkm" (UID: "bdade2c0-147d-4bd9-b95e-d1694be1fd27") : secret "metrics-daemon-secret" not found
Jul 15 13:15:46.598471 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.598434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:46.598879 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.598601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:46.599142 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.599123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:46.600708 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.600688    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f00aee38-2c4a-4990-91ea-bd68a9cb9b57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8822v\" (UID: \"f00aee38-2c4a-4990-91ea-bd68a9cb9b57\") " pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:46.689056 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.689002    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8822v"
Jul 15 13:15:46.824514 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.824464    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" podStartSLOduration=22.824442441 podStartE2EDuration="22.824442441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:41.528489579 +0000 UTC m=+251.445297024" watchObservedRunningTime="2026-07-15 13:15:46.824442441 +0000 UTC m=+256.741249888"
Jul 15 13:15:46.824827 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:46.824812    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8822v"]
Jul 15 13:15:46.827786 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:46.827758    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00aee38_2c4a_4990_91ea_bd68a9cb9b57.slice/crio-c1eb57d4b86df7f251a88ff804c7bab41a858f3ad31b70ed618766b4988f160e WatchSource:0}: Error finding container c1eb57d4b86df7f251a88ff804c7bab41a858f3ad31b70ed618766b4988f160e: Status 404 returned error can't find the container with id c1eb57d4b86df7f251a88ff804c7bab41a858f3ad31b70ed618766b4988f160e
Jul 15 13:15:47.517725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:47.517682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8822v" event={"ID":"f00aee38-2c4a-4990-91ea-bd68a9cb9b57","Type":"ContainerStarted","Data":"c1eb57d4b86df7f251a88ff804c7bab41a858f3ad31b70ed618766b4988f160e"}
Jul 15 13:15:52.536177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:52.536141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8822v" event={"ID":"f00aee38-2c4a-4990-91ea-bd68a9cb9b57","Type":"ContainerStarted","Data":"24dec8b2936e620377150c47372bd1d59c395a4b96a62af760030e3a34d6dbee"}
Jul 15 13:15:54.970188 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:54.970154    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:15:55.060349 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.060316    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9bf7bcbff-sm9jk"]
Jul 15 13:15:55.143583 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.143553    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bf7bcbff-sm9jk"]
Jul 15 13:15:55.143726 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.143647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269194 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-image-registry-private-configuration\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269194 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-ca-trust-extracted\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269194 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-bound-sa-token\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269251    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-trusted-ca\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-tls\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269360    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-certificates\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h97h\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-kube-api-access-7h97h\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.269430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.269397    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-installation-pull-secrets\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.370438 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-certificates\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.370438 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h97h\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-kube-api-access-7h97h\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.370676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370480    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-installation-pull-secrets\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-image-registry-private-configuration\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-ca-trust-extracted\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-bound-sa-token\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.370990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-trusted-ca\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.371146    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-tls\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.371303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-ca-trust-extracted\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.371751 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.371388    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-certificates\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.372039 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.372014    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-trusted-ca\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.373415 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.373387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-installation-pull-secrets\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.373558 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.373534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-image-registry-private-configuration\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.373909 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.373885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-registry-tls\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.382741 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.382676    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-bound-sa-token\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.382875 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.382831    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h97h\" (UniqueName: \"kubernetes.io/projected/31d98e7c-3cbc-43c7-9d9b-215d010efd0b-kube-api-access-7h97h\") pod \"image-registry-9bf7bcbff-sm9jk\" (UID: \"31d98e7c-3cbc-43c7-9d9b-215d010efd0b\") " pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:55.452065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:55.452019    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:56.075210 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.075177    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bf7bcbff-sm9jk"]
Jul 15 13:15:56.078699 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:15:56.078668    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d98e7c_3cbc_43c7_9d9b_215d010efd0b.slice/crio-5c49586b248c9f082aefddfee673837c85dd0c3919ef948f1dfcdd30705d9694 WatchSource:0}: Error finding container 5c49586b248c9f082aefddfee673837c85dd0c3919ef948f1dfcdd30705d9694: Status 404 returned error can't find the container with id 5c49586b248c9f082aefddfee673837c85dd0c3919ef948f1dfcdd30705d9694
Jul 15 13:15:56.553216 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.553177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8822v" event={"ID":"f00aee38-2c4a-4990-91ea-bd68a9cb9b57","Type":"ContainerStarted","Data":"747c79f2c03e6596743efeea41a85b37ca36c19f834ea53bc0b4b1dd105e982e"}
Jul 15 13:15:56.554841 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.554808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" event={"ID":"31d98e7c-3cbc-43c7-9d9b-215d010efd0b","Type":"ContainerStarted","Data":"23fb5357ff61abf19f8f6a3bea30f2da87a73f19da63daf90e0615b22fdff4eb"}
Jul 15 13:15:56.554962 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.554851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" event={"ID":"31d98e7c-3cbc-43c7-9d9b-215d010efd0b","Type":"ContainerStarted","Data":"5c49586b248c9f082aefddfee673837c85dd0c3919ef948f1dfcdd30705d9694"}
Jul 15 13:15:56.554962 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.554934    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:15:56.580878 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:56.580815    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" podStartSLOduration=1.580793496 podStartE2EDuration="1.580793496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:56.579051362 +0000 UTC m=+266.495858811" watchObservedRunningTime="2026-07-15 13:15:56.580793496 +0000 UTC m=+266.497600947"
Jul 15 13:15:59.567051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:59.567017    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8822v" event={"ID":"f00aee38-2c4a-4990-91ea-bd68a9cb9b57","Type":"ContainerStarted","Data":"b4f983b2daefa45080ce291c56dcebeb71d4ef22d73add2406f7ea803d5b6a69"}
Jul 15 13:15:59.590536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:15:59.590489    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8822v" podStartSLOduration=17.138628384 podStartE2EDuration="29.590475079s" totalImagesPullingTime="12.451846695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:15:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:15:59.588885649 +0000 UTC m=+269.505693097" watchObservedRunningTime="2026-07-15 13:15:59.590475079 +0000 UTC m=+269.507282527"
Jul 15 13:16:04.975783 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:04.975747    2571 patch_prober.go:28] interesting pod/image-registry-6646dfc66b-7n7bv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:04.976324 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:04.975812    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:10.551821 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.551783    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"]
Jul 15 13:16:10.555367 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.555347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.559192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.559148    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 13:16:10.559393 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.559372    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 13:16:10.560731 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.560706    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 13:16:10.560909 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.560712    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 13:16:10.560983 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.560770    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gzng4\""
Jul 15 13:16:10.560983 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.560816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 13:16:10.561094 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.560827    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 13:16:10.570092 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.570061    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q97xr"]
Jul 15 13:16:10.578139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.578072    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"]
Jul 15 13:16:10.578328 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.578192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.581837 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.581816    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 13:16:10.582153 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.582135    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 13:16:10.582489 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.582471    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cqkv2\""
Jul 15 13:16:10.583393 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.583376    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 13:16:10.693605 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693767 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693615    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-tls\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693767 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.693767 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693709    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-root\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693767 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8e016a6-2738-4e0f-8de0-52d223e050d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693820    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-metrics-client-ca\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693862    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-sys\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-accelerators-collector-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.693955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-textfile\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.694156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.693982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-648xg\" (UniqueName: \"kubernetes.io/projected/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-api-access-648xg\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.694156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.694006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-wtmp\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.694156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.694059    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnths\" (UniqueName: \"kubernetes.io/projected/106f4e77-5ee8-4836-8b3b-572de9a3d400-kube-api-access-xnths\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.694156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.694117    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-648xg\" (UniqueName: \"kubernetes.io/projected/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-api-access-648xg\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-wtmp\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795248    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnths\" (UniqueName: \"kubernetes.io/projected/106f4e77-5ee8-4836-8b3b-572de9a3d400-kube-api-access-xnths\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795390    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-wtmp\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-tls\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-root\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8e016a6-2738-4e0f-8de0-52d223e050d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795632    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-root\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-metrics-client-ca\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.795732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795708    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.796071 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-sys\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796071 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795777    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-accelerators-collector-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796071 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.795815    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-textfile\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796151    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-textfile\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/106f4e77-5ee8-4836-8b3b-572de9a3d400-sys\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796358 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.796624 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796599    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8e016a6-2738-4e0f-8de0-52d223e050d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.796713 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796687    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a8e016a6-2738-4e0f-8de0-52d223e050d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.796771 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796731    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-metrics-client-ca\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.796939 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.796919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-accelerators-collector-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.797899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.797876    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.797991 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.797885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.798242 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.798221    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/106f4e77-5ee8-4836-8b3b-572de9a3d400-node-exporter-tls\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.798242 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.798236    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.807958 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.807897    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnths\" (UniqueName: \"kubernetes.io/projected/106f4e77-5ee8-4836-8b3b-572de9a3d400-kube-api-access-xnths\") pod \"node-exporter-q97xr\" (UID: \"106f4e77-5ee8-4836-8b3b-572de9a3d400\") " pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.808129 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.808111    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-648xg\" (UniqueName: \"kubernetes.io/projected/a8e016a6-2738-4e0f-8de0-52d223e050d8-kube-api-access-648xg\") pod \"kube-state-metrics-785778ff74-ccjs9\" (UID: \"a8e016a6-2738-4e0f-8de0-52d223e050d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.866982 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.866943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"
Jul 15 13:16:10.888758 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:10.888729    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q97xr"
Jul 15 13:16:10.899063 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:16:10.899031    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106f4e77_5ee8_4836_8b3b_572de9a3d400.slice/crio-bd4bbf7d9dddc1fa5e3943cf61239057438330af277be1577e7733d431493e96 WatchSource:0}: Error finding container bd4bbf7d9dddc1fa5e3943cf61239057438330af277be1577e7733d431493e96: Status 404 returned error can't find the container with id bd4bbf7d9dddc1fa5e3943cf61239057438330af277be1577e7733d431493e96
Jul 15 13:16:11.006321 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:11.006297    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ccjs9"]
Jul 15 13:16:11.008475 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:16:11.008452    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e016a6_2738_4e0f_8de0_52d223e050d8.slice/crio-72ae45c367e9e880e835834173b3bf47a99e8a72bf5d7676439ca1b28197251c WatchSource:0}: Error finding container 72ae45c367e9e880e835834173b3bf47a99e8a72bf5d7676439ca1b28197251c: Status 404 returned error can't find the container with id 72ae45c367e9e880e835834173b3bf47a99e8a72bf5d7676439ca1b28197251c
Jul 15 13:16:11.608162 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:11.608121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q97xr" event={"ID":"106f4e77-5ee8-4836-8b3b-572de9a3d400","Type":"ContainerStarted","Data":"bd4bbf7d9dddc1fa5e3943cf61239057438330af277be1577e7733d431493e96"}
Jul 15 13:16:11.609717 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:11.609687    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9" event={"ID":"a8e016a6-2738-4e0f-8de0-52d223e050d8","Type":"ContainerStarted","Data":"72ae45c367e9e880e835834173b3bf47a99e8a72bf5d7676439ca1b28197251c"}
Jul 15 13:16:12.615511 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.615420    2571 generic.go:356] "Generic (PLEG): container finished" podID="106f4e77-5ee8-4836-8b3b-572de9a3d400" containerID="a5da5513d0f5a1e4db574528ef83824a54a4298f4c5b324a68688fb06a69a59f" exitCode=0
Jul 15 13:16:12.615933 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.615509    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q97xr" event={"ID":"106f4e77-5ee8-4836-8b3b-572de9a3d400","Type":"ContainerDied","Data":"a5da5513d0f5a1e4db574528ef83824a54a4298f4c5b324a68688fb06a69a59f"}
Jul 15 13:16:12.617728 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.617704    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9" event={"ID":"a8e016a6-2738-4e0f-8de0-52d223e050d8","Type":"ContainerStarted","Data":"61ee05ae88ea22c019c689c96bce4f2052c755c52818a014592c19ebb805cf9b"}
Jul 15 13:16:12.617842 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.617767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9" event={"ID":"a8e016a6-2738-4e0f-8de0-52d223e050d8","Type":"ContainerStarted","Data":"1a2cf4dc39a3080c13ce42a33b79b8222c1dd8ae972ba28d39a0b7c8803b1aa6"}
Jul 15 13:16:12.617842 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.617800    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9" event={"ID":"a8e016a6-2738-4e0f-8de0-52d223e050d8","Type":"ContainerStarted","Data":"bfd396190737cd485dcce13e59f106852ed2a9511bf2942d0686f4673d8e7852"}
Jul 15 13:16:12.662410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:12.662161    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-ccjs9" podStartSLOduration=1.314116345 podStartE2EDuration="2.662137907s" totalImagesPullingTime="1.348021562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:12.660226317 +0000 UTC m=+282.577033770" watchObservedRunningTime="2026-07-15 13:16:12.662137907 +0000 UTC m=+282.578945360"
Jul 15 13:16:13.546312 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.546255    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"]
Jul 15 13:16:13.548981 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.548958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.552599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.552576    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 13:16:13.552599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.552583    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c8pag15u2agga\""
Jul 15 13:16:13.553862 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.553846    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 13:16:13.553946 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.553925    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 13:16:13.554061 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.554046    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-th8k7\""
Jul 15 13:16:13.554144 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.554086    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 13:16:13.554144 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.554119    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 13:16:13.565701 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.565676    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"]
Jul 15 13:16:13.623987 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.623952    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q97xr" event={"ID":"106f4e77-5ee8-4836-8b3b-572de9a3d400","Type":"ContainerStarted","Data":"e2e12e2d478de335b4765a5ba41aa6766ae2a91085dfaa4ec5ae2863bed644e4"}
Jul 15 13:16:13.624462 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.624015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q97xr" event={"ID":"106f4e77-5ee8-4836-8b3b-572de9a3d400","Type":"ContainerStarted","Data":"c82e288b7a022f580876a496a3604f5d6e7202e28ef89c8a0acdb9d613d95b26"}
Jul 15 13:16:13.648755 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.648694    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q97xr" podStartSLOduration=2.778608199 podStartE2EDuration="3.648672384s" totalImagesPullingTime="793.93697ms" totalInitContainerRuntime="76.127215ms" isStatefulPod=true podCreationTimestamp="2026-07-15 13:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:13.647483061 +0000 UTC m=+283.564290547" watchObservedRunningTime="2026-07-15 13:16:13.648672384 +0000 UTC m=+283.565479832"
Jul 15 13:16:13.719978 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.719937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-metrics-client-ca\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.719978 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.719982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720017    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720417 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720417 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720417 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-grpc-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.720614 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.720592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9tmc\" (UniqueName: \"kubernetes.io/projected/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-kube-api-access-q9tmc\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.821676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821576    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.821676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.821899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.821899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-grpc-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.821899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9tmc\" (UniqueName: \"kubernetes.io/projected/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-kube-api-access-q9tmc\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.822052 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-metrics-client-ca\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.822052 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.822052 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.821975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.822848 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.822817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-metrics-client-ca\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.824524 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.824499    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.824907 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.824877    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.824987 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.824885    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.824987 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.824950    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-grpc-tls\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.825060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.825003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.825060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.825012    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.831739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.831716    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9tmc\" (UniqueName: \"kubernetes.io/projected/c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69-kube-api-access-q9tmc\") pod \"thanos-querier-7dd8486fb9-5ql9f\" (UID: \"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69\") " pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.858677 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.858638    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:13.998008 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:13.997981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"]
Jul 15 13:16:14.000125 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:16:14.000096    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d26dd5_d052_4bfa_9fe2_c1e620a3ca69.slice/crio-89d1abf7ad8018803fd48c367ccda4b61f91f406a7b3b51a2c5ca9f093d20db9 WatchSource:0}: Error finding container 89d1abf7ad8018803fd48c367ccda4b61f91f406a7b3b51a2c5ca9f093d20db9: Status 404 returned error can't find the container with id 89d1abf7ad8018803fd48c367ccda4b61f91f406a7b3b51a2c5ca9f093d20db9
Jul 15 13:16:14.628764 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:14.628725    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"89d1abf7ad8018803fd48c367ccda4b61f91f406a7b3b51a2c5ca9f093d20db9"}
Jul 15 13:16:14.975121 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:14.975040    2571 patch_prober.go:28] interesting pod/image-registry-6646dfc66b-7n7bv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:14.975121 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:14.975101    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:15.251917 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:16:15.251826    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6rpmd" podUID="dbdd5d91-be5d-42f3-94c6-81d754b3046c"
Jul 15 13:16:15.458217 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:15.457848    2571 patch_prober.go:28] interesting pod/image-registry-9bf7bcbff-sm9jk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:15.458217 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:15.457963    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" podUID="31d98e7c-3cbc-43c7-9d9b-215d010efd0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:15.633348 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:15.633314    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:17.563848 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.563765    2571 patch_prober.go:28] interesting pod/image-registry-9bf7bcbff-sm9jk container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:17.563848 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.563816    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" podUID="31d98e7c-3cbc-43c7-9d9b-215d010efd0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:17.642746 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.642709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"f0bc30f4bd2e70c258e3455893bc641de80323658c99ecbe94140dd159ae5d14"}
Jul 15 13:16:17.642913 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.642775    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"9bc75f8d8eb5045459a425517eb10142125a68ee1e8a50debbcc51cca4f82ad2"}
Jul 15 13:16:17.642913 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.642802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"19ef6eb2bcdf4e30ac7bb076b8abc9caeb6783701a253eb80ca80f113182cde2"}
Jul 15 13:16:17.794936 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.794903    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:16:17.797059 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.797043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.800111 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.800087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 13:16:17.800237 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.800182    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 13:16:17.800344 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.800234    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 13:16:17.800489 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.800467    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 13:16:17.801468 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.801453    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\""
Jul 15 13:16:17.801641 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.801624    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 13:16:17.801766 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.801750    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 13:16:17.803032 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.803012    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 13:16:17.807356 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.807335    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 13:16:17.814861 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.814799    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:16:17.852958 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.852926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fv8l\" (UniqueName: \"kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853130 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.852979    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853130 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.853055    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853130 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.853087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853130 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.853123    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853258 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.853143    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.853258 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.853165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.953920 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.953882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.953935    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.953954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.953971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fv8l\" (UniqueName: \"kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954692    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.954960 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.955047 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.954993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.955159 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.955101    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.957328 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.957270    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.957468 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.957448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:17.964858 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:17.964827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fv8l\" (UniqueName: \"kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l\") pod \"console-869b8d6d7b-9d6kr\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") " pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:18.106062 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.106021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:18.249207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.249179    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:16:18.260312 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:16:18.260258    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4db27f_433b_4290_8298_e993ab47d20c.slice/crio-3974e6f19082a88bc7ca3dd6105e0eae04fb5296e4a547d65b4595406a289772 WatchSource:0}: Error finding container 3974e6f19082a88bc7ca3dd6105e0eae04fb5296e4a547d65b4595406a289772: Status 404 returned error can't find the container with id 3974e6f19082a88bc7ca3dd6105e0eae04fb5296e4a547d65b4595406a289772
Jul 15 13:16:18.557661 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.557568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:18.559866 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.559847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dbdd5d91-be5d-42f3-94c6-81d754b3046c-metrics-tls\") pod \"dns-default-6rpmd\" (UID: \"dbdd5d91-be5d-42f3-94c6-81d754b3046c\") " pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:18.638683 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.638651    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bdsl2\""
Jul 15 13:16:18.644587 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.644563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:18.654734 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.654706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"90a8cd4388adb6f89deb0ce63c5485493bdc3cb4137a947e3892abd69bae134f"}
Jul 15 13:16:18.654919 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.654808    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"18ed8748edeba89142a6694104204fb7bd40fb8621aa8add1743de697ebd4977"}
Jul 15 13:16:18.654993 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.654968    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:18.655059 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.655030    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" event={"ID":"c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69","Type":"ContainerStarted","Data":"97d2e9e656ac0afdf392e9bdaf7addb180dc8f61af49d5b1921d2928ab2e2ad7"}
Jul 15 13:16:18.656044 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.656022    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869b8d6d7b-9d6kr" event={"ID":"7a4db27f-433b-4290-8298-e993ab47d20c","Type":"ContainerStarted","Data":"3974e6f19082a88bc7ca3dd6105e0eae04fb5296e4a547d65b4595406a289772"}
Jul 15 13:16:18.685088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.685018    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f" podStartSLOduration=1.716285313 podStartE2EDuration="5.684996243s" totalImagesPullingTime="3.96871093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:18.683137026 +0000 UTC m=+288.599944478" watchObservedRunningTime="2026-07-15 13:16:18.684996243 +0000 UTC m=+288.601803694"
Jul 15 13:16:18.777327 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:18.777295    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6rpmd"]
Jul 15 13:16:18.780367 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:16:18.780335    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdd5d91_be5d_42f3_94c6_81d754b3046c.slice/crio-555f0787c49b6f8ca8a1f952dcb265435d566a9849b2b621ff4e6ffcb372fd6f WatchSource:0}: Error finding container 555f0787c49b6f8ca8a1f952dcb265435d566a9849b2b621ff4e6ffcb372fd6f: Status 404 returned error can't find the container with id 555f0787c49b6f8ca8a1f952dcb265435d566a9849b2b621ff4e6ffcb372fd6f
Jul 15 13:16:19.662143 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:19.662053    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rpmd" event={"ID":"dbdd5d91-be5d-42f3-94c6-81d754b3046c","Type":"ContainerStarted","Data":"555f0787c49b6f8ca8a1f952dcb265435d566a9849b2b621ff4e6ffcb372fd6f"}
Jul 15 13:16:19.990759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:19.990655    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry" containerID="cri-o://9189421602c7363c7ddd4f097db3e51fe7ff4f89094e4bdf4881c907c72391a4" gracePeriod=30
Jul 15 13:16:20.667840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:20.667747    2571 generic.go:356] "Generic (PLEG): container finished" podID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerID="9189421602c7363c7ddd4f097db3e51fe7ff4f89094e4bdf4881c907c72391a4" exitCode=0
Jul 15 13:16:20.667840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:20.667806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" event={"ID":"0b55a3cc-fd77-4a5d-928e-98f017e9a529","Type":"ContainerDied","Data":"9189421602c7363c7ddd4f097db3e51fe7ff4f89094e4bdf4881c907c72391a4"}
Jul 15 13:16:21.600622 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.600601    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:16:21.674826 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.674592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869b8d6d7b-9d6kr" event={"ID":"7a4db27f-433b-4290-8298-e993ab47d20c","Type":"ContainerStarted","Data":"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"}
Jul 15 13:16:21.678376 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.677823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rpmd" event={"ID":"dbdd5d91-be5d-42f3-94c6-81d754b3046c","Type":"ContainerStarted","Data":"5514b16fc0ba835482a73288086c7837c42b0b48b099c15ec6cf0554609ac32d"}
Jul 15 13:16:21.680087 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.680054    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv" event={"ID":"0b55a3cc-fd77-4a5d-928e-98f017e9a529","Type":"ContainerDied","Data":"a92cc2cadf6cc034058b95a9f5c7d2b6db2bb2d010e5add79270abca00fc3f87"}
Jul 15 13:16:21.680087 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.680079    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6646dfc66b-7n7bv"
Jul 15 13:16:21.680258 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.680207    2571 scope.go:117] "RemoveContainer" containerID="9189421602c7363c7ddd4f097db3e51fe7ff4f89094e4bdf4881c907c72391a4"
Jul 15 13:16:21.683789 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683767    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.683888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683828    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42jm8\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.683888 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683870    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.684001 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683909    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.684001 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683941    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.684001 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.683984    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.684154 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.684009    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.684154 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.684061    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration\") pod \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\" (UID: \"0b55a3cc-fd77-4a5d-928e-98f017e9a529\") "
Jul 15 13:16:21.685115 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.684539    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:21.685115 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.684699    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:16:21.686663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.686637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:21.686832 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.686788    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8" (OuterVolumeSpecName: "kube-api-access-42jm8") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "kube-api-access-42jm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:21.687539 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.687513    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:21.687905 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.687877    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:16:21.689115 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.689042    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:16:21.696048 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.695996    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869b8d6d7b-9d6kr" podStartSLOduration=1.461552821 podStartE2EDuration="4.695973748s" totalImagesPullingTime="3.234420927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:21.694449387 +0000 UTC m=+291.611256859" watchObservedRunningTime="2026-07-15 13:16:21.695973748 +0000 UTC m=+291.612781197"
Jul 15 13:16:21.697116 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.697092    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0b55a3cc-fd77-4a5d-928e-98f017e9a529" (UID: "0b55a3cc-fd77-4a5d-928e-98f017e9a529"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:16:21.784943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784900    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42jm8\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-kube-api-access-42jm8\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.784943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784932    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.784943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784942    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b55a3cc-fd77-4a5d-928e-98f017e9a529-bound-sa-token\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.784943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784951    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-trusted-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.785192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784960    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b55a3cc-fd77-4a5d-928e-98f017e9a529-registry-certificates\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.785192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784969    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b55a3cc-fd77-4a5d-928e-98f017e9a529-ca-trust-extracted\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.785192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784978    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-image-registry-private-configuration\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:21.785192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:21.784987    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b55a3cc-fd77-4a5d-928e-98f017e9a529-installation-pull-secrets\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:16:22.004702 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.004666    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:16:22.011113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.011085    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6646dfc66b-7n7bv"]
Jul 15 13:16:22.690024 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.689983    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6rpmd" event={"ID":"dbdd5d91-be5d-42f3-94c6-81d754b3046c","Type":"ContainerStarted","Data":"bd81df9f06ea9e5bbfefc7019431f3ea432201931697a2d2d047f5b0c8817ec6"}
Jul 15 13:16:22.690453 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.690099    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:22.711148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.711094    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6rpmd" podStartSLOduration=252.002861872 podStartE2EDuration="4m14.711079834s" totalImagesPullingTime="2.708217962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:16:22.709691161 +0000 UTC m=+292.626498645" watchObservedRunningTime="2026-07-15 13:16:22.711079834 +0000 UTC m=+292.627887282"
Jul 15 13:16:22.715602 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:22.715576    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" path="/var/lib/kubelet/pods/0b55a3cc-fd77-4a5d-928e-98f017e9a529/volumes"
Jul 15 13:16:24.669748 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:24.669721    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7dd8486fb9-5ql9f"
Jul 15 13:16:25.456357 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:25.456323    2571 patch_prober.go:28] interesting pod/image-registry-9bf7bcbff-sm9jk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 13:16:25.456541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:25.456381    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk" podUID="31d98e7c-3cbc-43c7-9d9b-215d010efd0b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:16:27.562979 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:27.562949    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9bf7bcbff-sm9jk"
Jul 15 13:16:28.107088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:28.107058    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:28.107252 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:28.107119    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:28.111687 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:28.111661    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:28.718513 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:28.718486    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:16:30.521562 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:30.521532    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:16:30.521992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:30.521760    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:16:30.525825 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:30.525808    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 13:16:30.712041 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:16:30.711867    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rbxkm" podUID="bdade2c0-147d-4bd9-b95e-d1694be1fd27"
Jul 15 13:16:32.696252 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:32.696216    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6rpmd"
Jul 15 13:16:41.761048 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:41.761012    2571 generic.go:356] "Generic (PLEG): container finished" podID="68deb73d-6690-477f-8427-836f664228b0" containerID="a83355599295fef868f69e543c62bdcb39aab7d9af1c4d0c8ce3b84cf770c599" exitCode=0
Jul 15 13:16:41.761457 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:41.761083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2" event={"ID":"68deb73d-6690-477f-8427-836f664228b0","Type":"ContainerDied","Data":"a83355599295fef868f69e543c62bdcb39aab7d9af1c4d0c8ce3b84cf770c599"}
Jul 15 13:16:41.761457 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:41.761409    2571 scope.go:117] "RemoveContainer" containerID="a83355599295fef868f69e543c62bdcb39aab7d9af1c4d0c8ce3b84cf770c599"
Jul 15 13:16:42.766405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:42.766374    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-c7lz2" event={"ID":"68deb73d-6690-477f-8427-836f664228b0","Type":"ContainerStarted","Data":"e1ec65fcc383180a380b5e87e1836d513d4b61d55fc086b55143de194a522b5c"}
Jul 15 13:16:43.711204 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:16:43.711155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:17:34.866041 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.865996    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-749ff455f4-9hblf"]
Jul 15 13:17:34.866657 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.866394    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry"
Jul 15 13:17:34.866657 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.866412    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry"
Jul 15 13:17:34.866657 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.866501    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b55a3cc-fd77-4a5d-928e-98f017e9a529" containerName="registry"
Jul 15 13:17:34.868712 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.868686    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.873721 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.873688    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 13:17:34.873900 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.873876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kdtlh\""
Jul 15 13:17:34.874017 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.873997    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 13:17:34.874075 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.873882    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 13:17:34.874154 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.874005    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 13:17:34.874205 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.874164    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 13:17:34.879495 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.879474    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 13:17:34.882570 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.882546    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-749ff455f4-9hblf"]
Jul 15 13:17:34.999080 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.998991    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nggn9\" (UniqueName: \"kubernetes.io/projected/3ec35c80-5bb9-465d-8363-9d330e8364f9-kube-api-access-nggn9\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999080 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999065    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-metrics-client-ca\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-serving-certs-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-federate-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999220    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:34.999260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:34.999247    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-metrics-client-ca\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-serving-certs-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100507    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-federate-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.100686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.100672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nggn9\" (UniqueName: \"kubernetes.io/projected/3ec35c80-5bb9-465d-8363-9d330e8364f9-kube-api-access-nggn9\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.101347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.101297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-serving-certs-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.101653 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.101622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-metrics-client-ca\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.101806 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.101782    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.103212 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.103185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-telemeter-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.103309 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.103185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-federate-client-tls\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.103309 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.103287    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.103422 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.103406    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ec35c80-5bb9-465d-8363-9d330e8364f9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.111598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.111574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nggn9\" (UniqueName: \"kubernetes.io/projected/3ec35c80-5bb9-465d-8363-9d330e8364f9-kube-api-access-nggn9\") pod \"telemeter-client-749ff455f4-9hblf\" (UID: \"3ec35c80-5bb9-465d-8363-9d330e8364f9\") " pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.181809 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.181776    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf"
Jul 15 13:17:35.323970 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.323929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-749ff455f4-9hblf"]
Jul 15 13:17:35.327510 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:17:35.327485    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec35c80_5bb9_465d_8363_9d330e8364f9.slice/crio-053055fd6ed4d93c24a1182f86c6c1e67ffdc162487f58b83f4ac5b7e6ee7533 WatchSource:0}: Error finding container 053055fd6ed4d93c24a1182f86c6c1e67ffdc162487f58b83f4ac5b7e6ee7533: Status 404 returned error can't find the container with id 053055fd6ed4d93c24a1182f86c6c1e67ffdc162487f58b83f4ac5b7e6ee7533
Jul 15 13:17:35.329492 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.329478    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:17:35.957443 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:35.957408    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf" event={"ID":"3ec35c80-5bb9-465d-8363-9d330e8364f9","Type":"ContainerStarted","Data":"053055fd6ed4d93c24a1182f86c6c1e67ffdc162487f58b83f4ac5b7e6ee7533"}
Jul 15 13:17:37.968222 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:37.968185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf" event={"ID":"3ec35c80-5bb9-465d-8363-9d330e8364f9","Type":"ContainerStarted","Data":"ba88f7c72b7f0c36282147f9942c82d0f073b42149e1a74ea2c168070d6ae67c"}
Jul 15 13:17:40.980185 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:40.980092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf" event={"ID":"3ec35c80-5bb9-465d-8363-9d330e8364f9","Type":"ContainerStarted","Data":"dab1b97d05db0072c9c3509adf35f3553467a7f4b8d3397183b0e6c3c4ea94ca"}
Jul 15 13:17:40.980185 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:40.980168    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf" event={"ID":"3ec35c80-5bb9-465d-8363-9d330e8364f9","Type":"ContainerStarted","Data":"0b858da9edbe3f463cf14c5210e65efb39c92c5b47c9625648571400548048ea"}
Jul 15 13:17:41.011959 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:41.011897    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-749ff455f4-9hblf" podStartSLOduration=1.771021177 podStartE2EDuration="7.011882087s" totalImagesPullingTime="5.24086091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:17:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:41.00974874 +0000 UTC m=+370.926556219" watchObservedRunningTime="2026-07-15 13:17:41.011882087 +0000 UTC m=+370.928689535"
Jul 15 13:17:44.383190 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.383150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:17:44.385439 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.385416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bdade2c0-147d-4bd9-b95e-d1694be1fd27-metrics-certs\") pod \"network-metrics-daemon-rbxkm\" (UID: \"bdade2c0-147d-4bd9-b95e-d1694be1fd27\") " pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:17:44.615991 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.615953    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hh9ms\""
Jul 15 13:17:44.622648 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.622626    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbxkm"
Jul 15 13:17:44.756929 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.756733    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbxkm"]
Jul 15 13:17:44.760219 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:17:44.760190    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdade2c0_147d_4bd9_b95e_d1694be1fd27.slice/crio-a6485c07cd3cb65c81ef10b5bf6663437c162b8a44612ff301452668bb1a1816 WatchSource:0}: Error finding container a6485c07cd3cb65c81ef10b5bf6663437c162b8a44612ff301452668bb1a1816: Status 404 returned error can't find the container with id a6485c07cd3cb65c81ef10b5bf6663437c162b8a44612ff301452668bb1a1816
Jul 15 13:17:44.996510 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:44.996428    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbxkm" event={"ID":"bdade2c0-147d-4bd9-b95e-d1694be1fd27","Type":"ContainerStarted","Data":"a6485c07cd3cb65c81ef10b5bf6663437c162b8a44612ff301452668bb1a1816"}
Jul 15 13:17:46.001729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:46.001638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbxkm" event={"ID":"bdade2c0-147d-4bd9-b95e-d1694be1fd27","Type":"ContainerStarted","Data":"34697bc3d8b1e9a161ecc159d3ea7c591057b0204e2bff7ba26777781460789f"}
Jul 15 13:17:46.001729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:46.001691    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbxkm" event={"ID":"bdade2c0-147d-4bd9-b95e-d1694be1fd27","Type":"ContainerStarted","Data":"337727c2ad6d4d7aaa43bb3863086dc35c1d3810e4a7d257198214d50240f34e"}
Jul 15 13:17:46.022878 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:46.022822    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rbxkm" podStartSLOduration=374.146585757 podStartE2EDuration="6m15.022805528s" totalImagesPullingTime="876.219771ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:17:46.020740992 +0000 UTC m=+375.937548440" watchObservedRunningTime="2026-07-15 13:17:46.022805528 +0000 UTC m=+375.939612976"
Jul 15 13:17:52.709669 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:17:52.709629    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:18:17.730372 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:17.730330    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-869b8d6d7b-9d6kr" podUID="7a4db27f-433b-4290-8298-e993ab47d20c" containerName="console" containerID="cri-o://270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6" gracePeriod=15
Jul 15 13:18:17.971174 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:17.971146    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:18:18.046722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046634    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046691    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046716    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046820    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fv8l\" (UniqueName: \"kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046898    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.046985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.046936    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert\") pod \"7a4db27f-433b-4290-8298-e993ab47d20c\" (UID: \"7a4db27f-433b-4290-8298-e993ab47d20c\") "
Jul 15 13:18:18.047178 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047055    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca" (OuterVolumeSpecName: "service-ca") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:18:18.047178 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047140    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config" (OuterVolumeSpecName: "console-config") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:18:18.047308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047170    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:18:18.047308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:18:18.047388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047326    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.047388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047339    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-trusted-ca-bundle\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.047388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.047348    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-console-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.049171 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.049144    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l" (OuterVolumeSpecName: "kube-api-access-7fv8l") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "kube-api-access-7fv8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:18:18.049251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.049191    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:18:18.049251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.049232    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7a4db27f-433b-4290-8298-e993ab47d20c" (UID: "7a4db27f-433b-4290-8298-e993ab47d20c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:18:18.118819 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.118782    2571 generic.go:356] "Generic (PLEG): container finished" podID="7a4db27f-433b-4290-8298-e993ab47d20c" containerID="270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6" exitCode=0
Jul 15 13:18:18.119010 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.118837    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869b8d6d7b-9d6kr"
Jul 15 13:18:18.119010 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.118866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869b8d6d7b-9d6kr" event={"ID":"7a4db27f-433b-4290-8298-e993ab47d20c","Type":"ContainerDied","Data":"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"}
Jul 15 13:18:18.119010 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.118917    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869b8d6d7b-9d6kr" event={"ID":"7a4db27f-433b-4290-8298-e993ab47d20c","Type":"ContainerDied","Data":"3974e6f19082a88bc7ca3dd6105e0eae04fb5296e4a547d65b4595406a289772"}
Jul 15 13:18:18.119010 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.118937    2571 scope.go:117] "RemoveContainer" containerID="270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"
Jul 15 13:18:18.127299 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.127254    2571 scope.go:117] "RemoveContainer" containerID="270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"
Jul 15 13:18:18.127566 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:18:18.127545    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6\": container with ID starting with 270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6 not found: ID does not exist" containerID="270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"
Jul 15 13:18:18.127621 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.127575    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6"} err="failed to get container status \"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6\": rpc error: code = NotFound desc = could not find container \"270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6\": container with ID starting with 270b64e22cb21a470b9c64f409fce6475748a4256492fb14527ea65f224d3aa6 not found: ID does not exist"
Jul 15 13:18:18.141318 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.141291    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:18:18.145401 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.145377    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869b8d6d7b-9d6kr"]
Jul 15 13:18:18.148411 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.148393    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fv8l\" (UniqueName: \"kubernetes.io/projected/7a4db27f-433b-4290-8298-e993ab47d20c-kube-api-access-7fv8l\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.148463 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.148413    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db27f-433b-4290-8298-e993ab47d20c-oauth-serving-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.148463 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.148424    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-oauth-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.148463 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.148432    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7a4db27f-433b-4290-8298-e993ab47d20c-console-serving-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:18:18.715442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:18.715404    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4db27f-433b-4290-8298-e993ab47d20c" path="/var/lib/kubelet/pods/7a4db27f-433b-4290-8298-e993ab47d20c/volumes"
Jul 15 13:18:54.640789 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.640711    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:18:54.641193 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.640985    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4db27f-433b-4290-8298-e993ab47d20c" containerName="console"
Jul 15 13:18:54.641193 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.640997    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4db27f-433b-4290-8298-e993ab47d20c" containerName="console"
Jul 15 13:18:54.641193 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.641059    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4db27f-433b-4290-8298-e993ab47d20c" containerName="console"
Jul 15 13:18:54.644029 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.644012    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.649357 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.649336    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 13:18:54.649480 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.649339    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhdpv\""
Jul 15 13:18:54.649811 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.649791    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 13:18:54.650366 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.650046    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 13:18:54.650541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.650524    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 13:18:54.650683 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.650668    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 13:18:54.651007 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.650992    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 13:18:54.651306 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.651269    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 13:18:54.659655 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.659628    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:18:54.662556 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.662533    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 13:18:54.731993 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.731961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.731993 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.731995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.732233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.732013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.732233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.732117    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.732233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.732183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.732233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.732217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.732408 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.732238    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833511 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833571    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833672 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.833960 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.833678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.834389 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.834360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.834503 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.834363    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.834503 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.834366    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.834840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.834818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.836040 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.836017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.836196 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.836181    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.843460 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.843433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv\") pod \"console-645497fc-s4t9t\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") " pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:54.953019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:54.952920    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:18:55.094757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:55.094724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:18:55.098089 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:18:55.098060    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853e5625_2d57_4948_a37f_cebea75325b0.slice/crio-b78369a4be27fd18458fa5d237ce65489957443e49d24c2d59544f8d6518b256 WatchSource:0}: Error finding container b78369a4be27fd18458fa5d237ce65489957443e49d24c2d59544f8d6518b256: Status 404 returned error can't find the container with id b78369a4be27fd18458fa5d237ce65489957443e49d24c2d59544f8d6518b256
Jul 15 13:18:55.248935 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:55.248850    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645497fc-s4t9t" event={"ID":"853e5625-2d57-4948-a37f-cebea75325b0","Type":"ContainerStarted","Data":"74c009d8d715424f9aadba2002b8f7df34ac3a3477229be3f8d618cf0b90cf68"}
Jul 15 13:18:55.248935 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:55.248903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645497fc-s4t9t" event={"ID":"853e5625-2d57-4948-a37f-cebea75325b0","Type":"ContainerStarted","Data":"b78369a4be27fd18458fa5d237ce65489957443e49d24c2d59544f8d6518b256"}
Jul 15 13:18:55.277701 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:18:55.277647    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-645497fc-s4t9t" podStartSLOduration=1.27762777 podStartE2EDuration="1.27762777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:18:55.275476874 +0000 UTC m=+445.192284322" watchObservedRunningTime="2026-07-15 13:18:55.27762777 +0000 UTC m=+445.194435217"
Jul 15 13:19:04.953466 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:19:04.953409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:19:04.953466 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:19:04.953484    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:19:04.958195 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:19:04.958168    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:19:05.290980 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:19:05.290900    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:20:38.053177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.053142    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npxkx"]
Jul 15 13:20:38.055776 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.055758    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.059448 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.059422    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 13:20:38.059555 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.059462    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 13:20:38.064266 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.064233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-l7gbb\""
Jul 15 13:20:38.068608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.068581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npxkx"]
Jul 15 13:20:38.150196 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.150163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.150393 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.150209    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fngs\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-kube-api-access-6fngs\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.251140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.251105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.251313 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.251152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fngs\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-kube-api-access-6fngs\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.271174 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.271144    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-bound-sa-token\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.272260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.272242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fngs\" (UniqueName: \"kubernetes.io/projected/69b7f5ca-ad6e-46ce-b23b-623b4151ab9c-kube-api-access-6fngs\") pod \"cert-manager-55b4d954d5-npxkx\" (UID: \"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c\") " pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.368283 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.368252    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-npxkx"
Jul 15 13:20:38.496096 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.496066    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-npxkx"]
Jul 15 13:20:38.499241 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:20:38.499214    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69b7f5ca_ad6e_46ce_b23b_623b4151ab9c.slice/crio-5eaef8ed7be980756f842fda892ce940406770ee88b62e761fac0b6b31584391 WatchSource:0}: Error finding container 5eaef8ed7be980756f842fda892ce940406770ee88b62e761fac0b6b31584391: Status 404 returned error can't find the container with id 5eaef8ed7be980756f842fda892ce940406770ee88b62e761fac0b6b31584391
Jul 15 13:20:38.634070 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:38.633978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npxkx" event={"ID":"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c","Type":"ContainerStarted","Data":"5eaef8ed7be980756f842fda892ce940406770ee88b62e761fac0b6b31584391"}
Jul 15 13:20:41.647964 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:41.647924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-npxkx" event={"ID":"69b7f5ca-ad6e-46ce-b23b-623b4151ab9c","Type":"ContainerStarted","Data":"60a52005f64fbd29bb6cec4aeda85614e8d281aa00422c3bc8b46592d90b50fa"}
Jul 15 13:20:41.665565 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:20:41.665516    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-npxkx" podStartSLOduration=0.688206142 podStartE2EDuration="3.665500678s" totalImagesPullingTime="2.977294536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:20:41.664315111 +0000 UTC m=+551.581122550" watchObservedRunningTime="2026-07-15 13:20:41.665500678 +0000 UTC m=+551.582308125"
Jul 15 13:21:02.040866 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.040831    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"]
Jul 15 13:21:02.044190 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.044162    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.048722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.048698    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 13:21:02.049388 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.049369    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bqztw\""
Jul 15 13:21:02.049512 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.049481    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 13:21:02.050453 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.050435    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 13:21:02.051487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.051234    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 13:21:02.066836 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.066795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"]
Jul 15 13:21:02.145707 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.145663    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.145884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.145719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.145884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.145749    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlsfc\" (UniqueName: \"kubernetes.io/projected/e73d4a8d-d21d-405b-9a21-8c5e80da690a-kube-api-access-rlsfc\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.145884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.145848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.145884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.145878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.246832 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.246792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.246832 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.246833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlsfc\" (UniqueName: \"kubernetes.io/projected/e73d4a8d-d21d-405b-9a21-8c5e80da690a-kube-api-access-rlsfc\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.247089 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.246887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.247089 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.246906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.247089 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.246941    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.247397 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.247371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-manifests\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.249528 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.249490    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e73d4a8d-d21d-405b-9a21-8c5e80da690a-tmp\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.249638 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.249559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.249638 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.249595    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e73d4a8d-d21d-405b-9a21-8c5e80da690a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.268834 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.268799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlsfc\" (UniqueName: \"kubernetes.io/projected/e73d4a8d-d21d-405b-9a21-8c5e80da690a-kube-api-access-rlsfc\") pod \"opendatahub-operator-controller-manager-5f7f774c7f-jv9xf\" (UID: \"e73d4a8d-d21d-405b-9a21-8c5e80da690a\") " pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.355338 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.355291    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:02.516032 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.515997    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"]
Jul 15 13:21:02.519932 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:02.519906    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73d4a8d_d21d_405b_9a21_8c5e80da690a.slice/crio-53e65bb4b7b0d715af844d2311a2379345a4ba2ab7f00867494e0b6827909399 WatchSource:0}: Error finding container 53e65bb4b7b0d715af844d2311a2379345a4ba2ab7f00867494e0b6827909399: Status 404 returned error can't find the container with id 53e65bb4b7b0d715af844d2311a2379345a4ba2ab7f00867494e0b6827909399
Jul 15 13:21:02.723931 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:02.723841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf" event={"ID":"e73d4a8d-d21d-405b-9a21-8c5e80da690a","Type":"ContainerStarted","Data":"53e65bb4b7b0d715af844d2311a2379345a4ba2ab7f00867494e0b6827909399"}
Jul 15 13:21:05.742086 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:05.742049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf" event={"ID":"e73d4a8d-d21d-405b-9a21-8c5e80da690a","Type":"ContainerStarted","Data":"f3bb39178e0ece311c71a92b63dcc683527d469bceef98a3a498df41b25dd742"}
Jul 15 13:21:06.747754 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:06.747722    2571 generic.go:356] "Generic (PLEG): container finished" podID="e73d4a8d-d21d-405b-9a21-8c5e80da690a" containerID="f3bb39178e0ece311c71a92b63dcc683527d469bceef98a3a498df41b25dd742" exitCode=0
Jul 15 13:21:06.748249 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:06.747804    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf" event={"ID":"e73d4a8d-d21d-405b-9a21-8c5e80da690a","Type":"ContainerDied","Data":"f3bb39178e0ece311c71a92b63dcc683527d469bceef98a3a498df41b25dd742"}
Jul 15 13:21:07.755801 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:07.755709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf" event={"ID":"e73d4a8d-d21d-405b-9a21-8c5e80da690a","Type":"ContainerStarted","Data":"aab5476106c399213adc8601e0883aa2e9001b2de655892bd5440f7a7215ed64"}
Jul 15 13:21:07.756265 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:07.755863    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:07.811983 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:07.811930    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf" podStartSLOduration=1.987429352 podStartE2EDuration="6.811913289s" totalImagesPullingTime="3.712874664s" totalInitContainerRuntime="1.111609273s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:07.807468034 +0000 UTC m=+577.724275501" watchObservedRunningTime="2026-07-15 13:21:07.811913289 +0000 UTC m=+577.728720736"
Jul 15 13:21:18.762238 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:18.762203    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f7f774c7f-jv9xf"
Jul 15 13:21:22.118710 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.118673    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vjz5l"]
Jul 15 13:21:22.125763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.125739    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"]
Jul 15 13:21:22.125917 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.125888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.127905 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.127879    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.129627 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.129599    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2767x\""
Jul 15 13:21:22.133754 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.133728    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vjz5l"]
Jul 15 13:21:22.136958 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.136924    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"]
Jul 15 13:21:22.137411 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.137387    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 13:21:22.137736 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.137699    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mx7rx\""
Jul 15 13:21:22.137966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.137946    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 13:21:22.138423 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.138197    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 13:21:22.138423 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.137952    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 13:21:22.138729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.138714    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 13:21:22.212429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.212393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qffkc\" (UniqueName: \"kubernetes.io/projected/fbd428e7-903a-43c6-b120-255103223ade-kube-api-access-qffkc\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.212429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.212432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd428e7-903a-43c6-b120-255103223ade-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.212699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.212457    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.212699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.212527    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svlt8\" (UniqueName: \"kubernetes.io/projected/036ac88f-a94f-4874-b7d7-264148de2943-kube-api-access-svlt8\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.212699 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.212584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.312994 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.312954    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.313018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qffkc\" (UniqueName: \"kubernetes.io/projected/fbd428e7-903a-43c6-b120-255103223ade-kube-api-access-qffkc\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.313043    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd428e7-903a-43c6-b120-255103223ade-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.313064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.313089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svlt8\" (UniqueName: \"kubernetes.io/projected/036ac88f-a94f-4874-b7d7-264148de2943-kube-api-access-svlt8\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:22.313116    2571 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 13:21:22.313206 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:22.313190    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs podName:fbd428e7-903a-43c6-b120-255103223ade nodeName:}" failed. No retries permitted until 2026-07-15 13:21:22.813167514 +0000 UTC m=+592.729974964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs") pod "kube-auth-proxy-78dd6b4fb5-4vzjq" (UID: "fbd428e7-903a-43c6-b120-255103223ade") : secret "kube-auth-proxy-tls" not found
Jul 15 13:21:22.313540 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:22.313325    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 15 13:21:22.313540 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:22.313393    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert podName:036ac88f-a94f-4874-b7d7-264148de2943 nodeName:}" failed. No retries permitted until 2026-07-15 13:21:22.813376849 +0000 UTC m=+592.730184279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert") pod "odh-model-controller-7998c67dc4-vjz5l" (UID: "036ac88f-a94f-4874-b7d7-264148de2943") : secret "odh-model-controller-webhook-cert" not found
Jul 15 13:21:22.315467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.315445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd428e7-903a-43c6-b120-255103223ade-tmp\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.325555 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.325525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qffkc\" (UniqueName: \"kubernetes.io/projected/fbd428e7-903a-43c6-b120-255103223ade-kube-api-access-qffkc\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.327902 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.327876    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svlt8\" (UniqueName: \"kubernetes.io/projected/036ac88f-a94f-4874-b7d7-264148de2943-kube-api-access-svlt8\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.818153 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.818112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:22.818391 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.818214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.820590 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.820558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/036ac88f-a94f-4874-b7d7-264148de2943-cert\") pod \"odh-model-controller-7998c67dc4-vjz5l\" (UID: \"036ac88f-a94f-4874-b7d7-264148de2943\") " pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:22.820695 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:22.820589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fbd428e7-903a-43c6-b120-255103223ade-tls-certs\") pod \"kube-auth-proxy-78dd6b4fb5-4vzjq\" (UID: \"fbd428e7-903a-43c6-b120-255103223ade\") " pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:23.044132 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.044098    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:23.055755 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.055725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"
Jul 15 13:21:23.114054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.113992    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lng46"]
Jul 15 13:21:23.126933 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.126908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.133135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.132782    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 13:21:23.133135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.132809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-n89sv\""
Jul 15 13:21:23.137658 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.137585    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lng46"]
Jul 15 13:21:23.222069 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.222029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2d7dd74-36d9-472f-b062-f4042ee99041-tls-certs\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.222218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.222084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfzgj\" (UniqueName: \"kubernetes.io/projected/a2d7dd74-36d9-472f-b062-f4042ee99041-kube-api-access-nfzgj\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.248078 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.248050    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vjz5l"]
Jul 15 13:21:23.250221 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:23.250160    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036ac88f_a94f_4874_b7d7_264148de2943.slice/crio-97a8f35984c0fa56b9c3bf7db141f0cab6bde67860c2d796971c9c096e25c4f6 WatchSource:0}: Error finding container 97a8f35984c0fa56b9c3bf7db141f0cab6bde67860c2d796971c9c096e25c4f6: Status 404 returned error can't find the container with id 97a8f35984c0fa56b9c3bf7db141f0cab6bde67860c2d796971c9c096e25c4f6
Jul 15 13:21:23.280378 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.280352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq"]
Jul 15 13:21:23.282563 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:23.282524    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd428e7_903a_43c6_b120_255103223ade.slice/crio-5834c97fb443c03bc14fb10d421e9074a6a386fa2480b70fbcbfbdc9d1e00ff9 WatchSource:0}: Error finding container 5834c97fb443c03bc14fb10d421e9074a6a386fa2480b70fbcbfbdc9d1e00ff9: Status 404 returned error can't find the container with id 5834c97fb443c03bc14fb10d421e9074a6a386fa2480b70fbcbfbdc9d1e00ff9
Jul 15 13:21:23.323054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.323021    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2d7dd74-36d9-472f-b062-f4042ee99041-tls-certs\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.323248 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.323089    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfzgj\" (UniqueName: \"kubernetes.io/projected/a2d7dd74-36d9-472f-b062-f4042ee99041-kube-api-access-nfzgj\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.325860 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.325832    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2d7dd74-36d9-472f-b062-f4042ee99041-tls-certs\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.341197 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.341163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfzgj\" (UniqueName: \"kubernetes.io/projected/a2d7dd74-36d9-472f-b062-f4042ee99041-kube-api-access-nfzgj\") pod \"model-serving-api-54d89bd5fc-lng46\" (UID: \"a2d7dd74-36d9-472f-b062-f4042ee99041\") " pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.444942 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.444848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:23.603145 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.603112    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lng46"]
Jul 15 13:21:23.608325 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:23.608295    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d7dd74_36d9_472f_b062_f4042ee99041.slice/crio-cf185d2284eb7ba4fdd155eaf996256862603257224a5fb094940ba063fe9546 WatchSource:0}: Error finding container cf185d2284eb7ba4fdd155eaf996256862603257224a5fb094940ba063fe9546: Status 404 returned error can't find the container with id cf185d2284eb7ba4fdd155eaf996256862603257224a5fb094940ba063fe9546
Jul 15 13:21:23.779901 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.779817    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:23.784773 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.784750    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.789408 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.789378    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 13:21:23.789520 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.789438    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dhtw5\""
Jul 15 13:21:23.789966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.789946    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 13:21:23.790210 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.790192    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 13:21:23.790477 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.790458    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 13:21:23.800538 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.800514    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:23.821840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.821795    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l" event={"ID":"036ac88f-a94f-4874-b7d7-264148de2943","Type":"ContainerStarted","Data":"97a8f35984c0fa56b9c3bf7db141f0cab6bde67860c2d796971c9c096e25c4f6"}
Jul 15 13:21:23.822822 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.822802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq" event={"ID":"fbd428e7-903a-43c6-b120-255103223ade","Type":"ContainerStarted","Data":"5834c97fb443c03bc14fb10d421e9074a6a386fa2480b70fbcbfbdc9d1e00ff9"}
Jul 15 13:21:23.823868 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.823846    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lng46" event={"ID":"a2d7dd74-36d9-472f-b062-f4042ee99041","Type":"ContainerStarted","Data":"cf185d2284eb7ba4fdd155eaf996256862603257224a5fb094940ba063fe9546"}
Jul 15 13:21:23.826272 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826253    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826356 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826412 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826372    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826412 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826399    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bllxh\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826512 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826562 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.826562 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.826552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927498 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927510    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bllxh\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927582    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927663 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.927930 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.927670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.928718 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.928690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.930036 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.929980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.930440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.930405    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.930440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.930416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.930651 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.930631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.940374 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.940343    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:23.940646 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:23.940610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bllxh\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh\") pod \"istiod-openshift-gateway-7574459656-cpbsd\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:24.094876 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:24.094838    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:24.267583 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:24.267545    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:24.271540 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:24.271500    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bf15ba_e32d_4665_860a_a689eda7f0ab.slice/crio-f9534392758ebb11c09e2972b21f68c5113386b649e5a8675f29b3414e0474b3 WatchSource:0}: Error finding container f9534392758ebb11c09e2972b21f68c5113386b649e5a8675f29b3414e0474b3: Status 404 returned error can't find the container with id f9534392758ebb11c09e2972b21f68c5113386b649e5a8675f29b3414e0474b3
Jul 15 13:21:24.832914 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:24.832799    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" event={"ID":"a6bf15ba-e32d-4665-860a-a689eda7f0ab","Type":"ContainerStarted","Data":"f9534392758ebb11c09e2972b21f68c5113386b649e5a8675f29b3414e0474b3"}
Jul 15 13:21:25.376665 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:25.376079    2571 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/opendatahub/odh-model-serving-api:odh-v3.5-EA2"
Jul 15 13:21:25.376665 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:25.376241    2571 kuberuntime_manager.go:1459] "Unhandled Error" err="container server start failed in pod model-serving-api-54d89bd5fc-lng46_opendatahub(a2d7dd74-36d9-472f-b062-f4042ee99041): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 15 13:21:25.376665 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:25.376304    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"server\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/model-serving-api-54d89bd5fc-lng46" podUID="a2d7dd74-36d9-472f-b062-f4042ee99041"
Jul 15 13:21:25.840548 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:25.840461    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"server\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/odh-model-serving-api:odh-v3.5-EA2\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/model-serving-api-54d89bd5fc-lng46" podUID="a2d7dd74-36d9-472f-b062-f4042ee99041"
Jul 15 13:21:28.804326 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:28.804262    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:21:28.804725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:28.804368    2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 15 13:21:29.863611 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.863568    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" event={"ID":"a6bf15ba-e32d-4665-860a-a689eda7f0ab","Type":"ContainerStarted","Data":"6df19a7668fde667e93c9f4d1b5f32e0ee0c69badae97329d9c8fb5bb5be5b4d"}
Jul 15 13:21:29.864653 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.864628    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:29.866696 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.866484    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cpbsd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 13:21:29.866696 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.866532    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 13:21:29.866696 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.866591    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l" event={"ID":"036ac88f-a94f-4874-b7d7-264148de2943","Type":"ContainerStarted","Data":"b4e54e5e76ce8f64d7c8f1511cb21ea113bd1b2f217de62d1ce980fee824b326"}
Jul 15 13:21:29.866972 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.866827    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:29.868299 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.868257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq" event={"ID":"fbd428e7-903a-43c6-b120-255103223ade","Type":"ContainerStarted","Data":"3c6667432bd6730f5c9452ffab48687464210630b36f3b848dc04a7168aa2d4d"}
Jul 15 13:21:29.936513 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.936449    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" podStartSLOduration=2.407567315 podStartE2EDuration="6.936431357s" totalImagesPullingTime="4.528864042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:29.933524039 +0000 UTC m=+599.850331505" watchObservedRunningTime="2026-07-15 13:21:29.936431357 +0000 UTC m=+599.853238804"
Jul 15 13:21:29.982156 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:29.982105    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78dd6b4fb5-4vzjq" podStartSLOduration=2.472649752 podStartE2EDuration="7.982088956s" totalImagesPullingTime="5.509439204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:29.963777073 +0000 UTC m=+599.880584521" watchObservedRunningTime="2026-07-15 13:21:29.982088956 +0000 UTC m=+599.898896406"
Jul 15 13:21:30.007342 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:30.007259    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l" podStartSLOduration=2.447302015 podStartE2EDuration="8.007235191s" totalImagesPullingTime="5.559933176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:30.005401701 +0000 UTC m=+599.922209172" watchObservedRunningTime="2026-07-15 13:21:30.007235191 +0000 UTC m=+599.924042644"
Jul 15 13:21:30.564341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:30.564312    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:21:30.565316 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:30.565294    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:21:30.873863 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:30.873834    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:35.700818 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.700783    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"]
Jul 15 13:21:35.704768 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.704743    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"]
Jul 15 13:21:35.704896 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.704875    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.707945 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.707913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.708912 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.708893    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 15 13:21:35.709020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.708951    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-l6ksn\""
Jul 15 13:21:35.713157 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.713136    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 13:21:35.713250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.713233    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ztbrl\""
Jul 15 13:21:35.726875 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.726850    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"]
Jul 15 13:21:35.763778 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.763738    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"]
Jul 15 13:21:35.845582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.845535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvmkc\" (UniqueName: \"kubernetes.io/projected/9886d400-c966-41ff-8ad6-9835607a9f1d-kube-api-access-fvmkc\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.845582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.845583    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bk4q\" (UniqueName: \"kubernetes.io/projected/3c1c6322-285f-4826-8d78-59d64400fc50-kube-api-access-5bk4q\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.845840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.845659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9886d400-c966-41ff-8ad6-9835607a9f1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.845840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.845701    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.946341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.946304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9886d400-c966-41ff-8ad6-9835607a9f1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.946341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.946343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.946600 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.946392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvmkc\" (UniqueName: \"kubernetes.io/projected/9886d400-c966-41ff-8ad6-9835607a9f1d-kube-api-access-fvmkc\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.946600 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.946417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bk4q\" (UniqueName: \"kubernetes.io/projected/3c1c6322-285f-4826-8d78-59d64400fc50-kube-api-access-5bk4q\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.946600 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:35.946524    2571 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 15 13:21:35.946756 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:21:35.946608    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert podName:3c1c6322-285f-4826-8d78-59d64400fc50 nodeName:}" failed. No retries permitted until 2026-07-15 13:21:36.446585955 +0000 UTC m=+606.363393381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert") pod "kserve-controller-manager-d6f4b65b8-j5xbb" (UID: "3c1c6322-285f-4826-8d78-59d64400fc50") : secret "kserve-webhook-server-cert" not found
Jul 15 13:21:35.948807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.948786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9886d400-c966-41ff-8ad6-9835607a9f1d-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:35.963926 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.963860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bk4q\" (UniqueName: \"kubernetes.io/projected/3c1c6322-285f-4826-8d78-59d64400fc50-kube-api-access-5bk4q\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:35.964067 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:35.963944    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvmkc\" (UniqueName: \"kubernetes.io/projected/9886d400-c966-41ff-8ad6-9835607a9f1d-kube-api-access-fvmkc\") pod \"llmisvc-controller-manager-777c6bd7d5-h9q97\" (UID: \"9886d400-c966-41ff-8ad6-9835607a9f1d\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:36.017048 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.017009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:36.196966 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:36.196935    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9886d400_c966_41ff_8ad6_9835607a9f1d.slice/crio-5a4d8a87b68183a67c02c7c5a2bc90d1e0be7cea3a3bc5b0bda2b1ccfdfa4e4c WatchSource:0}: Error finding container 5a4d8a87b68183a67c02c7c5a2bc90d1e0be7cea3a3bc5b0bda2b1ccfdfa4e4c: Status 404 returned error can't find the container with id 5a4d8a87b68183a67c02c7c5a2bc90d1e0be7cea3a3bc5b0bda2b1ccfdfa4e4c
Jul 15 13:21:36.197331 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.197307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"]
Jul 15 13:21:36.451519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.451483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:36.453791 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.453773    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c1c6322-285f-4826-8d78-59d64400fc50-cert\") pod \"kserve-controller-manager-d6f4b65b8-j5xbb\" (UID: \"3c1c6322-285f-4826-8d78-59d64400fc50\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:36.622473 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.622436    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:36.818887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.818856    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"]
Jul 15 13:21:36.822050 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:21:36.822021    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1c6322_285f_4826_8d78_59d64400fc50.slice/crio-571af0dfdf3ed96ab91b12e34f1ff08a00cdce1b689e082e37ea735b4110164c WatchSource:0}: Error finding container 571af0dfdf3ed96ab91b12e34f1ff08a00cdce1b689e082e37ea735b4110164c: Status 404 returned error can't find the container with id 571af0dfdf3ed96ab91b12e34f1ff08a00cdce1b689e082e37ea735b4110164c
Jul 15 13:21:36.904400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.904303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97" event={"ID":"9886d400-c966-41ff-8ad6-9835607a9f1d","Type":"ContainerStarted","Data":"5a4d8a87b68183a67c02c7c5a2bc90d1e0be7cea3a3bc5b0bda2b1ccfdfa4e4c"}
Jul 15 13:21:36.905739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:36.905703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb" event={"ID":"3c1c6322-285f-4826-8d78-59d64400fc50","Type":"ContainerStarted","Data":"571af0dfdf3ed96ab91b12e34f1ff08a00cdce1b689e082e37ea735b4110164c"}
Jul 15 13:21:39.415418 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.415077    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:39.415418 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.415357    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery" containerID="cri-o://6df19a7668fde667e93c9f4d1b5f32e0ee0c69badae97329d9c8fb5bb5be5b4d" gracePeriod=30
Jul 15 13:21:39.874137 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.874112    2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cpbsd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.25:8080/ready\": dial tcp 10.134.0.25:8080: connect: connection refused" start-of-body=
Jul 15 13:21:39.874214 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.874174    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery" probeResult="failure" output="Get \"http://10.134.0.25:8080/ready\": dial tcp 10.134.0.25:8080: connect: connection refused"
Jul 15 13:21:39.923102 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.923065    2571 generic.go:356] "Generic (PLEG): container finished" podID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerID="6df19a7668fde667e93c9f4d1b5f32e0ee0c69badae97329d9c8fb5bb5be5b4d" exitCode=0
Jul 15 13:21:39.923292 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:39.923105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" event={"ID":"a6bf15ba-e32d-4665-860a-a689eda7f0ab","Type":"ContainerDied","Data":"6df19a7668fde667e93c9f4d1b5f32e0ee0c69badae97329d9c8fb5bb5be5b4d"}
Jul 15 13:21:40.876704 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:40.876666    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vjz5l"
Jul 15 13:21:41.097679 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.097648    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:41.195008 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.194980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195133 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195036    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195133 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195094    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bllxh\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195147    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195178    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195213    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.195429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.195352    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig\") pod \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\" (UID: \"a6bf15ba-e32d-4665-860a-a689eda7f0ab\") "
Jul 15 13:21:41.196208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.196156    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:21:41.199066 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.199025    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:21:41.199252 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.199221    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts" (OuterVolumeSpecName: "cacerts") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:21:41.199519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.199477    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh" (OuterVolumeSpecName: "kube-api-access-bllxh") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "kube-api-access-bllxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:21:41.199985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.199955    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:21:41.200180 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.200153    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs" (OuterVolumeSpecName: "local-certs") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:21:41.201112 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.201091    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a6bf15ba-e32d-4665-860a-a689eda7f0ab" (UID: "a6bf15ba-e32d-4665-860a-a689eda7f0ab"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:21:41.296054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296017    2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-token\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296054    2571 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-cacerts\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296069    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bllxh\" (UniqueName: \"kubernetes.io/projected/a6bf15ba-e32d-4665-860a-a689eda7f0ab-kube-api-access-bllxh\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296085    2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-dns-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296098    2571 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6bf15ba-e32d-4665-860a-a689eda7f0ab-local-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296111    2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-csr-ca-configmap\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.296314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.296123    2571 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a6bf15ba-e32d-4665-860a-a689eda7f0ab-istio-kubeconfig\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:21:41.940993 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.940963    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"
Jul 15 13:21:41.941478 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.941000    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd" event={"ID":"a6bf15ba-e32d-4665-860a-a689eda7f0ab","Type":"ContainerDied","Data":"f9534392758ebb11c09e2972b21f68c5113386b649e5a8675f29b3414e0474b3"}
Jul 15 13:21:41.941478 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.941057    2571 scope.go:117] "RemoveContainer" containerID="6df19a7668fde667e93c9f4d1b5f32e0ee0c69badae97329d9c8fb5bb5be5b4d"
Jul 15 13:21:41.942780 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.942704    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97" event={"ID":"9886d400-c966-41ff-8ad6-9835607a9f1d","Type":"ContainerStarted","Data":"4603501e5a664822b2aa1b0f3bd07e4cdc33eef0089e2e846cf4957cd529fad5"}
Jul 15 13:21:41.942894 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.942799    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:21:41.944669 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.944647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb" event={"ID":"3c1c6322-285f-4826-8d78-59d64400fc50","Type":"ContainerStarted","Data":"372f3840834b005b94350b992d875362e06df2ced79ace122dadf923f905c114"}
Jul 15 13:21:41.944840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.944760    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:21:41.946398 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.946376    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lng46" event={"ID":"a2d7dd74-36d9-472f-b062-f4042ee99041","Type":"ContainerStarted","Data":"020c9aa9fbd169dfd45a9d4e0612d4750d1253973ac9db2d2c4d082c492a1980"}
Jul 15 13:21:41.946571 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:41.946554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:21:42.002251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.002192    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97" podStartSLOduration=2.08370946 podStartE2EDuration="7.002175608s" totalImagesPullingTime="4.918466148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:42.001299596 +0000 UTC m=+611.918107035" watchObservedRunningTime="2026-07-15 13:21:42.002175608 +0000 UTC m=+611.918983056"
Jul 15 13:21:42.037866 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.037810    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lng46" podStartSLOduration=1.537945336 podStartE2EDuration="19.037793268s" totalImagesPullingTime="17.499847932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-15 13:21:42.035158433 +0000 UTC m=+611.951965881" watchObservedRunningTime="2026-07-15 13:21:42.037793268 +0000 UTC m=+611.954600715"
Jul 15 13:21:42.058713 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.058660    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb" podStartSLOduration=2.770098531 podStartE2EDuration="7.058642153s" totalImagesPullingTime="4.288543622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:21:42.056845947 +0000 UTC m=+611.973653392" watchObservedRunningTime="2026-07-15 13:21:42.058642153 +0000 UTC m=+611.975449600"
Jul 15 13:21:42.079191 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.079155    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:42.088128 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.088098    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cpbsd"]
Jul 15 13:21:42.717131 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:42.717094    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" path="/var/lib/kubelet/pods/a6bf15ba-e32d-4665-860a-a689eda7f0ab/volumes"
Jul 15 13:21:52.957016 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:21:52.956935    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lng46"
Jul 15 13:22:12.954453 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:12.954426    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h9q97"
Jul 15 13:22:12.957626 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:12.957604    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j5xbb"
Jul 15 13:22:23.017352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.017310    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:23.017726 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.017657    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery"
Jul 15 13:22:23.017726 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.017668    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery"
Jul 15 13:22:23.017799 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.017742    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bf15ba-e32d-4665-860a-a689eda7f0ab" containerName="discovery"
Jul 15 13:22:23.027962 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.027937    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:23.032487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.032236    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 13:22:23.032487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.032415    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 13:22:23.033965 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.033929    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bgt76\""
Jul 15 13:22:23.046743 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.046711    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:23.166345 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.166313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85rc\" (UniqueName: \"kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc\") pod \"kuadrant-operator-catalog-g6bxl\" (UID: \"fc392c75-39d7-4ff0-931b-69c49278f84e\") " pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:23.267667 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.267584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85rc\" (UniqueName: \"kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc\") pod \"kuadrant-operator-catalog-g6bxl\" (UID: \"fc392c75-39d7-4ff0-931b-69c49278f84e\") " pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:23.278853 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.278815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85rc\" (UniqueName: \"kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc\") pod \"kuadrant-operator-catalog-g6bxl\" (UID: \"fc392c75-39d7-4ff0-931b-69c49278f84e\") " pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:23.339484 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.339448    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:23.357032 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.357004    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:23.480729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.480655    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:23.486137 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:22:23.486110    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc392c75_39d7_4ff0_931b_69c49278f84e.slice/crio-c9456579e3f0a852369ffc84f6e96fdb160027d59ffde02354a3801cbea3e393 WatchSource:0}: Error finding container c9456579e3f0a852369ffc84f6e96fdb160027d59ffde02354a3801cbea3e393: Status 404 returned error can't find the container with id c9456579e3f0a852369ffc84f6e96fdb160027d59ffde02354a3801cbea3e393
Jul 15 13:22:23.586947 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.586915    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mzh9"]
Jul 15 13:22:23.589733 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.589709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:23.607150 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.607121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mzh9"]
Jul 15 13:22:23.671444 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.671408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52ntv\" (UniqueName: \"kubernetes.io/projected/cc8bf98d-cac7-4303-87ae-24c77367d73a-kube-api-access-52ntv\") pod \"kuadrant-operator-catalog-4mzh9\" (UID: \"cc8bf98d-cac7-4303-87ae-24c77367d73a\") " pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:23.772651 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.772619    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52ntv\" (UniqueName: \"kubernetes.io/projected/cc8bf98d-cac7-4303-87ae-24c77367d73a-kube-api-access-52ntv\") pod \"kuadrant-operator-catalog-4mzh9\" (UID: \"cc8bf98d-cac7-4303-87ae-24c77367d73a\") " pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:23.783853 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.783821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52ntv\" (UniqueName: \"kubernetes.io/projected/cc8bf98d-cac7-4303-87ae-24c77367d73a-kube-api-access-52ntv\") pod \"kuadrant-operator-catalog-4mzh9\" (UID: \"cc8bf98d-cac7-4303-87ae-24c77367d73a\") " pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:23.898802 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:23.898713    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:24.031774 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:24.031744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mzh9"]
Jul 15 13:22:24.034312 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:22:24.034259    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8bf98d_cac7_4303_87ae_24c77367d73a.slice/crio-3f7ded6a2fe935a10e2842a33075ea482102a0344a07d15f6b6a7eabd5a930ff WatchSource:0}: Error finding container 3f7ded6a2fe935a10e2842a33075ea482102a0344a07d15f6b6a7eabd5a930ff: Status 404 returned error can't find the container with id 3f7ded6a2fe935a10e2842a33075ea482102a0344a07d15f6b6a7eabd5a930ff
Jul 15 13:22:24.130855 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:24.130819    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9" event={"ID":"cc8bf98d-cac7-4303-87ae-24c77367d73a","Type":"ContainerStarted","Data":"3f7ded6a2fe935a10e2842a33075ea482102a0344a07d15f6b6a7eabd5a930ff"}
Jul 15 13:22:24.132042 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:24.132019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" event={"ID":"fc392c75-39d7-4ff0-931b-69c49278f84e","Type":"ContainerStarted","Data":"c9456579e3f0a852369ffc84f6e96fdb160027d59ffde02354a3801cbea3e393"}
Jul 15 13:22:26.142521 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.142487    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9" event={"ID":"cc8bf98d-cac7-4303-87ae-24c77367d73a","Type":"ContainerStarted","Data":"7ca9325f275e954f513807eef73d3e6c31872345acbb7fe3effd5f45ce44393b"}
Jul 15 13:22:26.143990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.143964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" event={"ID":"fc392c75-39d7-4ff0-931b-69c49278f84e","Type":"ContainerStarted","Data":"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"}
Jul 15 13:22:26.144146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.144042    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" podUID="fc392c75-39d7-4ff0-931b-69c49278f84e" containerName="registry-server" containerID="cri-o://79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f" gracePeriod=2
Jul 15 13:22:26.167678 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.167629    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9" podStartSLOduration=1.402120525 podStartE2EDuration="3.167612876s" totalImagesPullingTime="1.765492351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:26.166052406 +0000 UTC m=+656.082859855" watchObservedRunningTime="2026-07-15 13:22:26.167612876 +0000 UTC m=+656.084420324"
Jul 15 13:22:26.192819 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.192768    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" podStartSLOduration=1.882558304 podStartE2EDuration="4.192747947s" totalImagesPullingTime="2.310189643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:26.190146536 +0000 UTC m=+656.106953985" watchObservedRunningTime="2026-07-15 13:22:26.192747947 +0000 UTC m=+656.109555431"
Jul 15 13:22:26.394111 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.394046    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:26.498128 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.498094    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x85rc\" (UniqueName: \"kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc\") pod \"fc392c75-39d7-4ff0-931b-69c49278f84e\" (UID: \"fc392c75-39d7-4ff0-931b-69c49278f84e\") "
Jul 15 13:22:26.500221 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.500197    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc" (OuterVolumeSpecName: "kube-api-access-x85rc") pod "fc392c75-39d7-4ff0-931b-69c49278f84e" (UID: "fc392c75-39d7-4ff0-931b-69c49278f84e"). InnerVolumeSpecName "kube-api-access-x85rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:22:26.599173 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:26.599138    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x85rc\" (UniqueName: \"kubernetes.io/projected/fc392c75-39d7-4ff0-931b-69c49278f84e-kube-api-access-x85rc\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:22:27.150096 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.150060    2571 generic.go:356] "Generic (PLEG): container finished" podID="fc392c75-39d7-4ff0-931b-69c49278f84e" containerID="79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f" exitCode=0
Jul 15 13:22:27.150649 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.150130    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl"
Jul 15 13:22:27.150649 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.150153    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" event={"ID":"fc392c75-39d7-4ff0-931b-69c49278f84e","Type":"ContainerDied","Data":"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"}
Jul 15 13:22:27.150649 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.150228    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g6bxl" event={"ID":"fc392c75-39d7-4ff0-931b-69c49278f84e","Type":"ContainerDied","Data":"c9456579e3f0a852369ffc84f6e96fdb160027d59ffde02354a3801cbea3e393"}
Jul 15 13:22:27.150649 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.150250    2571 scope.go:117] "RemoveContainer" containerID="79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"
Jul 15 13:22:27.158975 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.158955    2571 scope.go:117] "RemoveContainer" containerID="79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"
Jul 15 13:22:27.159296 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:22:27.159260    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f\": container with ID starting with 79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f not found: ID does not exist" containerID="79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"
Jul 15 13:22:27.159380 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.159306    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f"} err="failed to get container status \"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f\": rpc error: code = NotFound desc = could not find container \"79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f\": container with ID starting with 79258a84d1a626835656f2fe4bfb434315c0a3cd5f48ccb7de10aa4efe0bdc7f not found: ID does not exist"
Jul 15 13:22:27.175015 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.174984    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:27.180374 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:27.180350    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g6bxl"]
Jul 15 13:22:28.716999 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:28.716963    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc392c75-39d7-4ff0-931b-69c49278f84e" path="/var/lib/kubelet/pods/fc392c75-39d7-4ff0-931b-69c49278f84e/volumes"
Jul 15 13:22:33.899729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:33.899688    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:33.900233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:33.899787    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:33.922483 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:33.922455    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:34.203862 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:34.203791    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4mzh9"
Jul 15 13:22:55.171966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.171931    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8499599bcd-jmrcc"]
Jul 15 13:22:55.172467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.172263    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc392c75-39d7-4ff0-931b-69c49278f84e" containerName="registry-server"
Jul 15 13:22:55.172467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.172289    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc392c75-39d7-4ff0-931b-69c49278f84e" containerName="registry-server"
Jul 15 13:22:55.172467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.172345    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc392c75-39d7-4ff0-931b-69c49278f84e" containerName="registry-server"
Jul 15 13:22:55.175598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.175581    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.201389 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.201351    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8499599bcd-jmrcc"]
Jul 15 13:22:55.245951 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.245910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.245962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-service-ca\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.245980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-oauth-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.246021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-oauth-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.246108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246369 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.246154    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-trusted-ca-bundle\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.246369 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.246180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t68nj\" (UniqueName: \"kubernetes.io/projected/b71a55d1-1130-4b06-8b0f-90387a317ca6-kube-api-access-t68nj\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.278180 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.278144    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"]
Jul 15 13:22:55.281434 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.281415    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:55.284196 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.284174    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ws7nl\""
Jul 15 13:22:55.294457 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.294430    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"]
Jul 15 13:22:55.347033 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.346991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347033 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347039    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-service-ca\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-oauth-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-oauth-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347173    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-trusted-ca-bundle\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347195    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t68nj\" (UniqueName: \"kubernetes.io/projected/b71a55d1-1130-4b06-8b0f-90387a317ca6-kube-api-access-t68nj\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.347556 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlk5\" (UniqueName: \"kubernetes.io/projected/1f907139-5a6e-46e2-bcca-121984df75bc-kube-api-access-tnlk5\") pod \"authorino-operator-75cc8d5cb7-d4j7r\" (UID: \"1f907139-5a6e-46e2-bcca-121984df75bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:55.347891 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347859    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-oauth-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.348004 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347870    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.348004 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.347934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-service-ca\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.348396 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.348372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b71a55d1-1130-4b06-8b0f-90387a317ca6-trusted-ca-bundle\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.349704 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.349683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-serving-cert\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.349787 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.349707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b71a55d1-1130-4b06-8b0f-90387a317ca6-console-oauth-config\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.364607 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.364582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t68nj\" (UniqueName: \"kubernetes.io/projected/b71a55d1-1130-4b06-8b0f-90387a317ca6-kube-api-access-t68nj\") pod \"console-8499599bcd-jmrcc\" (UID: \"b71a55d1-1130-4b06-8b0f-90387a317ca6\") " pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.449004 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.448900    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlk5\" (UniqueName: \"kubernetes.io/projected/1f907139-5a6e-46e2-bcca-121984df75bc-kube-api-access-tnlk5\") pod \"authorino-operator-75cc8d5cb7-d4j7r\" (UID: \"1f907139-5a6e-46e2-bcca-121984df75bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:55.459087 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.459059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlk5\" (UniqueName: \"kubernetes.io/projected/1f907139-5a6e-46e2-bcca-121984df75bc-kube-api-access-tnlk5\") pod \"authorino-operator-75cc8d5cb7-d4j7r\" (UID: \"1f907139-5a6e-46e2-bcca-121984df75bc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:55.485742 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.485706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:22:55.593271 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.593177    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:55.633898 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.633874    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8499599bcd-jmrcc"]
Jul 15 13:22:55.636744 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:22:55.636714    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71a55d1_1130_4b06_8b0f_90387a317ca6.slice/crio-e437394d5b677fcf098b708f5a28723d65e4d13e8230272b00388cdace9b6bad WatchSource:0}: Error finding container e437394d5b677fcf098b708f5a28723d65e4d13e8230272b00388cdace9b6bad: Status 404 returned error can't find the container with id e437394d5b677fcf098b708f5a28723d65e4d13e8230272b00388cdace9b6bad
Jul 15 13:22:55.743190 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.743076    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"]
Jul 15 13:22:55.746008 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:22:55.745984    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f907139_5a6e_46e2_bcca_121984df75bc.slice/crio-1cd434942ba25094b9d922ad5b36ba62d17a2688468abaeca674ed8446b782cf WatchSource:0}: Error finding container 1cd434942ba25094b9d922ad5b36ba62d17a2688468abaeca674ed8446b782cf: Status 404 returned error can't find the container with id 1cd434942ba25094b9d922ad5b36ba62d17a2688468abaeca674ed8446b782cf
Jul 15 13:22:55.749303 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:55.749143    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:22:56.276544 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:56.276508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r" event={"ID":"1f907139-5a6e-46e2-bcca-121984df75bc","Type":"ContainerStarted","Data":"1cd434942ba25094b9d922ad5b36ba62d17a2688468abaeca674ed8446b782cf"}
Jul 15 13:22:56.277915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:56.277885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8499599bcd-jmrcc" event={"ID":"b71a55d1-1130-4b06-8b0f-90387a317ca6","Type":"ContainerStarted","Data":"58f20481cd4db119c001c7bd9dabc8b2375897ad2c16c0a1b4cb6dab2279da60"}
Jul 15 13:22:56.278020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:56.277921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8499599bcd-jmrcc" event={"ID":"b71a55d1-1130-4b06-8b0f-90387a317ca6","Type":"ContainerStarted","Data":"e437394d5b677fcf098b708f5a28723d65e4d13e8230272b00388cdace9b6bad"}
Jul 15 13:22:56.309532 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:56.309479    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8499599bcd-jmrcc" podStartSLOduration=1.309462972 podStartE2EDuration="1.309462972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:56.306836729 +0000 UTC m=+686.223644196" watchObservedRunningTime="2026-07-15 13:22:56.309462972 +0000 UTC m=+686.226270419"
Jul 15 13:22:58.009012 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.008942    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"]
Jul 15 13:22:58.016104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.016073    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:22:58.019482 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.019456    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v8bhv\""
Jul 15 13:22:58.023340 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.023270    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"]
Jul 15 13:22:58.073621 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.073578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqkg2\" (UniqueName: \"kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2\") pod \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" (UID: \"8e895908-fc34-4031-815f-8c486ad465b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:22:58.174047 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.174022    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqkg2\" (UniqueName: \"kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2\") pod \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" (UID: \"8e895908-fc34-4031-815f-8c486ad465b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:22:58.184776 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.184751    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqkg2\" (UniqueName: \"kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2\") pod \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" (UID: \"8e895908-fc34-4031-815f-8c486ad465b5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:22:58.289565 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.289475    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r" event={"ID":"1f907139-5a6e-46e2-bcca-121984df75bc","Type":"ContainerStarted","Data":"4428de0000afb7bb40ce9abd10deb0c6bef8f941f40d5c79f275c3a570095f09"}
Jul 15 13:22:58.289732 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.289608    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:22:58.311452 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.311398    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r" podStartSLOduration=0.936959911 podStartE2EDuration="3.311382302s" totalImagesPullingTime="2.374422391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:22:58.31036384 +0000 UTC m=+688.227171308" watchObservedRunningTime="2026-07-15 13:22:58.311382302 +0000 UTC m=+688.228189749"
Jul 15 13:22:58.330520 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.330487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:22:58.473352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:58.473268    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"]
Jul 15 13:22:58.476147 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:22:58.476094    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e895908_fc34_4031_815f_8c486ad465b5.slice/crio-fe1093bba379541cbab073e448f228d822e199a29e1066c48d09087162b9d109 WatchSource:0}: Error finding container fe1093bba379541cbab073e448f228d822e199a29e1066c48d09087162b9d109: Status 404 returned error can't find the container with id fe1093bba379541cbab073e448f228d822e199a29e1066c48d09087162b9d109
Jul 15 13:22:59.295153 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:22:59.295115    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh" event={"ID":"8e895908-fc34-4031-815f-8c486ad465b5","Type":"ContainerStarted","Data":"fe1093bba379541cbab073e448f228d822e199a29e1066c48d09087162b9d109"}
Jul 15 13:23:01.708600 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.708568    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"]
Jul 15 13:23:01.711908 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.711889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.719462 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.719441    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nvxgg\""
Jul 15 13:23:01.732811 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.732778    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"]
Jul 15 13:23:01.809213 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.809178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2nmt\" (UniqueName: \"kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.809429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.809366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.910121 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.910079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.910331 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.910138    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2nmt\" (UniqueName: \"kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.910508 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.910487    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:01.925814 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:01.925786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2nmt\" (UniqueName: \"kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:02.021547 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.021501    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:02.164114 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.164089    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"]
Jul 15 13:23:02.166788 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:02.166753    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8641694e_9d3c_42ac_b442_7de0d2e815ab.slice/crio-a7cba86b2c6f2113988af803d20fddab4cbd09eed6debbe1cda469a029dfcdca WatchSource:0}: Error finding container a7cba86b2c6f2113988af803d20fddab4cbd09eed6debbe1cda469a029dfcdca: Status 404 returned error can't find the container with id a7cba86b2c6f2113988af803d20fddab4cbd09eed6debbe1cda469a029dfcdca
Jul 15 13:23:02.310298 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.310206    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh" event={"ID":"8e895908-fc34-4031-815f-8c486ad465b5","Type":"ContainerStarted","Data":"884a903ba1744ea8e550b273749d1cf5bdc8de2ad68e4cd10e6addc0cf833688"}
Jul 15 13:23:02.310298 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.310305    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:02.311444 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.311421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz" event={"ID":"8641694e-9d3c-42ac-b442-7de0d2e815ab","Type":"ContainerStarted","Data":"a7cba86b2c6f2113988af803d20fddab4cbd09eed6debbe1cda469a029dfcdca"}
Jul 15 13:23:02.339359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:02.339305    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh" podStartSLOduration=2.249121896 podStartE2EDuration="5.33927173s" totalImagesPullingTime="3.090149834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:02.337079892 +0000 UTC m=+692.253887340" watchObservedRunningTime="2026-07-15 13:23:02.33927173 +0000 UTC m=+692.256079179"
Jul 15 13:23:04.030222 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.030186    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"]
Jul 15 13:23:04.033844 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.033822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:04.036902 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.036878    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q6xg5\""
Jul 15 13:23:04.037027 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.036930    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 13:23:04.047428 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.047400    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"]
Jul 15 13:23:04.139637 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.139599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htwqg\" (UniqueName: \"kubernetes.io/projected/4ccfcd03-529c-4c1e-89f4-141d4ca243d7-kube-api-access-htwqg\") pod \"dns-operator-controller-manager-864dd78c4c-8mjrn\" (UID: \"4ccfcd03-529c-4c1e-89f4-141d4ca243d7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:04.240092 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.240052    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htwqg\" (UniqueName: \"kubernetes.io/projected/4ccfcd03-529c-4c1e-89f4-141d4ca243d7-kube-api-access-htwqg\") pod \"dns-operator-controller-manager-864dd78c4c-8mjrn\" (UID: \"4ccfcd03-529c-4c1e-89f4-141d4ca243d7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:04.260235 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.260208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htwqg\" (UniqueName: \"kubernetes.io/projected/4ccfcd03-529c-4c1e-89f4-141d4ca243d7-kube-api-access-htwqg\") pod \"dns-operator-controller-manager-864dd78c4c-8mjrn\" (UID: \"4ccfcd03-529c-4c1e-89f4-141d4ca243d7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:04.347880 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.347848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:04.516621 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:04.516586    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccfcd03_529c_4c1e_89f4_141d4ca243d7.slice/crio-c6914d86a02b00814e456bd9ca22236cebdb514ea9df9602709737f62af664ae WatchSource:0}: Error finding container c6914d86a02b00814e456bd9ca22236cebdb514ea9df9602709737f62af664ae: Status 404 returned error can't find the container with id c6914d86a02b00814e456bd9ca22236cebdb514ea9df9602709737f62af664ae
Jul 15 13:23:04.520541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:04.520503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"]
Jul 15 13:23:05.329464 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:05.329429    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn" event={"ID":"4ccfcd03-529c-4c1e-89f4-141d4ca243d7","Type":"ContainerStarted","Data":"c6914d86a02b00814e456bd9ca22236cebdb514ea9df9602709737f62af664ae"}
Jul 15 13:23:05.486346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:05.486312    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:23:05.486531 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:05.486403    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:23:05.491581 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:05.491554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:23:06.337725 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:06.337699    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8499599bcd-jmrcc"
Jul 15 13:23:06.428894 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:06.428762    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:23:07.340367 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:07.340326    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn" event={"ID":"4ccfcd03-529c-4c1e-89f4-141d4ca243d7","Type":"ContainerStarted","Data":"69d7db089e685ee4fbfe3ba51b29d147eda52aadd9f6958aefadbc72871d671d"}
Jul 15 13:23:07.340750 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:07.340548    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:07.362404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:07.362354    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn" podStartSLOduration=0.820946173 podStartE2EDuration="3.362335001s" totalImagesPullingTime="2.541388828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:07.360380857 +0000 UTC m=+697.277188324" watchObservedRunningTime="2026-07-15 13:23:07.362335001 +0000 UTC m=+697.279142495"
Jul 15 13:23:09.297990 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:09.297959    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-d4j7r"
Jul 15 13:23:09.354915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:09.354869    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz" event={"ID":"8641694e-9d3c-42ac-b442-7de0d2e815ab","Type":"ContainerStarted","Data":"c902c4ef280cec81251a18a0b7c491677fc2e600ce106ecf3115e0de7d3ec5ae"}
Jul 15 13:23:09.355123 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:09.354990    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:09.382593 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:09.382541    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz" podStartSLOduration=1.8187674280000001 podStartE2EDuration="8.382525326s" totalImagesPullingTime="6.563757898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:09.381681723 +0000 UTC m=+699.298489173" watchObservedRunningTime="2026-07-15 13:23:09.382525326 +0000 UTC m=+699.299332770"
Jul 15 13:23:11.478209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.478168    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"]
Jul 15 13:23:11.481881 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.481864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.485055 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.485025    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 13:23:11.485163 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.485112    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vmzhp\""
Jul 15 13:23:11.485163 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.485132    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 13:23:11.491268 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.491239    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"]
Jul 15 13:23:11.615462 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.615426    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5bv2\" (UniqueName: \"kubernetes.io/projected/4c3dadb7-846f-4842-87f2-c1038ecfd552-kube-api-access-n5bv2\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.615634 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.615488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c3dadb7-846f-4842-87f2-c1038ecfd552-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.615634 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.615551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3dadb7-846f-4842-87f2-c1038ecfd552-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.716554 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.716520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5bv2\" (UniqueName: \"kubernetes.io/projected/4c3dadb7-846f-4842-87f2-c1038ecfd552-kube-api-access-n5bv2\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.716756 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.716585    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c3dadb7-846f-4842-87f2-c1038ecfd552-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.716756 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.716617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3dadb7-846f-4842-87f2-c1038ecfd552-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.717402 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.717378    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4c3dadb7-846f-4842-87f2-c1038ecfd552-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.719028 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.719007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4c3dadb7-846f-4842-87f2-c1038ecfd552-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.728954 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.728899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5bv2\" (UniqueName: \"kubernetes.io/projected/4c3dadb7-846f-4842-87f2-c1038ecfd552-kube-api-access-n5bv2\") pod \"kuadrant-console-plugin-66b5774985-6wqcg\" (UID: \"4c3dadb7-846f-4842-87f2-c1038ecfd552\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.793286 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.793252    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"
Jul 15 13:23:11.945696 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:11.945651    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg"]
Jul 15 13:23:11.947968 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:11.947938    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c3dadb7_846f_4842_87f2_c1038ecfd552.slice/crio-427880d28b5483e48bba7edcfd03254a781fd07b195253e75b2517d217748020 WatchSource:0}: Error finding container 427880d28b5483e48bba7edcfd03254a781fd07b195253e75b2517d217748020: Status 404 returned error can't find the container with id 427880d28b5483e48bba7edcfd03254a781fd07b195253e75b2517d217748020
Jul 15 13:23:12.369662 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:12.369631    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg" event={"ID":"4c3dadb7-846f-4842-87f2-c1038ecfd552","Type":"ContainerStarted","Data":"427880d28b5483e48bba7edcfd03254a781fd07b195253e75b2517d217748020"}
Jul 15 13:23:13.319536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:13.319503    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:18.349398 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:18.349362    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8mjrn"
Jul 15 13:23:20.362102 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:20.362065    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:21.433768 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.433683    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"]
Jul 15 13:23:21.437588 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.437564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.483849 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.483806    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"]
Jul 15 13:23:21.516350 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.516313    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85vw\" (UniqueName: \"kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.516528 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.516419    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.617564 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.617518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.617749 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.617624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85vw\" (UniqueName: \"kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.617999 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.617969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.658079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.658044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85vw\" (UniqueName: \"kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.751146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.751052    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:21.927874 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:21.927847    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"]
Jul 15 13:23:22.257244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.257210    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"]
Jul 15 13:23:22.273565 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.273476    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"]
Jul 15 13:23:22.286499 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.286467    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:23:22.293556 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.293513    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"]
Jul 15 13:23:22.293734 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.293650    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.293803 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.293724    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" containerName="manager" containerID="cri-o://c902c4ef280cec81251a18a0b7c491677fc2e600ce106ecf3115e0de7d3ec5ae" gracePeriod=2
Jul 15 13:23:22.306970 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.306869    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"]
Jul 15 13:23:22.310643 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.309486    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:23:22.323853 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.323798    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.324032 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.323936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4p9d\" (UniqueName: \"kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.324207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.324149    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"]
Jul 15 13:23:22.324486 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.324423    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh" podUID="8e895908-fc34-4031-815f-8c486ad465b5" containerName="manager" containerID="cri-o://884a903ba1744ea8e550b273749d1cf5bdc8de2ad68e4cd10e6addc0cf833688" gracePeriod=2
Jul 15 13:23:22.326570 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.326547    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:22.327166 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.327144    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" containerName="manager"
Jul 15 13:23:22.327166 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.327167    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" containerName="manager"
Jul 15 13:23:22.327415 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.327305    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" containerName="manager"
Jul 15 13:23:22.331227 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.331205    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.339963 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:22.339450    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:22.342005 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.341977    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"]
Jul 15 13:23:22.342394 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:22.342362    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:22.347603 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.347573    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:22.372329 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:22.372253    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:22.425457 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.425424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.425681 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.425520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5rl8\" (UniqueName: \"kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.425681 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.425577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4p9d\" (UniqueName: \"kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.425681 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.425630    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.425869 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.425846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.443012 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.442977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4p9d\" (UniqueName: \"kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-kgzl7\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.526706 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.526625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.526865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.526740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5rl8\" (UniqueName: \"kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.527092 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.527056    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.540363 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.540329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5rl8\" (UniqueName: \"kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mzfd7\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:22.611763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.611717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:22.719323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:22.719295    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:31.462142 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:31.462086    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-645497fc-s4t9t" podUID="853e5625-2d57-4948-a37f-cebea75325b0" containerName="console" containerID="cri-o://74c009d8d715424f9aadba2002b8f7df34ac3a3477229be3f8d618cf0b90cf68" gracePeriod=15
Jul 15 13:23:35.287806 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:35.287760    2571 patch_prober.go:28] interesting pod/console-645497fc-s4t9t container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body=
Jul 15 13:23:35.288234 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:35.287829    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-645497fc-s4t9t" podUID="853e5625-2d57-4948-a37f-cebea75325b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused"
Jul 15 13:23:36.315980 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:36.315939    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8330ee43_3fa5_4cb9_ac18_ae3f3e806e8b.slice/crio-f2cd52849fc4c5bc31f94dd8cca81b66fd0554185ab8851b794f1c8e24a839d5 WatchSource:0}: Error finding container f2cd52849fc4c5bc31f94dd8cca81b66fd0554185ab8851b794f1c8e24a839d5: Status 404 returned error can't find the container with id f2cd52849fc4c5bc31f94dd8cca81b66fd0554185ab8851b794f1c8e24a839d5
Jul 15 13:23:36.508690 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.508659    2571 generic.go:356] "Generic (PLEG): container finished" podID="8641694e-9d3c-42ac-b442-7de0d2e815ab" containerID="c902c4ef280cec81251a18a0b7c491677fc2e600ce106ecf3115e0de7d3ec5ae" exitCode=0
Jul 15 13:23:36.509962 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.509938    2571 generic.go:356] "Generic (PLEG): container finished" podID="8e895908-fc34-4031-815f-8c486ad465b5" containerID="884a903ba1744ea8e550b273749d1cf5bdc8de2ad68e4cd10e6addc0cf833688" exitCode=0
Jul 15 13:23:36.510073 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.510013    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe1093bba379541cbab073e448f228d822e199a29e1066c48d09087162b9d109"
Jul 15 13:23:36.511873 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.511845    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" containerName="manager" containerID="cri-o://63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d" gracePeriod=2
Jul 15 13:23:36.513135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.513114    2571 generic.go:356] "Generic (PLEG): container finished" podID="853e5625-2d57-4948-a37f-cebea75325b0" containerID="74c009d8d715424f9aadba2002b8f7df34ac3a3477229be3f8d618cf0b90cf68" exitCode=0
Jul 15 13:23:36.513246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.513186    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645497fc-s4t9t" event={"ID":"853e5625-2d57-4948-a37f-cebea75325b0","Type":"ContainerDied","Data":"74c009d8d715424f9aadba2002b8f7df34ac3a3477229be3f8d618cf0b90cf68"}
Jul 15 13:23:36.514475 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.514449    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:36.553319 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.552617    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:36.555244 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.555185    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:36.556107 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.556010    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:23:36.557651 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.557440    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:36.560082 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.559934    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:36.583782 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.583736    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:36.615050 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.615023    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:36.618124 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.618085    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:36.620645 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.620621    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:36.623149 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:36.623126    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:36.667623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.667623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667628    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.667874 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667679    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.667874 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667785    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqkg2\" (UniqueName: \"kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2\") pod \"8e895908-fc34-4031-815f-8c486ad465b5\" (UID: \"8e895908-fc34-4031-815f-8c486ad465b5\") "
Jul 15 13:23:36.667874 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667830    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.667874 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.668079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667915    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2nmt\" (UniqueName: \"kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt\") pod \"8641694e-9d3c-42ac-b442-7de0d2e815ab\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") "
Jul 15 13:23:36.668079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667947    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.668079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.667999    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config\") pod \"853e5625-2d57-4948-a37f-cebea75325b0\" (UID: \"853e5625-2d57-4948-a37f-cebea75325b0\") "
Jul 15 13:23:36.668079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668027    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume\") pod \"8641694e-9d3c-42ac-b442-7de0d2e815ab\" (UID: \"8641694e-9d3c-42ac-b442-7de0d2e815ab\") "
Jul 15 13:23:36.668315 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668150    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config" (OuterVolumeSpecName: "console-config") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:23:36.668665 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668400    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-console-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.668665 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668446    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:23:36.668665 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668661    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:23:36.668876 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668736    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:23:36.668935 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.668905    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8641694e-9d3c-42ac-b442-7de0d2e815ab" (UID: "8641694e-9d3c-42ac-b442-7de0d2e815ab"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:23:36.670218 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.670190    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt" (OuterVolumeSpecName: "kube-api-access-v2nmt") pod "8641694e-9d3c-42ac-b442-7de0d2e815ab" (UID: "8641694e-9d3c-42ac-b442-7de0d2e815ab"). InnerVolumeSpecName "kube-api-access-v2nmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:23:36.670460 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.670431    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2" (OuterVolumeSpecName: "kube-api-access-zqkg2") pod "8e895908-fc34-4031-815f-8c486ad465b5" (UID: "8e895908-fc34-4031-815f-8c486ad465b5"). InnerVolumeSpecName "kube-api-access-zqkg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:23:36.670578 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.670494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv" (OuterVolumeSpecName: "kube-api-access-9tqmv") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "kube-api-access-9tqmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:23:36.670578 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.670544    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:23:36.670724 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.670706    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "853e5625-2d57-4948-a37f-cebea75325b0" (UID: "853e5625-2d57-4948-a37f-cebea75325b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:23:36.717113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.717076    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" path="/var/lib/kubelet/pods/8641694e-9d3c-42ac-b442-7de0d2e815ab/volumes"
Jul 15 13:23:36.717468 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.717451    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e895908-fc34-4031-815f-8c486ad465b5" path="/var/lib/kubelet/pods/8e895908-fc34-4031-815f-8c486ad465b5/volumes"
Jul 15 13:23:36.769359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769325    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-oauth-serving-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769353    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tqmv\" (UniqueName: \"kubernetes.io/projected/853e5625-2d57-4948-a37f-cebea75325b0-kube-api-access-9tqmv\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769363    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2nmt\" (UniqueName: \"kubernetes.io/projected/8641694e-9d3c-42ac-b442-7de0d2e815ab-kube-api-access-v2nmt\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769373    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-trusted-ca-bundle\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769382    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-oauth-config\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769390    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8641694e-9d3c-42ac-b442-7de0d2e815ab-extensions-socket-volume\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769398    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/853e5625-2d57-4948-a37f-cebea75325b0-console-serving-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769406    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/853e5625-2d57-4948-a37f-cebea75325b0-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.769598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.769415    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqkg2\" (UniqueName: \"kubernetes.io/projected/8e895908-fc34-4031-815f-8c486ad465b5-kube-api-access-zqkg2\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:36.813749 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.813710    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:36.816665 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:36.816627    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:23:36.817865 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:36.817825    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce04041_3c4e_47d3_a041_bcdc3df2cf8a.slice/crio-d3fff30ec9d8a422e207161d1c2c4938a763355c68af4741c00c34aad603ed68 WatchSource:0}: Error finding container d3fff30ec9d8a422e207161d1c2c4938a763355c68af4741c00c34aad603ed68: Status 404 returned error can't find the container with id d3fff30ec9d8a422e207161d1c2c4938a763355c68af4741c00c34aad603ed68
Jul 15 13:23:36.818666 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:36.818646    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f909fa6_10a1_4605_80b8_26419b47d7cf.slice/crio-1de466fb945f911b485b3ef5ba6e4abfc5ff0e701b05fc1ae7952f0f3f7cd54f WatchSource:0}: Error finding container 1de466fb945f911b485b3ef5ba6e4abfc5ff0e701b05fc1ae7952f0f3f7cd54f: Status 404 returned error can't find the container with id 1de466fb945f911b485b3ef5ba6e4abfc5ff0e701b05fc1ae7952f0f3f7cd54f
Jul 15 13:23:37.523011 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.522976    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" event={"ID":"1f909fa6-10a1-4605-80b8-26419b47d7cf","Type":"ContainerStarted","Data":"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"}
Jul 15 13:23:37.523533 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.523032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" event={"ID":"1f909fa6-10a1-4605-80b8-26419b47d7cf","Type":"ContainerStarted","Data":"1de466fb945f911b485b3ef5ba6e4abfc5ff0e701b05fc1ae7952f0f3f7cd54f"}
Jul 15 13:23:37.523533 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.523102    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:37.524404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.524388    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-645497fc-s4t9t"
Jul 15 13:23:37.524508 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.524395    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-645497fc-s4t9t" event={"ID":"853e5625-2d57-4948-a37f-cebea75325b0","Type":"ContainerDied","Data":"b78369a4be27fd18458fa5d237ce65489957443e49d24c2d59544f8d6518b256"}
Jul 15 13:23:37.524508 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.524451    2571 scope.go:117] "RemoveContainer" containerID="74c009d8d715424f9aadba2002b8f7df34ac3a3477229be3f8d618cf0b90cf68"
Jul 15 13:23:37.525948 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.525932    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:37.531325 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.531298    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg" event={"ID":"4c3dadb7-846f-4842-87f2-c1038ecfd552","Type":"ContainerStarted","Data":"c1de4255f8a7d2701bc31e542de92056feafa614c848b44b1481ce6b7f7f4c86"}
Jul 15 13:23:37.534090 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.534066    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:37.534225 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.534069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" event={"ID":"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a","Type":"ContainerStarted","Data":"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"}
Jul 15 13:23:37.534225 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.534205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" event={"ID":"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a","Type":"ContainerStarted","Data":"d3fff30ec9d8a422e207161d1c2c4938a763355c68af4741c00c34aad603ed68"}
Jul 15 13:23:37.538751 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.538728    2571 scope.go:117] "RemoveContainer" containerID="c902c4ef280cec81251a18a0b7c491677fc2e600ce106ecf3115e0de7d3ec5ae"
Jul 15 13:23:37.549119 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.549076    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" podStartSLOduration=15.549060726 podStartE2EDuration="15.549060726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:37.548713543 +0000 UTC m=+727.465520991" watchObservedRunningTime="2026-07-15 13:23:37.549060726 +0000 UTC m=+727.465868174"
Jul 15 13:23:37.551349 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:37.551324    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:37.569985 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.569896    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6wqcg" podStartSLOduration=2.108338828 podStartE2EDuration="26.569879705s" totalImagesPullingTime="24.461540877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:37.568568478 +0000 UTC m=+727.485375939" watchObservedRunningTime="2026-07-15 13:23:37.569879705 +0000 UTC m=+727.486687156"
Jul 15 13:23:37.572464 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:37.572425    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:37.601043 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.600985    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" podStartSLOduration=15.600969391 podStartE2EDuration="15.600969391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:37.598766235 +0000 UTC m=+727.515573684" watchObservedRunningTime="2026-07-15 13:23:37.600969391 +0000 UTC m=+727.517776838"
Jul 15 13:23:37.615969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.615940    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:23:37.620108 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:37.620081    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-645497fc-s4t9t"]
Jul 15 13:23:38.541020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.540984    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:38.682623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.682591    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:38.685901 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:38.685872    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w5fzh\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8e895908-fc34-4031-815f-8c486ad465b5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w5fzh"
Jul 15 13:23:38.688535 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:38.688511    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:38.690609 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:38.690589    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-f8zxz\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8641694e-9d3c-42ac-b442-7de0d2e815ab" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-f8zxz"
Jul 15 13:23:38.716619 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.716581    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="853e5625-2d57-4948-a37f-cebea75325b0" path="/var/lib/kubelet/pods/853e5625-2d57-4948-a37f-cebea75325b0/volumes"
Jul 15 13:23:38.789246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.789155    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume\") pod \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") "
Jul 15 13:23:38.789246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.789217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85vw\" (UniqueName: \"kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw\") pod \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\" (UID: \"8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b\") "
Jul 15 13:23:38.789566 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.789539    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" (UID: "8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:23:38.791341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.791310    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw" (OuterVolumeSpecName: "kube-api-access-l85vw") pod "8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" (UID: "8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b"). InnerVolumeSpecName "kube-api-access-l85vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:23:38.890904 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.890866    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-extensions-socket-volume\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:38.890904 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:38.890895    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85vw\" (UniqueName: \"kubernetes.io/projected/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b-kube-api-access-l85vw\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:39.547119 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:39.547078    2571 generic.go:356] "Generic (PLEG): container finished" podID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" containerID="63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d" exitCode=137
Jul 15 13:23:39.547612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:39.547136    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:39.547612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:39.547184    2571 scope.go:117] "RemoveContainer" containerID="63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d"
Jul 15 13:23:39.550304 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:39.550256    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:39.556183 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:39.556162    2571 scope.go:117] "RemoveContainer" containerID="63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d"
Jul 15 13:23:39.556478 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:39.556451    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d\": container with ID starting with 63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d not found: ID does not exist" containerID="63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d"
Jul 15 13:23:39.556567 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:39.556488    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d"} err="failed to get container status \"63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d\": rpc error: code = NotFound desc = could not find container \"63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d\": container with ID starting with 63c51d426d848e4fa7233e426a44dce8cb4a93325e9362f2f0f0052bb994245d not found: ID does not exist"
Jul 15 13:23:39.557510 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:39.557474    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:40.715932 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:40.715891    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-g5qjn\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-g5qjn"
Jul 15 13:23:40.717011 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:40.716989    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" path="/var/lib/kubelet/pods/8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b/volumes"
Jul 15 13:23:48.543135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.543104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:23:48.600335 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.600299    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:48.600712 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.600647    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" podUID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" containerName="manager" containerID="cri-o://ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5" gracePeriod=10
Jul 15 13:23:48.602434 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.602412    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:48.860869 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.860840    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:23:48.861304 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861270    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e895908-fc34-4031-815f-8c486ad465b5" containerName="manager"
Jul 15 13:23:48.861400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861306    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e895908-fc34-4031-815f-8c486ad465b5" containerName="manager"
Jul 15 13:23:48.861400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861333    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="853e5625-2d57-4948-a37f-cebea75325b0" containerName="console"
Jul 15 13:23:48.861400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861342    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="853e5625-2d57-4948-a37f-cebea75325b0" containerName="console"
Jul 15 13:23:48.861400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861361    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" containerName="manager"
Jul 15 13:23:48.861400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861369    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" containerName="manager"
Jul 15 13:23:48.861965 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861460    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e895908-fc34-4031-815f-8c486ad465b5" containerName="manager"
Jul 15 13:23:48.861965 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861473    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="853e5625-2d57-4948-a37f-cebea75325b0" containerName="console"
Jul 15 13:23:48.861965 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.861480    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8330ee43-3fa5-4cb9-ac18-ae3f3e806e8b" containerName="manager"
Jul 15 13:23:48.868506 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.868485    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:48.869355 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.869342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:48.877968 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.877941    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:23:48.980316 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.980272    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5rl8\" (UniqueName: \"kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8\") pod \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") "
Jul 15 13:23:48.980595 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.980348    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume\") pod \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\" (UID: \"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a\") "
Jul 15 13:23:48.980595 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.980559    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdf4\" (UniqueName: \"kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:48.980690 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.980644    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:48.980805 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.980787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" (UID: "0ce04041-3c4e-47d3-a041-bcdc3df2cf8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:23:48.982550 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:48.982523    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8" (OuterVolumeSpecName: "kube-api-access-f5rl8") pod "0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" (UID: "0ce04041-3c4e-47d3-a041-bcdc3df2cf8a"). InnerVolumeSpecName "kube-api-access-f5rl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:23:49.082036 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.081997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdf4\" (UniqueName: \"kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.082207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.082055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.082247 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.082216    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5rl8\" (UniqueName: \"kubernetes.io/projected/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-kube-api-access-f5rl8\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:49.082247 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.082234    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a-extensions-socket-volume\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:23:49.082498 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.082479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.093477 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.093445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdf4\" (UniqueName: \"kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4\") pod \"kuadrant-operator-controller-manager-86878c769f-cpzlz\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.180718 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.180588    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.362881 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.362854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:23:49.365165 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:23:49.365140    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014c07fb_3bf6_4124_a4f2_8a3c83805fce.slice/crio-92a27449e1c446305218598a33ad5616eabd22753c8d7a41a3d8a153ab9ab586 WatchSource:0}: Error finding container 92a27449e1c446305218598a33ad5616eabd22753c8d7a41a3d8a153ab9ab586: Status 404 returned error can't find the container with id 92a27449e1c446305218598a33ad5616eabd22753c8d7a41a3d8a153ab9ab586
Jul 15 13:23:49.607668 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.607637    2571 generic.go:356] "Generic (PLEG): container finished" podID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" containerID="ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5" exitCode=0
Jul 15 13:23:49.608097 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.607680    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"
Jul 15 13:23:49.608097 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.607709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" event={"ID":"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a","Type":"ContainerDied","Data":"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"}
Jul 15 13:23:49.608097 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.607760    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7" event={"ID":"0ce04041-3c4e-47d3-a041-bcdc3df2cf8a","Type":"ContainerDied","Data":"d3fff30ec9d8a422e207161d1c2c4938a763355c68af4741c00c34aad603ed68"}
Jul 15 13:23:49.608097 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.607783    2571 scope.go:117] "RemoveContainer" containerID="ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"
Jul 15 13:23:49.609458 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.609431    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" event={"ID":"014c07fb-3bf6-4124-a4f2-8a3c83805fce","Type":"ContainerStarted","Data":"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"}
Jul 15 13:23:49.609566 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.609472    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" event={"ID":"014c07fb-3bf6-4124-a4f2-8a3c83805fce","Type":"ContainerStarted","Data":"92a27449e1c446305218598a33ad5616eabd22753c8d7a41a3d8a153ab9ab586"}
Jul 15 13:23:49.609632 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.609583    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:23:49.624814 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.624792    2571 scope.go:117] "RemoveContainer" containerID="ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"
Jul 15 13:23:49.625104 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:23:49.625086    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5\": container with ID starting with ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5 not found: ID does not exist" containerID="ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"
Jul 15 13:23:49.625150 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.625115    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5"} err="failed to get container status \"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5\": rpc error: code = NotFound desc = could not find container \"ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5\": container with ID starting with ea0316df5f76728f01d42095f37336557f11934ee02f71d08ad8a5d75b4991e5 not found: ID does not exist"
Jul 15 13:23:49.632408 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.632350    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" podStartSLOduration=1.632334124 podStartE2EDuration="1.632334124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:23:49.631433037 +0000 UTC m=+739.548240497" watchObservedRunningTime="2026-07-15 13:23:49.632334124 +0000 UTC m=+739.549141571"
Jul 15 13:23:49.648751 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.648719    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:49.655052 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:49.655023    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mzfd7"]
Jul 15 13:23:50.716301 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:23:50.716258    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" path="/var/lib/kubelet/pods/0ce04041-3c4e-47d3-a041-bcdc3df2cf8a/volumes"
Jul 15 13:24:00.617824 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:00.617789    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:24:00.672254 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:00.672216    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:24:00.672505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:00.672458    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" podUID="1f909fa6-10a1-4605-80b8-26419b47d7cf" containerName="manager" containerID="cri-o://1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9" gracePeriod=10
Jul 15 13:24:01.478511 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.478478    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:24:01.596686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.596653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume\") pod \"1f909fa6-10a1-4605-80b8-26419b47d7cf\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") "
Jul 15 13:24:01.596899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.596741    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4p9d\" (UniqueName: \"kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d\") pod \"1f909fa6-10a1-4605-80b8-26419b47d7cf\" (UID: \"1f909fa6-10a1-4605-80b8-26419b47d7cf\") "
Jul 15 13:24:01.597165 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.597128    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1f909fa6-10a1-4605-80b8-26419b47d7cf" (UID: "1f909fa6-10a1-4605-80b8-26419b47d7cf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:24:01.599341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.599311    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d" (OuterVolumeSpecName: "kube-api-access-n4p9d") pod "1f909fa6-10a1-4605-80b8-26419b47d7cf" (UID: "1f909fa6-10a1-4605-80b8-26419b47d7cf"). InnerVolumeSpecName "kube-api-access-n4p9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:01.670759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.670700    2571 generic.go:356] "Generic (PLEG): container finished" podID="1f909fa6-10a1-4605-80b8-26419b47d7cf" containerID="1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9" exitCode=0
Jul 15 13:24:01.670759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.670754    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"
Jul 15 13:24:01.670759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.670761    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" event={"ID":"1f909fa6-10a1-4605-80b8-26419b47d7cf","Type":"ContainerDied","Data":"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"}
Jul 15 13:24:01.671310 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.670807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7" event={"ID":"1f909fa6-10a1-4605-80b8-26419b47d7cf","Type":"ContainerDied","Data":"1de466fb945f911b485b3ef5ba6e4abfc5ff0e701b05fc1ae7952f0f3f7cd54f"}
Jul 15 13:24:01.671310 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.670832    2571 scope.go:117] "RemoveContainer" containerID="1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"
Jul 15 13:24:01.680641 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.680501    2571 scope.go:117] "RemoveContainer" containerID="1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"
Jul 15 13:24:01.680877 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:24:01.680858    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9\": container with ID starting with 1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9 not found: ID does not exist" containerID="1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"
Jul 15 13:24:01.680951 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.680886    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9"} err="failed to get container status \"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9\": rpc error: code = NotFound desc = could not find container \"1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9\": container with ID starting with 1d935d30cda2c305b4850b66d5547683ded299f30b8e99cd223a567cc27fc2a9 not found: ID does not exist"
Jul 15 13:24:01.697715 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.697665    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f909fa6-10a1-4605-80b8-26419b47d7cf-extensions-socket-volume\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:01.697715 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.697695    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4p9d\" (UniqueName: \"kubernetes.io/projected/1f909fa6-10a1-4605-80b8-26419b47d7cf-kube-api-access-n4p9d\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:01.700395 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.700365    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:24:01.704389 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:01.704359    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-kgzl7"]
Jul 15 13:24:02.717298 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:02.717249    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f909fa6-10a1-4605-80b8-26419b47d7cf" path="/var/lib/kubelet/pods/1f909fa6-10a1-4605-80b8-26419b47d7cf/volumes"
Jul 15 13:24:18.981013 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.980967    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:18.981613 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981542    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f909fa6-10a1-4605-80b8-26419b47d7cf" containerName="manager"
Jul 15 13:24:18.981613 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981563    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f909fa6-10a1-4605-80b8-26419b47d7cf" containerName="manager"
Jul 15 13:24:18.981613 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981581    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" containerName="manager"
Jul 15 13:24:18.981613 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981590    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" containerName="manager"
Jul 15 13:24:18.981820 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981674    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce04041-3c4e-47d3-a041-bcdc3df2cf8a" containerName="manager"
Jul 15 13:24:18.981820 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:18.981686    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f909fa6-10a1-4605-80b8-26419b47d7cf" containerName="manager"
Jul 15 13:24:19.070259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.070218    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:19.070448 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.070376    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.073572 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.073542    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 13:24:19.074323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.074296    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:19.129160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.129128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxrh\" (UniqueName: \"kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.129160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.129165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.230507 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.230473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxrh\" (UniqueName: \"kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.230695 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.230515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.231177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.231134    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.239785 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.239764    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxrh\" (UniqueName: \"kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh\") pod \"limitador-limitador-64c94fd64f-m2ng2\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.383857 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.383822    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:19.412420 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.412385    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:24:19.417436 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.417410    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.430173 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.430136    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:24:19.463626 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.463596    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:24:19.528687 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.528607    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:19.532592 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:19.532560    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13f99cb_31eb_49f4_8f89_d4743badbc7e.slice/crio-cdc4a1ee5635e0387f1b41fd53a0b9745f4d005ba69fb14f88c4ca2e1fcf4739 WatchSource:0}: Error finding container cdc4a1ee5635e0387f1b41fd53a0b9745f4d005ba69fb14f88c4ca2e1fcf4739: Status 404 returned error can't find the container with id cdc4a1ee5635e0387f1b41fd53a0b9745f4d005ba69fb14f88c4ca2e1fcf4739
Jul 15 13:24:19.532931 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.532913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4382dd63-5409-4cab-84da-fedcb972a3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.532979 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.532952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk8vx\" (UniqueName: \"kubernetes.io/projected/4382dd63-5409-4cab-84da-fedcb972a3e2-kube-api-access-xk8vx\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.633687 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.633652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4382dd63-5409-4cab-84da-fedcb972a3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.633871 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.633700    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk8vx\" (UniqueName: \"kubernetes.io/projected/4382dd63-5409-4cab-84da-fedcb972a3e2-kube-api-access-xk8vx\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.634389 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.634368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4382dd63-5409-4cab-84da-fedcb972a3e2-config-file\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.642530 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.642496    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk8vx\" (UniqueName: \"kubernetes.io/projected/4382dd63-5409-4cab-84da-fedcb972a3e2-kube-api-access-xk8vx\") pod \"limitador-limitador-54d6d988d5-z2bb4\" (UID: \"4382dd63-5409-4cab-84da-fedcb972a3e2\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.730955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.730914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:19.762795 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.762763    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" event={"ID":"d13f99cb-31eb-49f4-8f89-d4743badbc7e","Type":"ContainerStarted","Data":"cdc4a1ee5635e0387f1b41fd53a0b9745f4d005ba69fb14f88c4ca2e1fcf4739"}
Jul 15 13:24:19.875194 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:19.875154    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:24:19.877366 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:19.877335    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4382dd63_5409_4cab_84da_fedcb972a3e2.slice/crio-9d845646284640e2014efbf680cae0098b85c723b18c6344de1b12a34ada7d8c WatchSource:0}: Error finding container 9d845646284640e2014efbf680cae0098b85c723b18c6344de1b12a34ada7d8c: Status 404 returned error can't find the container with id 9d845646284640e2014efbf680cae0098b85c723b18c6344de1b12a34ada7d8c
Jul 15 13:24:20.078354 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.076915    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:20.084054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.084018    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:20.086132 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.086108    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:20.087544 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.087518    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nqc98\""
Jul 15 13:24:20.136941 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.136903    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9g5\" (UniqueName: \"kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5\") pod \"authorino-75d556bd77-5bccg\" (UID: \"65a80945-dee1-47ff-92f8-d2837439a044\") " pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:20.237394 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.237363    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9g5\" (UniqueName: \"kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5\") pod \"authorino-75d556bd77-5bccg\" (UID: \"65a80945-dee1-47ff-92f8-d2837439a044\") " pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:20.249195 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.249169    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9g5\" (UniqueName: \"kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5\") pod \"authorino-75d556bd77-5bccg\" (UID: \"65a80945-dee1-47ff-92f8-d2837439a044\") " pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:20.395474 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.395433    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:20.534951 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.534926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:20.537634 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:20.537608    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65a80945_dee1_47ff_92f8_d2837439a044.slice/crio-4563951fdbebf769bbc134f07f66aff48e2f0b7ce7cd6a834705b5083c2a7576 WatchSource:0}: Error finding container 4563951fdbebf769bbc134f07f66aff48e2f0b7ce7cd6a834705b5083c2a7576: Status 404 returned error can't find the container with id 4563951fdbebf769bbc134f07f66aff48e2f0b7ce7cd6a834705b5083c2a7576
Jul 15 13:24:20.771945 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.771851    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4" event={"ID":"4382dd63-5409-4cab-84da-fedcb972a3e2","Type":"ContainerStarted","Data":"9d845646284640e2014efbf680cae0098b85c723b18c6344de1b12a34ada7d8c"}
Jul 15 13:24:20.774339 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:20.774309    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5bccg" event={"ID":"65a80945-dee1-47ff-92f8-d2837439a044","Type":"ContainerStarted","Data":"4563951fdbebf769bbc134f07f66aff48e2f0b7ce7cd6a834705b5083c2a7576"}
Jul 15 13:24:25.810300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.810238    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" event={"ID":"d13f99cb-31eb-49f4-8f89-d4743badbc7e","Type":"ContainerStarted","Data":"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"}
Jul 15 13:24:25.810776 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.810435    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:25.811891 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.811870    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4" event={"ID":"4382dd63-5409-4cab-84da-fedcb972a3e2","Type":"ContainerStarted","Data":"e58e1e044b994d4c22a5308eea4bec31cc0df38b5d3b3a4e52ea7b714542a3f5"}
Jul 15 13:24:25.811992 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.811981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:25.813246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.813224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5bccg" event={"ID":"65a80945-dee1-47ff-92f8-d2837439a044","Type":"ContainerStarted","Data":"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"}
Jul 15 13:24:25.829656 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.829604    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" podStartSLOduration=2.326757677 podStartE2EDuration="7.829589288s" totalImagesPullingTime="5.502831611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:25.828826808 +0000 UTC m=+775.745634256" watchObservedRunningTime="2026-07-15 13:24:25.829589288 +0000 UTC m=+775.746396736"
Jul 15 13:24:25.848519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.848450    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4" podStartSLOduration=1.6992691199999999 podStartE2EDuration="6.848433233s" totalImagesPullingTime="5.149164113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:25.846371871 +0000 UTC m=+775.763179346" watchObservedRunningTime="2026-07-15 13:24:25.848433233 +0000 UTC m=+775.765240682"
Jul 15 13:24:25.867248 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:25.867192    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5bccg" podStartSLOduration=1.381108097 podStartE2EDuration="5.867177583s" totalImagesPullingTime="4.486069486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:25.866239921 +0000 UTC m=+775.783047379" watchObservedRunningTime="2026-07-15 13:24:25.867177583 +0000 UTC m=+775.783985031"
Jul 15 13:24:36.820918 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:36.820889    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:36.821330 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:36.820958    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"
Jul 15 13:24:36.887804 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:36.887763    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:36.887983 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:36.887956    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" podUID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" containerName="limitador" containerID="cri-o://09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0" gracePeriod=30
Jul 15 13:24:37.440536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.440509    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:37.498007 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.497909    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file\") pod \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") "
Jul 15 13:24:37.498007 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.497980    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtxrh\" (UniqueName: \"kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh\") pod \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\" (UID: \"d13f99cb-31eb-49f4-8f89-d4743badbc7e\") "
Jul 15 13:24:37.498324 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.498268    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file" (OuterVolumeSpecName: "config-file") pod "d13f99cb-31eb-49f4-8f89-d4743badbc7e" (UID: "d13f99cb-31eb-49f4-8f89-d4743badbc7e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:24:37.500110 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.500083    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh" (OuterVolumeSpecName: "kube-api-access-xtxrh") pod "d13f99cb-31eb-49f4-8f89-d4743badbc7e" (UID: "d13f99cb-31eb-49f4-8f89-d4743badbc7e"). InnerVolumeSpecName "kube-api-access-xtxrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:37.599498 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.599456    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtxrh\" (UniqueName: \"kubernetes.io/projected/d13f99cb-31eb-49f4-8f89-d4743badbc7e-kube-api-access-xtxrh\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:37.599498 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.599489    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d13f99cb-31eb-49f4-8f89-d4743badbc7e-config-file\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:37.871971 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.871937    2571 generic.go:356] "Generic (PLEG): container finished" podID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" containerID="09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0" exitCode=0
Jul 15 13:24:37.872429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.871997    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"
Jul 15 13:24:37.872429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.872025    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" event={"ID":"d13f99cb-31eb-49f4-8f89-d4743badbc7e","Type":"ContainerDied","Data":"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"}
Jul 15 13:24:37.872429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.872075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m2ng2" event={"ID":"d13f99cb-31eb-49f4-8f89-d4743badbc7e","Type":"ContainerDied","Data":"cdc4a1ee5635e0387f1b41fd53a0b9745f4d005ba69fb14f88c4ca2e1fcf4739"}
Jul 15 13:24:37.872429 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.872096    2571 scope.go:117] "RemoveContainer" containerID="09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"
Jul 15 13:24:37.881800 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.881782    2571 scope.go:117] "RemoveContainer" containerID="09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"
Jul 15 13:24:37.882110 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:24:37.882087    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0\": container with ID starting with 09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0 not found: ID does not exist" containerID="09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"
Jul 15 13:24:37.882181 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.882124    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0"} err="failed to get container status \"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0\": rpc error: code = NotFound desc = could not find container \"09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0\": container with ID starting with 09d3625f0fc75838bbb0bfa0ce24b65581df73374eebbbd792f6ae303bdf0ec0 not found: ID does not exist"
Jul 15 13:24:37.894088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.894054    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:37.897904 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:37.897876    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m2ng2"]
Jul 15 13:24:38.716469 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.716427    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" path="/var/lib/kubelet/pods/d13f99cb-31eb-49f4-8f89-d4743badbc7e/volumes"
Jul 15 13:24:38.984085 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.983992    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"]
Jul 15 13:24:38.984615 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.984593    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" containerName="limitador"
Jul 15 13:24:38.984690 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.984617    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" containerName="limitador"
Jul 15 13:24:38.984761 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.984748    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d13f99cb-31eb-49f4-8f89-d4743badbc7e" containerName="limitador"
Jul 15 13:24:38.988108 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.988075    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:38.991404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.991378    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 13:24:38.991544 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.991426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 13:24:38.992887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.992697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7jpfg\""
Jul 15 13:24:38.992887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.992704    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:24:38.995481 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:38.995455    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"]
Jul 15 13:24:39.118064 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.118028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-data\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.118064 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.118071    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8ln\" (UniqueName: \"kubernetes.io/projected/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-kube-api-access-2v8ln\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.218862 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.218816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-data\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.218862 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.218865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8ln\" (UniqueName: \"kubernetes.io/projected/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-kube-api-access-2v8ln\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.219236 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.219211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-data\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.229739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.229704    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8ln\" (UniqueName: \"kubernetes.io/projected/380e9bd4-18ef-4f36-bc6c-8bb3581bae79-kube-api-access-2v8ln\") pod \"postgres-69fb4594cf-kzmdr\" (UID: \"380e9bd4-18ef-4f36-bc6c-8bb3581bae79\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.300979 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.300894    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:39.448683 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.448652    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"]
Jul 15 13:24:39.451272 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:39.451242    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380e9bd4_18ef_4f36_bc6c_8bb3581bae79.slice/crio-c6874b2c69b2c0ab171982b0464b20d84fd96506950b58cfaac517375491fc11 WatchSource:0}: Error finding container c6874b2c69b2c0ab171982b0464b20d84fd96506950b58cfaac517375491fc11: Status 404 returned error can't find the container with id c6874b2c69b2c0ab171982b0464b20d84fd96506950b58cfaac517375491fc11
Jul 15 13:24:39.884201 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:39.884163    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr" event={"ID":"380e9bd4-18ef-4f36-bc6c-8bb3581bae79","Type":"ContainerStarted","Data":"c6874b2c69b2c0ab171982b0464b20d84fd96506950b58cfaac517375491fc11"}
Jul 15 13:24:44.914421 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:44.914384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr" event={"ID":"380e9bd4-18ef-4f36-bc6c-8bb3581bae79","Type":"ContainerStarted","Data":"60660d852728dcde78e967001149b952c9923c43b678126acc6c0b5397f20bbf"}
Jul 15 13:24:44.914806 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:44.914509    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:44.933229 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:44.933175    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr" podStartSLOduration=2.012253036 podStartE2EDuration="6.933159677s" totalImagesPullingTime="4.920906641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:44.932499968 +0000 UTC m=+794.849307439" watchObservedRunningTime="2026-07-15 13:24:44.933159677 +0000 UTC m=+794.849967124"
Jul 15 13:24:50.950919 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:50.950889    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kzmdr"
Jul 15 13:24:51.579676 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.579637    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:51.584051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.584031    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:51.615351 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.615320    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:51.644574 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.644534    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2hx\" (UniqueName: \"kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx\") pod \"authorino-5d4b67c446-phm5d\" (UID: \"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8\") " pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:51.745720 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.745680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2hx\" (UniqueName: \"kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx\") pod \"authorino-5d4b67c446-phm5d\" (UID: \"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8\") " pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:51.758915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.758889    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2hx\" (UniqueName: \"kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx\") pod \"authorino-5d4b67c446-phm5d\" (UID: \"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8\") " pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:51.776674 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.776636    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:51.776914 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.776903    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:51.805528 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.805494    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:51.809542 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.809517    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:51.816079 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.816051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:51.847211 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.847142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zllk7\" (UniqueName: \"kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7\") pod \"authorino-db8745cfd-gdp9z\" (UID: \"234f4ee2-a4d4-4d00-939b-8f65dcbe693e\") " pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:51.917840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.917814    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:51.923512 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:51.923481    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94b1e17f_44c6_42d7_99bf_f8e3eac87ed8.slice/crio-103091d7f86d8a9d979973d674630bee7ffea3031134dc16487beee454275d4f WatchSource:0}: Error finding container 103091d7f86d8a9d979973d674630bee7ffea3031134dc16487beee454275d4f: Status 404 returned error can't find the container with id 103091d7f86d8a9d979973d674630bee7ffea3031134dc16487beee454275d4f
Jul 15 13:24:51.948044 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.948014    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllk7\" (UniqueName: \"kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7\") pod \"authorino-db8745cfd-gdp9z\" (UID: \"234f4ee2-a4d4-4d00-939b-8f65dcbe693e\") " pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:51.948335 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.948308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-phm5d" event={"ID":"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8","Type":"ContainerStarted","Data":"103091d7f86d8a9d979973d674630bee7ffea3031134dc16487beee454275d4f"}
Jul 15 13:24:51.957110 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:51.957082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllk7\" (UniqueName: \"kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7\") pod \"authorino-db8745cfd-gdp9z\" (UID: \"234f4ee2-a4d4-4d00-939b-8f65dcbe693e\") " pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:52.023185 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.023149    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:52.023454 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.023441    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:52.052752 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.052720    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:24:52.056727 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.056702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.059757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.059734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 13:24:52.065360 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.065334    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:24:52.150373 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.150344    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.150373 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.150377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nb4p\" (UniqueName: \"kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.165981 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.165957    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:52.168614 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:52.168590    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod234f4ee2_a4d4_4d00_939b_8f65dcbe693e.slice/crio-526050a55f19a55181bb69b672e14fc72a739bcf4d466f43b4feca79c4076f65 WatchSource:0}: Error finding container 526050a55f19a55181bb69b672e14fc72a739bcf4d466f43b4feca79c4076f65: Status 404 returned error can't find the container with id 526050a55f19a55181bb69b672e14fc72a739bcf4d466f43b4feca79c4076f65
Jul 15 13:24:52.251208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.251167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.251208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.251210    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nb4p\" (UniqueName: \"kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.253625 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.253608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.261060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.261035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nb4p\" (UniqueName: \"kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p\") pod \"authorino-fbcdb84d6-4vh8j\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") " pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.367999 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.367907    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:24:52.504375 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.504243    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:24:52.506516 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:52.506493    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod011d3f39_8406_4e85_9f83_740c113f3502.slice/crio-2842399ca6d7a6f69fa103daed9019c5f09ca042358cc5bdd232bb0bdb153c7b WatchSource:0}: Error finding container 2842399ca6d7a6f69fa103daed9019c5f09ca042358cc5bdd232bb0bdb153c7b: Status 404 returned error can't find the container with id 2842399ca6d7a6f69fa103daed9019c5f09ca042358cc5bdd232bb0bdb153c7b
Jul 15 13:24:52.956792 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.956702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-phm5d" event={"ID":"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8","Type":"ContainerStarted","Data":"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"}
Jul 15 13:24:52.956792 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.956744    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-phm5d" podUID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" containerName="authorino" containerID="cri-o://33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2" gracePeriod=30
Jul 15 13:24:52.958024 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.957999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" event={"ID":"011d3f39-8406-4e85-9f83-740c113f3502","Type":"ContainerStarted","Data":"2842399ca6d7a6f69fa103daed9019c5f09ca042358cc5bdd232bb0bdb153c7b"}
Jul 15 13:24:52.959476 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.959450    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db8745cfd-gdp9z" event={"ID":"234f4ee2-a4d4-4d00-939b-8f65dcbe693e","Type":"ContainerStarted","Data":"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"}
Jul 15 13:24:52.959577 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.959484    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db8745cfd-gdp9z" event={"ID":"234f4ee2-a4d4-4d00-939b-8f65dcbe693e","Type":"ContainerStarted","Data":"526050a55f19a55181bb69b672e14fc72a739bcf4d466f43b4feca79c4076f65"}
Jul 15 13:24:52.959577 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.959537    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-db8745cfd-gdp9z" podUID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" containerName="authorino" containerID="cri-o://0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212" gracePeriod=30
Jul 15 13:24:52.973567 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.973520    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-phm5d" podStartSLOduration=1.419340358 podStartE2EDuration="1.973504888s" totalImagesPullingTime="554.16453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:52.973239542 +0000 UTC m=+802.890047009" watchObservedRunningTime="2026-07-15 13:24:52.973504888 +0000 UTC m=+802.890312335"
Jul 15 13:24:52.991950 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:52.991896    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-db8745cfd-gdp9z" podStartSLOduration=1.490844317 podStartE2EDuration="1.991878744s" totalImagesPullingTime="501.034427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:52.990748199 +0000 UTC m=+802.907555668" watchObservedRunningTime="2026-07-15 13:24:52.991878744 +0000 UTC m=+802.908686240"
Jul 15 13:24:53.234541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.234510    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:53.242445 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.242422    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:53.259523 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.259494    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zllk7\" (UniqueName: \"kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7\") pod \"234f4ee2-a4d4-4d00-939b-8f65dcbe693e\" (UID: \"234f4ee2-a4d4-4d00-939b-8f65dcbe693e\") "
Jul 15 13:24:53.259711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.259606    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf2hx\" (UniqueName: \"kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx\") pod \"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8\" (UID: \"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8\") "
Jul 15 13:24:53.261896 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.261860    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7" (OuterVolumeSpecName: "kube-api-access-zllk7") pod "234f4ee2-a4d4-4d00-939b-8f65dcbe693e" (UID: "234f4ee2-a4d4-4d00-939b-8f65dcbe693e"). InnerVolumeSpecName "kube-api-access-zllk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:53.262028 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.261928    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx" (OuterVolumeSpecName: "kube-api-access-tf2hx") pod "94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" (UID: "94b1e17f-44c6-42d7-99bf-f8e3eac87ed8"). InnerVolumeSpecName "kube-api-access-tf2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:53.360494 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.360455    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf2hx\" (UniqueName: \"kubernetes.io/projected/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8-kube-api-access-tf2hx\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:53.360494 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.360490    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zllk7\" (UniqueName: \"kubernetes.io/projected/234f4ee2-a4d4-4d00-939b-8f65dcbe693e-kube-api-access-zllk7\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:53.965346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.965309    2571 generic.go:356] "Generic (PLEG): container finished" podID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" containerID="0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212" exitCode=0
Jul 15 13:24:53.965346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.965347    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db8745cfd-gdp9z"
Jul 15 13:24:53.965824 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.965397    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db8745cfd-gdp9z" event={"ID":"234f4ee2-a4d4-4d00-939b-8f65dcbe693e","Type":"ContainerDied","Data":"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"}
Jul 15 13:24:53.965824 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.965441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db8745cfd-gdp9z" event={"ID":"234f4ee2-a4d4-4d00-939b-8f65dcbe693e","Type":"ContainerDied","Data":"526050a55f19a55181bb69b672e14fc72a739bcf4d466f43b4feca79c4076f65"}
Jul 15 13:24:53.965824 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.965461    2571 scope.go:117] "RemoveContainer" containerID="0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"
Jul 15 13:24:53.966808 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.966669    2571 generic.go:356] "Generic (PLEG): container finished" podID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" containerID="33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2" exitCode=0
Jul 15 13:24:53.966808 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.966709    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-phm5d"
Jul 15 13:24:53.966808 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.966718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-phm5d" event={"ID":"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8","Type":"ContainerDied","Data":"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"}
Jul 15 13:24:53.966808 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.966773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-phm5d" event={"ID":"94b1e17f-44c6-42d7-99bf-f8e3eac87ed8","Type":"ContainerDied","Data":"103091d7f86d8a9d979973d674630bee7ffea3031134dc16487beee454275d4f"}
Jul 15 13:24:53.968539 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.968514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" event={"ID":"011d3f39-8406-4e85-9f83-740c113f3502","Type":"ContainerStarted","Data":"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"}
Jul 15 13:24:53.975445 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.975422    2571 scope.go:117] "RemoveContainer" containerID="0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"
Jul 15 13:24:53.975785 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:24:53.975757    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212\": container with ID starting with 0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212 not found: ID does not exist" containerID="0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"
Jul 15 13:24:53.975860 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.975789    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212"} err="failed to get container status \"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212\": rpc error: code = NotFound desc = could not find container \"0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212\": container with ID starting with 0d632bef0e2460afd0e64111b2c9de14e556c6841807f29008616a7e17ffe212 not found: ID does not exist"
Jul 15 13:24:53.975860 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.975810    2571 scope.go:117] "RemoveContainer" containerID="33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"
Jul 15 13:24:53.983770 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.983750    2571 scope.go:117] "RemoveContainer" containerID="33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"
Jul 15 13:24:53.984077 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:24:53.984058    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2\": container with ID starting with 33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2 not found: ID does not exist" containerID="33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"
Jul 15 13:24:53.984133 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.984086    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2"} err="failed to get container status \"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2\": rpc error: code = NotFound desc = could not find container \"33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2\": container with ID starting with 33fab6869bdeb44a705f292cae60053b367ec1f0ed3698c3b274bf2e97bd8ae2 not found: ID does not exist"
Jul 15 13:24:53.987605 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:53.987560    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" podStartSLOduration=1.369333151 podStartE2EDuration="1.98754605s" totalImagesPullingTime="618.212899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:24:53.98710116 +0000 UTC m=+803.903908629" watchObservedRunningTime="2026-07-15 13:24:53.98754605 +0000 UTC m=+803.904353498"
Jul 15 13:24:54.009494 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.009253    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:54.011201 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.011171    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-phm5d"]
Jul 15 13:24:54.017576 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.017507    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:54.017697 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.017675    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5bccg" podUID="65a80945-dee1-47ff-92f8-d2837439a044" containerName="authorino" containerID="cri-o://d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669" gracePeriod=30
Jul 15 13:24:54.028884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.028811    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:54.031164 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.031132    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-db8745cfd-gdp9z"]
Jul 15 13:24:54.275525 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.275466    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:54.369546 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.369516    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nb9g5\" (UniqueName: \"kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5\") pod \"65a80945-dee1-47ff-92f8-d2837439a044\" (UID: \"65a80945-dee1-47ff-92f8-d2837439a044\") "
Jul 15 13:24:54.371612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.371581    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5" (OuterVolumeSpecName: "kube-api-access-nb9g5") pod "65a80945-dee1-47ff-92f8-d2837439a044" (UID: "65a80945-dee1-47ff-92f8-d2837439a044"). InnerVolumeSpecName "kube-api-access-nb9g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:24:54.470928 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.470893    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb9g5\" (UniqueName: \"kubernetes.io/projected/65a80945-dee1-47ff-92f8-d2837439a044-kube-api-access-nb9g5\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:24:54.717469 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.717427    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" path="/var/lib/kubelet/pods/234f4ee2-a4d4-4d00-939b-8f65dcbe693e/volumes"
Jul 15 13:24:54.717849 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.717830    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" path="/var/lib/kubelet/pods/94b1e17f-44c6-42d7-99bf-f8e3eac87ed8/volumes"
Jul 15 13:24:54.975608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.975522    2571 generic.go:356] "Generic (PLEG): container finished" podID="65a80945-dee1-47ff-92f8-d2837439a044" containerID="d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669" exitCode=0
Jul 15 13:24:54.975608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.975564    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5bccg"
Jul 15 13:24:54.976105 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.975612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5bccg" event={"ID":"65a80945-dee1-47ff-92f8-d2837439a044","Type":"ContainerDied","Data":"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"}
Jul 15 13:24:54.976105 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.975655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5bccg" event={"ID":"65a80945-dee1-47ff-92f8-d2837439a044","Type":"ContainerDied","Data":"4563951fdbebf769bbc134f07f66aff48e2f0b7ce7cd6a834705b5083c2a7576"}
Jul 15 13:24:54.976105 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.975677    2571 scope.go:117] "RemoveContainer" containerID="d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"
Jul 15 13:24:54.984134 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.984116    2571 scope.go:117] "RemoveContainer" containerID="d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"
Jul 15 13:24:54.984438 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:24:54.984416    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669\": container with ID starting with d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669 not found: ID does not exist" containerID="d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"
Jul 15 13:24:54.984550 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.984447    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669"} err="failed to get container status \"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669\": rpc error: code = NotFound desc = could not find container \"d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669\": container with ID starting with d215ccf7548b5bb706ba3483f5dea66fedafebcf624d399459943bb45246a669 not found: ID does not exist"
Jul 15 13:24:54.995212 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.995182    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:54.999248 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:54.999225    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5bccg"]
Jul 15 13:24:56.724979 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:56.724946    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65a80945-dee1-47ff-92f8-d2837439a044" path="/var/lib/kubelet/pods/65a80945-dee1-47ff-92f8-d2837439a044/volumes"
Jul 15 13:24:58.942078 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942041    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942452    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" containerName="authorino"
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942464    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" containerName="authorino"
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942477    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" containerName="authorino"
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942485    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" containerName="authorino"
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942503    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a80945-dee1-47ff-92f8-d2837439a044" containerName="authorino"
Jul 15 13:24:58.942505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942509    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a80945-dee1-47ff-92f8-d2837439a044" containerName="authorino"
Jul 15 13:24:58.942691 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942577    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a80945-dee1-47ff-92f8-d2837439a044" containerName="authorino"
Jul 15 13:24:58.942691 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942590    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="94b1e17f-44c6-42d7-99bf-f8e3eac87ed8" containerName="authorino"
Jul 15 13:24:58.942691 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:58.942596    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="234f4ee2-a4d4-4d00-939b-8f65dcbe693e" containerName="authorino"
Jul 15 13:24:59.108548 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.108510    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:24:59.108741 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.108642    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.113235 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.113207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 13:24:59.113235 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.113229    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2v7pw\""
Jul 15 13:24:59.113436 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.113213    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:24:59.211360 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.211237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgh26\" (UniqueName: \"kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.211514 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.211398    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.312675 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.312630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.312852 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.312685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgh26\" (UniqueName: \"kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.315112 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.315081    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.323567 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.323541    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgh26\" (UniqueName: \"kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26\") pod \"maas-controller-dcb58757c-n9fl2\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") " pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.419419 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.419379    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:24:59.610820 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:24:59.610790    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:24:59.613071 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:24:59.613045    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7400de0_fd5e_46fa_942a_c753115c77f7.slice/crio-c5421b3e7320122ce94c1cb2102d97f4ee456403d509e77fa7fbc5afbc521cc2 WatchSource:0}: Error finding container c5421b3e7320122ce94c1cb2102d97f4ee456403d509e77fa7fbc5afbc521cc2: Status 404 returned error can't find the container with id c5421b3e7320122ce94c1cb2102d97f4ee456403d509e77fa7fbc5afbc521cc2
Jul 15 13:25:00.003594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:00.003560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-n9fl2" event={"ID":"f7400de0-fd5e-46fa-942a-c753115c77f7","Type":"ContainerStarted","Data":"c5421b3e7320122ce94c1cb2102d97f4ee456403d509e77fa7fbc5afbc521cc2"}
Jul 15 13:25:03.021164 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:03.021129    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-n9fl2" event={"ID":"f7400de0-fd5e-46fa-942a-c753115c77f7","Type":"ContainerStarted","Data":"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"}
Jul 15 13:25:03.021583 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:03.021189    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:25:03.041759 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:03.041702    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dcb58757c-n9fl2" podStartSLOduration=2.580585292 podStartE2EDuration="5.041686061s" totalImagesPullingTime="2.461100769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:03.04118037 +0000 UTC m=+812.957987844" watchObservedRunningTime="2026-07-15 13:25:03.041686061 +0000 UTC m=+812.958493545"
Jul 15 13:25:14.028172 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:14.028140    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:25:38.624107 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.624072    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-nphqg"]
Jul 15 13:25:38.629537 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.629503    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.632465 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.632439    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 13:25:38.632605 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.632444    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l68nn\""
Jul 15 13:25:38.638822 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.638795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-nphqg"]
Jul 15 13:25:38.673502 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.673464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78780206-1817-4cc1-8754-51af229537ac-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.673680 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.673535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gkjl\" (UniqueName: \"kubernetes.io/projected/78780206-1817-4cc1-8754-51af229537ac-kube-api-access-5gkjl\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.774504 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.774463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78780206-1817-4cc1-8754-51af229537ac-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.774702 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.774527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gkjl\" (UniqueName: \"kubernetes.io/projected/78780206-1817-4cc1-8754-51af229537ac-kube-api-access-5gkjl\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.775247 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.775228    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/78780206-1817-4cc1-8754-51af229537ac-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.783333 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.783269    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gkjl\" (UniqueName: \"kubernetes.io/projected/78780206-1817-4cc1-8754-51af229537ac-kube-api-access-5gkjl\") pod \"payload-processing-f9b8d9b9b-nphqg\" (UID: \"78780206-1817-4cc1-8754-51af229537ac\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:38.925445 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.925361    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:25:38.940739 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:38.940706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:39.093946 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:39.093870    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-nphqg"]
Jul 15 13:25:39.096604 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:25:39.096578    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78780206_1817_4cc1_8754_51af229537ac.slice/crio-85161f06f8dca677ba6603d9438fd266bb581885bfb228670ceddb08146d202b WatchSource:0}: Error finding container 85161f06f8dca677ba6603d9438fd266bb581885bfb228670ceddb08146d202b: Status 404 returned error can't find the container with id 85161f06f8dca677ba6603d9438fd266bb581885bfb228670ceddb08146d202b
Jul 15 13:25:39.207182 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:39.207085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg" event={"ID":"78780206-1817-4cc1-8754-51af229537ac","Type":"ContainerStarted","Data":"85161f06f8dca677ba6603d9438fd266bb581885bfb228670ceddb08146d202b"}
Jul 15 13:25:41.220261 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:41.220224    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg" event={"ID":"78780206-1817-4cc1-8754-51af229537ac","Type":"ContainerStarted","Data":"1b934bc06def0fdcb6bab9d941a47bdb57e0323c5ec98e23cc384556885e27c7"}
Jul 15 13:25:41.220683 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:41.220351    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:41.240473 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:41.240403    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg" podStartSLOduration=1.9630296820000002 podStartE2EDuration="3.240382835s" totalImagesPullingTime="1.277353153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:41.239944615 +0000 UTC m=+851.156752064" watchObservedRunningTime="2026-07-15 13:25:41.240382835 +0000 UTC m=+851.157190284"
Jul 15 13:25:52.227491 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:52.227453    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-nphqg"
Jul 15 13:25:53.891234 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.891195    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"]
Jul 15 13:25:53.894423 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.894400    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.897599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.897554    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 13:25:53.897599 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.897598    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gr4gv\""
Jul 15 13:25:53.897791 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.897607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 13:25:53.898830 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.898814    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 13:25:53.905589 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.905568    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"]
Jul 15 13:25:53.994101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.994101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.994341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994131    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.994341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994181    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62r47\" (UniqueName: \"kubernetes.io/projected/eecf5178-a55c-40c6-8daa-1b6f01acc02e-kube-api-access-62r47\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.994341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:53.994341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:53.994334    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095678 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095678 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095917 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095917 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095917 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095766    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.095917 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.095796    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62r47\" (UniqueName: \"kubernetes.io/projected/eecf5178-a55c-40c6-8daa-1b6f01acc02e-kube-api-access-62r47\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.096162 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.096135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.096234 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.096147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.096497 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.096455    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.098310 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.098271    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eecf5178-a55c-40c6-8daa-1b6f01acc02e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.098430 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.098411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eecf5178-a55c-40c6-8daa-1b6f01acc02e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.105683 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.105653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62r47\" (UniqueName: \"kubernetes.io/projected/eecf5178-a55c-40c6-8daa-1b6f01acc02e-kube-api-access-62r47\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q\" (UID: \"eecf5178-a55c-40c6-8daa-1b6f01acc02e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.206645 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.206574    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:25:54.370943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.370911    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"]
Jul 15 13:25:54.374661 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:25:54.374635    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecf5178_a55c_40c6_8daa_1b6f01acc02e.slice/crio-59691458427b6ee6954007ba93625d09080b520c46105658988fa87fc9b9dbf0 WatchSource:0}: Error finding container 59691458427b6ee6954007ba93625d09080b520c46105658988fa87fc9b9dbf0: Status 404 returned error can't find the container with id 59691458427b6ee6954007ba93625d09080b520c46105658988fa87fc9b9dbf0
Jul 15 13:25:54.584030 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:54.583993    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:25:55.293241 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:55.293200    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q" event={"ID":"eecf5178-a55c-40c6-8daa-1b6f01acc02e","Type":"ContainerStarted","Data":"59691458427b6ee6954007ba93625d09080b520c46105658988fa87fc9b9dbf0"}
Jul 15 13:25:56.299500 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:56.299466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q" event={"ID":"eecf5178-a55c-40c6-8daa-1b6f01acc02e","Type":"ContainerStarted","Data":"f00cccec117de23009ed3ef82d73b2b6049be7251af9e62640b2520e9b87092d"}
Jul 15 13:25:56.319192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:25:56.319133    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q" podStartSLOduration=1.8763399079999998 podStartE2EDuration="3.319118129s" totalImagesPullingTime="1.442778221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:25:56.317488386 +0000 UTC m=+866.234295857" watchObservedRunningTime="2026-07-15 13:25:56.319118129 +0000 UTC m=+866.235925578"
Jul 15 13:26:04.207634 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:04.207601    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:26:04.208081 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:04.207678    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:26:04.220518 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:04.220492    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:26:04.352192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:04.352159    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q"
Jul 15 13:26:12.508928 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:12.508894    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:26:30.595178 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:30.595149    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:26:30.597456 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:30.597430    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:26:40.296756 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:40.296714    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:26:56.683655 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.683620    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"]
Jul 15 13:26:56.687612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.687588    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.690439 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.690413    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 13:26:56.699461 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.699431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"]
Jul 15 13:26:56.757048 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757010    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.757243 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.757243 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djr7w\" (UniqueName: \"kubernetes.io/projected/fedc9504-da12-418a-9360-cff270bb0e61-kube-api-access-djr7w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.757243 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757218    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedc9504-da12-418a-9360-cff270bb0e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.757405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757302    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.757405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.757390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858479 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858442    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858479 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djr7w\" (UniqueName: \"kubernetes.io/projected/fedc9504-da12-418a-9360-cff270bb0e61-kube-api-access-djr7w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedc9504-da12-418a-9360-cff270bb0e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.858757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858601    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.859093 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.859093 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.859093 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.858992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.860768 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.860740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fedc9504-da12-418a-9360-cff270bb0e61-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.861183 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.861159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fedc9504-da12-418a-9360-cff270bb0e61-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:56.867815 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:56.867789    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djr7w\" (UniqueName: \"kubernetes.io/projected/fedc9504-da12-418a-9360-cff270bb0e61-kube-api-access-djr7w\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9\" (UID: \"fedc9504-da12-418a-9360-cff270bb0e61\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:57.002102 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:57.001975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:26:57.143770 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:57.143745    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"]
Jul 15 13:26:57.147444 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:26:57.147415    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedc9504_da12_418a_9360_cff270bb0e61.slice/crio-5bc8076ee9bc3c16744f1c865b2af5e5706cbcff50ba69b402588f7ff94ff564 WatchSource:0}: Error finding container 5bc8076ee9bc3c16744f1c865b2af5e5706cbcff50ba69b402588f7ff94ff564: Status 404 returned error can't find the container with id 5bc8076ee9bc3c16744f1c865b2af5e5706cbcff50ba69b402588f7ff94ff564
Jul 15 13:26:57.617977 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:57.617946    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9" event={"ID":"fedc9504-da12-418a-9360-cff270bb0e61","Type":"ContainerStarted","Data":"e2e0a5e54b2f61592850559c1442d3120c51df7b6f03bfc25b772f13111803a9"}
Jul 15 13:26:57.618153 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:57.617996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9" event={"ID":"fedc9504-da12-418a-9360-cff270bb0e61","Type":"ContainerStarted","Data":"5bc8076ee9bc3c16744f1c865b2af5e5706cbcff50ba69b402588f7ff94ff564"}
Jul 15 13:26:57.639594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:57.639488    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9" podStartSLOduration=1.4040984970000001 podStartE2EDuration="1.63947185s" totalImagesPullingTime="235.373353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:26:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:26:57.63775608 +0000 UTC m=+927.554563529" watchObservedRunningTime="2026-07-15 13:26:57.63947185 +0000 UTC m=+927.556279277"
Jul 15 13:26:58.300001 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:26:58.299966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:27:06.298924 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:06.298878    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:27:07.003006 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:07.002964    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:27:07.003222 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:07.003048    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:27:07.015389 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:07.015356    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:27:07.681125 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:07.681062    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9"
Jul 15 13:27:17.986635 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:27:17.986597    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:28:15.281062 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.281024    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77464bdd47-44mnz"]
Jul 15 13:28:15.284811 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.284789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.292177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.292147    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77464bdd47-44mnz"]
Jul 15 13:28:15.385574 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.385517    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rblcw\" (UniqueName: \"kubernetes.io/projected/a38ee069-ba33-4f8d-b233-77203524f57a-kube-api-access-rblcw\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.385746 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.385653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a38ee069-ba33-4f8d-b233-77203524f57a-tls-cert\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.487139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.487098    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a38ee069-ba33-4f8d-b233-77203524f57a-tls-cert\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.487349 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.487178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rblcw\" (UniqueName: \"kubernetes.io/projected/a38ee069-ba33-4f8d-b233-77203524f57a-kube-api-access-rblcw\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.489565 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.489543    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a38ee069-ba33-4f8d-b233-77203524f57a-tls-cert\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.498068 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.497118    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rblcw\" (UniqueName: \"kubernetes.io/projected/a38ee069-ba33-4f8d-b233-77203524f57a-kube-api-access-rblcw\") pod \"authorino-77464bdd47-44mnz\" (UID: \"a38ee069-ba33-4f8d-b233-77203524f57a\") " pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.594608 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.594578    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77464bdd47-44mnz"
Jul 15 13:28:15.742160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.742128    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77464bdd47-44mnz"]
Jul 15 13:28:15.744432 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:28:15.744401    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38ee069_ba33_4f8d_b233_77203524f57a.slice/crio-82aff320ec3b66f79f404cb6887fff2a42b147c42b5cf869445b31fc8de60f18 WatchSource:0}: Error finding container 82aff320ec3b66f79f404cb6887fff2a42b147c42b5cf869445b31fc8de60f18: Status 404 returned error can't find the container with id 82aff320ec3b66f79f404cb6887fff2a42b147c42b5cf869445b31fc8de60f18
Jul 15 13:28:15.745893 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:15.745862    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:28:16.009101 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:16.009003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77464bdd47-44mnz" event={"ID":"a38ee069-ba33-4f8d-b233-77203524f57a","Type":"ContainerStarted","Data":"82aff320ec3b66f79f404cb6887fff2a42b147c42b5cf869445b31fc8de60f18"}
Jul 15 13:28:17.017988 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.017942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77464bdd47-44mnz" event={"ID":"a38ee069-ba33-4f8d-b233-77203524f57a","Type":"ContainerStarted","Data":"abd21d8bc18afbb238dd25cfbf8d3f6f6186e8958d0353af46f442e4f24d7ca0"}
Jul 15 13:28:17.078245 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.078178    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77464bdd47-44mnz" podStartSLOduration=1.626624497 podStartE2EDuration="2.078153692s" totalImagesPullingTime="451.529195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:28:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:28:17.072381551 +0000 UTC m=+1006.989189014" watchObservedRunningTime="2026-07-15 13:28:17.078153692 +0000 UTC m=+1006.994961140"
Jul 15 13:28:17.189128 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.189084    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:28:17.189353 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.189324    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" podUID="011d3f39-8406-4e85-9f83-740c113f3502" containerName="authorino" containerID="cri-o://683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7" gracePeriod=30
Jul 15 13:28:17.473805 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.473779    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:28:17.606076 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.606031    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert\") pod \"011d3f39-8406-4e85-9f83-740c113f3502\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") "
Jul 15 13:28:17.606267 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.606130    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nb4p\" (UniqueName: \"kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p\") pod \"011d3f39-8406-4e85-9f83-740c113f3502\" (UID: \"011d3f39-8406-4e85-9f83-740c113f3502\") "
Jul 15 13:28:17.608135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.608109    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p" (OuterVolumeSpecName: "kube-api-access-8nb4p") pod "011d3f39-8406-4e85-9f83-740c113f3502" (UID: "011d3f39-8406-4e85-9f83-740c113f3502"). InnerVolumeSpecName "kube-api-access-8nb4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:28:17.617948 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.617915    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "011d3f39-8406-4e85-9f83-740c113f3502" (UID: "011d3f39-8406-4e85-9f83-740c113f3502"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:28:17.707119 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.707084    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nb4p\" (UniqueName: \"kubernetes.io/projected/011d3f39-8406-4e85-9f83-740c113f3502-kube-api-access-8nb4p\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:28:17.707119 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:17.707120    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/011d3f39-8406-4e85-9f83-740c113f3502-tls-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:28:18.024159 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.024071    2571 generic.go:356] "Generic (PLEG): container finished" podID="011d3f39-8406-4e85-9f83-740c113f3502" containerID="683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7" exitCode=0
Jul 15 13:28:18.024159 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.024113    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j"
Jul 15 13:28:18.024710 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.024159    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" event={"ID":"011d3f39-8406-4e85-9f83-740c113f3502","Type":"ContainerDied","Data":"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"}
Jul 15 13:28:18.024710 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.024205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-fbcdb84d6-4vh8j" event={"ID":"011d3f39-8406-4e85-9f83-740c113f3502","Type":"ContainerDied","Data":"2842399ca6d7a6f69fa103daed9019c5f09ca042358cc5bdd232bb0bdb153c7b"}
Jul 15 13:28:18.024710 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.024228    2571 scope.go:117] "RemoveContainer" containerID="683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"
Jul 15 13:28:18.035127 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.035109    2571 scope.go:117] "RemoveContainer" containerID="683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"
Jul 15 13:28:18.035464 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:28:18.035446    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7\": container with ID starting with 683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7 not found: ID does not exist" containerID="683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"
Jul 15 13:28:18.035542 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.035475    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7"} err="failed to get container status \"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7\": rpc error: code = NotFound desc = could not find container \"683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7\": container with ID starting with 683ab5832a2fd5443bacf39c6798f67b98e0c778cbc441c28046228f8aa709b7 not found: ID does not exist"
Jul 15 13:28:18.051550 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.051517    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:28:18.055877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.055839    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-fbcdb84d6-4vh8j"]
Jul 15 13:28:18.718616 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:18.718582    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="011d3f39-8406-4e85-9f83-740c113f3502" path="/var/lib/kubelet/pods/011d3f39-8406-4e85-9f83-740c113f3502/volumes"
Jul 15 13:28:45.909452 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:45.909410    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:28:55.499387 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:28:55.499355    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:29:08.091873 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:08.091835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:29:16.290172 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:16.290130    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:29:27.713782 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:27.713700    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:29:28.844591 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:28.844556    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:29:28.845038 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:28.844819    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dcb58757c-n9fl2" podUID="f7400de0-fd5e-46fa-942a-c753115c77f7" containerName="manager" containerID="cri-o://df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb" gracePeriod=30
Jul 15 13:29:29.100602 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.100533    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:29:29.145819 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.145781    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgh26\" (UniqueName: \"kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26\") pod \"f7400de0-fd5e-46fa-942a-c753115c77f7\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") "
Jul 15 13:29:29.146001 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.145847    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert\") pod \"f7400de0-fd5e-46fa-942a-c753115c77f7\" (UID: \"f7400de0-fd5e-46fa-942a-c753115c77f7\") "
Jul 15 13:29:29.148152 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.148118    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f7400de0-fd5e-46fa-942a-c753115c77f7" (UID: "f7400de0-fd5e-46fa-942a-c753115c77f7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:29:29.148272 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.148190    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26" (OuterVolumeSpecName: "kube-api-access-dgh26") pod "f7400de0-fd5e-46fa-942a-c753115c77f7" (UID: "f7400de0-fd5e-46fa-942a-c753115c77f7"). InnerVolumeSpecName "kube-api-access-dgh26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:29:29.247226 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.247184    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f7400de0-fd5e-46fa-942a-c753115c77f7-webhook-cert\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:29:29.247226 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.247228    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgh26\" (UniqueName: \"kubernetes.io/projected/f7400de0-fd5e-46fa-942a-c753115c77f7-kube-api-access-dgh26\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:29:29.403223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.403139    2571 generic.go:356] "Generic (PLEG): container finished" podID="f7400de0-fd5e-46fa-942a-c753115c77f7" containerID="df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb" exitCode=0
Jul 15 13:29:29.403223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.403182    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-n9fl2"
Jul 15 13:29:29.403223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.403188    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-n9fl2" event={"ID":"f7400de0-fd5e-46fa-942a-c753115c77f7","Type":"ContainerDied","Data":"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"}
Jul 15 13:29:29.403487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.403229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-n9fl2" event={"ID":"f7400de0-fd5e-46fa-942a-c753115c77f7","Type":"ContainerDied","Data":"c5421b3e7320122ce94c1cb2102d97f4ee456403d509e77fa7fbc5afbc521cc2"}
Jul 15 13:29:29.403487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.403251    2571 scope.go:117] "RemoveContainer" containerID="df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"
Jul 15 13:29:29.416202 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.416180    2571 scope.go:117] "RemoveContainer" containerID="df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"
Jul 15 13:29:29.416525 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:29:29.416502    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb\": container with ID starting with df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb not found: ID does not exist" containerID="df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"
Jul 15 13:29:29.416598 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.416534    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb"} err="failed to get container status \"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb\": rpc error: code = NotFound desc = could not find container \"df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb\": container with ID starting with df209ad0797413afeac91cbb6e3e691acc28ed80f3fad109cd2f2c3525f4bdeb not found: ID does not exist"
Jul 15 13:29:29.432911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.432879    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:29:29.437780 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:29.437754    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dcb58757c-n9fl2"]
Jul 15 13:29:30.268575 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.268534    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dcb58757c-9k69x"]
Jul 15 13:29:30.269140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269119    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011d3f39-8406-4e85-9f83-740c113f3502" containerName="authorino"
Jul 15 13:29:30.269230 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269144    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="011d3f39-8406-4e85-9f83-740c113f3502" containerName="authorino"
Jul 15 13:29:30.269230 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269154    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7400de0-fd5e-46fa-942a-c753115c77f7" containerName="manager"
Jul 15 13:29:30.269230 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269162    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7400de0-fd5e-46fa-942a-c753115c77f7" containerName="manager"
Jul 15 13:29:30.269437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269322    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="011d3f39-8406-4e85-9f83-740c113f3502" containerName="authorino"
Jul 15 13:29:30.269437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.269345    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7400de0-fd5e-46fa-942a-c753115c77f7" containerName="manager"
Jul 15 13:29:30.273830 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.273810    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.277400 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.277384    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2v7pw\""
Jul 15 13:29:30.278678 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.278658    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 13:29:30.278782 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.278666    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:29:30.283772 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.283748    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb58757c-9k69x"]
Jul 15 13:29:30.358187 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.358149    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920036f6-c17e-48c1-b395-fa652049d1e6-webhook-cert\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.358397 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.358249    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpr22\" (UniqueName: \"kubernetes.io/projected/920036f6-c17e-48c1-b395-fa652049d1e6-kube-api-access-lpr22\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.459394 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.459351    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpr22\" (UniqueName: \"kubernetes.io/projected/920036f6-c17e-48c1-b395-fa652049d1e6-kube-api-access-lpr22\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.459582 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.459441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920036f6-c17e-48c1-b395-fa652049d1e6-webhook-cert\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.461881 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.461860    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920036f6-c17e-48c1-b395-fa652049d1e6-webhook-cert\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.470164 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.470138    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpr22\" (UniqueName: \"kubernetes.io/projected/920036f6-c17e-48c1-b395-fa652049d1e6-kube-api-access-lpr22\") pod \"maas-controller-dcb58757c-9k69x\" (UID: \"920036f6-c17e-48c1-b395-fa652049d1e6\") " pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.587833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.587804    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2v7pw\""
Jul 15 13:29:30.595192 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.595164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:30.652939 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.652909    2571 scope.go:117] "RemoveContainer" containerID="884a903ba1744ea8e550b273749d1cf5bdc8de2ad68e4cd10e6addc0cf833688"
Jul 15 13:29:30.718624 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.718593    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7400de0-fd5e-46fa-942a-c753115c77f7" path="/var/lib/kubelet/pods/f7400de0-fd5e-46fa-942a-c753115c77f7/volumes"
Jul 15 13:29:30.747534 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:30.747512    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dcb58757c-9k69x"]
Jul 15 13:29:30.748672 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:29:30.748638    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920036f6_c17e_48c1_b395_fa652049d1e6.slice/crio-aa78198a019ef8b9dd0e53ab58651c62a1a4448293425c60fd3516f6871e9e87 WatchSource:0}: Error finding container aa78198a019ef8b9dd0e53ab58651c62a1a4448293425c60fd3516f6871e9e87: Status 404 returned error can't find the container with id aa78198a019ef8b9dd0e53ab58651c62a1a4448293425c60fd3516f6871e9e87
Jul 15 13:29:31.197691 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:31.197669    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 13:29:31.415848 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:31.415813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-9k69x" event={"ID":"920036f6-c17e-48c1-b395-fa652049d1e6","Type":"ContainerStarted","Data":"d355d0b34e369d534238c0802fd7d362d26f261d470b590e12d6dcf4e1300e7f"}
Jul 15 13:29:31.416350 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:31.415868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dcb58757c-9k69x" event={"ID":"920036f6-c17e-48c1-b395-fa652049d1e6","Type":"ContainerStarted","Data":"aa78198a019ef8b9dd0e53ab58651c62a1a4448293425c60fd3516f6871e9e87"}
Jul 15 13:29:31.416350 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:31.415912    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:31.438326 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:31.438259    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dcb58757c-9k69x" podStartSLOduration=0.994125896 podStartE2EDuration="1.438243308s" totalImagesPullingTime="444.117412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:29:31.43638288 +0000 UTC m=+1081.353190341" watchObservedRunningTime="2026-07-15 13:29:31.438243308 +0000 UTC m=+1081.355050760"
Jul 15 13:29:42.423201 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:42.423173    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dcb58757c-9k69x"
Jul 15 13:29:54.236236 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:29:54.236196    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:30:06.517821 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:30:06.517785    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:30:50.219193 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:30:50.219157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:00.700251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:00.700211    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:10.108270 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:10.108236    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:18.096015 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:18.095979    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:29.827634 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:29.827574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:30.629517 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:30.629489    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:31:30.634100 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:30.634076    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:31:41.164692 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:41.164655    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:31:52.128850 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:31:52.128806    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:32:02.013293 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:32:02.013236    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:32:24.308492 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:32:24.308405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:32:37.003077 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:32:37.003046    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:01.302851 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:01.302810    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:12.191089 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:12.191056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:21.798519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:21.798484    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:29.605394 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:29.605357    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:40.000114 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:40.000076    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:33:50.025560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:33:50.025522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:34:01.693175 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:01.693141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:34:33.799650 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:33.799615    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:34:33.800215 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:33.799829    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" podUID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" containerName="manager" containerID="cri-o://9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75" gracePeriod=10
Jul 15 13:34:36.860513 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.860487    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:34:36.964938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.964843    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume\") pod \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") "
Jul 15 13:34:36.964938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.964886    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrdf4\" (UniqueName: \"kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4\") pod \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\" (UID: \"014c07fb-3bf6-4124-a4f2-8a3c83805fce\") "
Jul 15 13:34:36.965238 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.965215    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "014c07fb-3bf6-4124-a4f2-8a3c83805fce" (UID: "014c07fb-3bf6-4124-a4f2-8a3c83805fce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:34:36.967030 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.967001    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4" (OuterVolumeSpecName: "kube-api-access-hrdf4") pod "014c07fb-3bf6-4124-a4f2-8a3c83805fce" (UID: "014c07fb-3bf6-4124-a4f2-8a3c83805fce"). InnerVolumeSpecName "kube-api-access-hrdf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:34:36.995878 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.995837    2571 generic.go:356] "Generic (PLEG): container finished" podID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" containerID="9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75" exitCode=0
Jul 15 13:34:36.996047 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.995889    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"
Jul 15 13:34:36.996047 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.995890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" event={"ID":"014c07fb-3bf6-4124-a4f2-8a3c83805fce","Type":"ContainerDied","Data":"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"}
Jul 15 13:34:36.996047 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.996031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz" event={"ID":"014c07fb-3bf6-4124-a4f2-8a3c83805fce","Type":"ContainerDied","Data":"92a27449e1c446305218598a33ad5616eabd22753c8d7a41a3d8a153ab9ab586"}
Jul 15 13:34:36.996171 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:36.996064    2571 scope.go:117] "RemoveContainer" containerID="9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"
Jul 15 13:34:37.010768 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.010747    2571 scope.go:117] "RemoveContainer" containerID="9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"
Jul 15 13:34:37.011122 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:34:37.011098    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75\": container with ID starting with 9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75 not found: ID does not exist" containerID="9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"
Jul 15 13:34:37.011215 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.011130    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75"} err="failed to get container status \"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75\": rpc error: code = NotFound desc = could not find container \"9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75\": container with ID starting with 9a89bd68352a30ef7e7800c4d88f358b26462cd18e6df9b6abd3220d4169be75 not found: ID does not exist"
Jul 15 13:34:37.028287 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.028239    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:34:37.033225 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.033193    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cpzlz"]
Jul 15 13:34:37.066546 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.066510    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014c07fb-3bf6-4124-a4f2-8a3c83805fce-extensions-socket-volume\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:34:37.066546 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:37.066538    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdf4\" (UniqueName: \"kubernetes.io/projected/014c07fb-3bf6-4124-a4f2-8a3c83805fce-kube-api-access-hrdf4\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:34:38.717345 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:34:38.717313    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" path="/var/lib/kubelet/pods/014c07fb-3bf6-4124-a4f2-8a3c83805fce/volumes"
Jul 15 13:35:35.007250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.007214    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"]
Jul 15 13:35:35.007741 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.007722    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" containerName="manager"
Jul 15 13:35:35.007791 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.007743    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" containerName="manager"
Jul 15 13:35:35.007832 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.007823    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="014c07fb-3bf6-4124-a4f2-8a3c83805fce" containerName="manager"
Jul 15 13:35:35.011998 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.011982    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.015200 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.015178    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nvxgg\""
Jul 15 13:35:35.024325 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.024299    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"]
Jul 15 13:35:35.085399 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.085362    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f921c98b-8270-4f7b-a662-f973568145d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.085399 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.085400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwqk5\" (UniqueName: \"kubernetes.io/projected/f921c98b-8270-4f7b-a662-f973568145d2-kube-api-access-zwqk5\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.186633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.186590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f921c98b-8270-4f7b-a662-f973568145d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.186633 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.186633    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwqk5\" (UniqueName: \"kubernetes.io/projected/f921c98b-8270-4f7b-a662-f973568145d2-kube-api-access-zwqk5\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.187065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.187046    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f921c98b-8270-4f7b-a662-f973568145d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.199145 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.199115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwqk5\" (UniqueName: \"kubernetes.io/projected/f921c98b-8270-4f7b-a662-f973568145d2-kube-api-access-zwqk5\") pod \"kuadrant-operator-controller-manager-86878c769f-slprx\" (UID: \"f921c98b-8270-4f7b-a662-f973568145d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.321833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.321747    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:35.475833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:35.475727    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"]
Jul 15 13:35:35.478364 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:35:35.478338    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf921c98b_8270_4f7b_a662_f973568145d2.slice/crio-23ef97c8ab15a828dd6240e8c39aa1d4b01eaf05cd5ac7e037af74a6d9886b71 WatchSource:0}: Error finding container 23ef97c8ab15a828dd6240e8c39aa1d4b01eaf05cd5ac7e037af74a6d9886b71: Status 404 returned error can't find the container with id 23ef97c8ab15a828dd6240e8c39aa1d4b01eaf05cd5ac7e037af74a6d9886b71
Jul 15 13:35:36.290616 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:36.290583    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx" event={"ID":"f921c98b-8270-4f7b-a662-f973568145d2","Type":"ContainerStarted","Data":"3e5e6941dc421cc310964ba9bd98dabb8881d3f25058dfc4fdbdeacc95a571df"}
Jul 15 13:35:36.290616 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:36.290635    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx" event={"ID":"f921c98b-8270-4f7b-a662-f973568145d2","Type":"ContainerStarted","Data":"23ef97c8ab15a828dd6240e8c39aa1d4b01eaf05cd5ac7e037af74a6d9886b71"}
Jul 15 13:35:36.291157 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:36.290671    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:36.313066 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:36.313009    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx" podStartSLOduration=2.312992368 podStartE2EDuration="2.312992368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:35:36.311943536 +0000 UTC m=+1446.228751006" watchObservedRunningTime="2026-07-15 13:35:36.312992368 +0000 UTC m=+1446.229799817"
Jul 15 13:35:47.297696 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:47.297663    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-slprx"
Jul 15 13:35:57.203139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:35:57.203092    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:36:08.891235 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:08.891199    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:36:19.996662 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:19.996626    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:36:30.660054 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:30.660026    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:36:30.666060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:30.666038    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:36:34.696187 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:34.696146    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:36:44.344504 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:44.344469    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:36:54.194330 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:36:54.194228    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:37:03.120250 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:37:03.120212    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:37:14.999642 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:37:14.999603    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:37:26.094973 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:37:26.094935    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:37:34.189424 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:37:34.189392    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:37:45.499035 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:37:45.499001    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:09.889246 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:09.889207    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:17.420512 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:17.420476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:27.895405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:27.895319    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:38.104933 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:38.104900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:46.126087 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:46.126057    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:38:58.795555 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:38:58.795521    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:39:08.605196 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:39:08.605157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:39:17.696426 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:39:17.696387    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:39:28.603065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:39:28.603022    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:39:38.615149 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:39:38.615106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:39:49.522987 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:39:49.522953    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:40:01.004566 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:40:01.004522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:40:15.797571 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:40:15.797534    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:40:25.707437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:40:25.707398    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:40:36.201030 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:40:36.200987    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:40:48.791892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:40:48.791854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:41:05.693039 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:05.692997    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:41:17.893686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:17.893643    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:41:29.108308 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:29.108262    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:41:30.691933 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:30.691899    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:41:30.698501 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:30.698477    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:41:36.327779 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:36.327738    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:41:52.596315 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:41:52.596265    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:42:07.987788 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:07.987750    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:42:21.619496 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.619455    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:42:21.623179 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.623155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.626436 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.626404    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-17469591-serving-cert\""
Jul 15 13:42:21.626823 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.626499    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:42:21.632107 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.632084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.632259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.632119    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wztpk\" (UniqueName: \"kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.632259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.632142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.637428 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.637399    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:42:21.732920 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.732884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.733095 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.732925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wztpk\" (UniqueName: \"kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.733095 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.732967    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.733095 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:42:21.733075    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-serving-cert: secret "maas-api-e2e-migrate-17469591-serving-cert" not found
Jul 15 13:42:21.733209 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:42:21.733157    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls podName:c1e74d9b-1df6-4329-a543-1f2616ba7b86 nodeName:}" failed. No retries permitted until 2026-07-15 13:42:22.233135125 +0000 UTC m=+1852.149942566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls") pod "maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" (UID: "c1e74d9b-1df6-4329-a543-1f2616ba7b86") : secret "maas-api-e2e-migrate-17469591-serving-cert" not found
Jul 15 13:42:21.733825 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.733801    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:21.742937 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:21.742906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wztpk\" (UniqueName: \"kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:22.239356 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:22.239315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:22.241940 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:22.241908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") pod \"maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:22.536188 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:22.536090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:22.685856 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:22.685824    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:42:22.687815 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:42:22.687787    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e74d9b_1df6_4329_a543_1f2616ba7b86.slice/crio-34f01b75847562931c958f83071b6a9afc8121b08025f40de64dc1d4039a023d WatchSource:0}: Error finding container 34f01b75847562931c958f83071b6a9afc8121b08025f40de64dc1d4039a023d: Status 404 returned error can't find the container with id 34f01b75847562931c958f83071b6a9afc8121b08025f40de64dc1d4039a023d
Jul 15 13:42:22.689824 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:22.689806    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:42:23.362346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:23.362312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" event={"ID":"c1e74d9b-1df6-4329-a543-1f2616ba7b86","Type":"ContainerStarted","Data":"34f01b75847562931c958f83071b6a9afc8121b08025f40de64dc1d4039a023d"}
Jul 15 13:42:27.382806 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:27.382767    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" event={"ID":"c1e74d9b-1df6-4329-a543-1f2616ba7b86","Type":"ContainerStarted","Data":"a33a570fd5fa09b92832e69286c9e4c578ecac12617cb6b654c2a8a40d7906ee"}
Jul 15 13:42:27.383207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:27.382867    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:42:27.402207 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:27.402154    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" podStartSLOduration=2.71056408 podStartE2EDuration="6.402138923s" totalImagesPullingTime="3.691574843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:42:27.40134412 +0000 UTC m=+1857.318151589" watchObservedRunningTime="2026-07-15 13:42:27.402138923 +0000 UTC m=+1857.318946371"
Jul 15 13:42:29.587322 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:29.587271    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:42:33.393138 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:42:33.393111    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:43:26.521566 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.521527    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:43:26.522104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.521813    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" podUID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" containerName="maas-api" containerID="cri-o://a33a570fd5fa09b92832e69286c9e4c578ecac12617cb6b654c2a8a40d7906ee" gracePeriod=30
Jul 15 13:43:26.691127 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.691093    2571 generic.go:356] "Generic (PLEG): container finished" podID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" containerID="a33a570fd5fa09b92832e69286c9e4c578ecac12617cb6b654c2a8a40d7906ee" exitCode=0
Jul 15 13:43:26.691352 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.691177    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" event={"ID":"c1e74d9b-1df6-4329-a543-1f2616ba7b86","Type":"ContainerDied","Data":"a33a570fd5fa09b92832e69286c9e4c578ecac12617cb6b654c2a8a40d7906ee"}
Jul 15 13:43:26.784833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.784763    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:43:26.842717 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.842666    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wztpk\" (UniqueName: \"kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk\") pod \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") "
Jul 15 13:43:26.842926 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.842816    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca\") pod \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") "
Jul 15 13:43:26.842926 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.842862    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") pod \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\" (UID: \"c1e74d9b-1df6-4329-a543-1f2616ba7b86\") "
Jul 15 13:43:26.843310 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.843244    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1e74d9b-1df6-4329-a543-1f2616ba7b86" (UID: "c1e74d9b-1df6-4329-a543-1f2616ba7b86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:26.845160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.845120    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1e74d9b-1df6-4329-a543-1f2616ba7b86" (UID: "c1e74d9b-1df6-4329-a543-1f2616ba7b86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:43:26.845319 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.845156    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk" (OuterVolumeSpecName: "kube-api-access-wztpk") pod "c1e74d9b-1df6-4329-a543-1f2616ba7b86" (UID: "c1e74d9b-1df6-4329-a543-1f2616ba7b86"). InnerVolumeSpecName "kube-api-access-wztpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:43:26.944467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.944428    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1e74d9b-1df6-4329-a543-1f2616ba7b86-openshift-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:43:26.944467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.944461    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1e74d9b-1df6-4329-a543-1f2616ba7b86-maas-api-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:43:26.944467 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:26.944472    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wztpk\" (UniqueName: \"kubernetes.io/projected/c1e74d9b-1df6-4329-a543-1f2616ba7b86-kube-api-access-wztpk\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:43:27.697136 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:27.697096    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz" event={"ID":"c1e74d9b-1df6-4329-a543-1f2616ba7b86","Type":"ContainerDied","Data":"34f01b75847562931c958f83071b6a9afc8121b08025f40de64dc1d4039a023d"}
Jul 15 13:43:27.697136 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:27.697116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"
Jul 15 13:43:27.697736 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:27.697158    2571 scope.go:117] "RemoveContainer" containerID="a33a570fd5fa09b92832e69286c9e4c578ecac12617cb6b654c2a8a40d7906ee"
Jul 15 13:43:27.721999 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:27.721969    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:43:27.725919 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:27.725896    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-17469591-5559b5dbbc-stpdz"]
Jul 15 13:43:28.692223 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:28.692180    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:43:28.716423 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:28.716394    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" path="/var/lib/kubelet/pods/c1e74d9b-1df6-4329-a543-1f2616ba7b86/volumes"
Jul 15 13:43:38.905743 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.905708    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"]
Jul 15 13:43:38.906155 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.906141    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" containerName="maas-api"
Jul 15 13:43:38.906155 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.906155    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" containerName="maas-api"
Jul 15 13:43:38.906237 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.906228    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e74d9b-1df6-4329-a543-1f2616ba7b86" containerName="maas-api"
Jul 15 13:43:38.909340 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.909319    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:38.912572 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.912547    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:43:38.917551 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:38.917512    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"]
Jul 15 13:43:39.059289 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.059246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk\" (UID: \"d66d105c-9837-45e2-9803-79778e9a3704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:39.159794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.159699    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk\" (UID: \"d66d105c-9837-45e2-9803-79778e9a3704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:39.160589 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.160564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk\" (UID: \"d66d105c-9837-45e2-9803-79778e9a3704\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:39.221757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.221724    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:39.367857 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.367690    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"]
Jul 15 13:43:39.370855 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:43:39.370829    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66d105c_9837_45e2_9803_79778e9a3704.slice/crio-c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236 WatchSource:0}: Error finding container c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236: Status 404 returned error can't find the container with id c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236
Jul 15 13:43:39.762660 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:39.762622    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk" event={"ID":"d66d105c-9837-45e2-9803-79778e9a3704","Type":"ContainerStarted","Data":"c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236"}
Jul 15 13:43:41.616336 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:41.616302    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:43:41.773986 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:41.773884    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk" event={"ID":"d66d105c-9837-45e2-9803-79778e9a3704","Type":"ContainerStarted","Data":"a8682ce380e6153e277b4ddf4480128b6a8caff30673da7af89f6f7b51229ef0"}
Jul 15 13:43:41.795820 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:41.795761    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk" podStartSLOduration=1.9845267130000002 podStartE2EDuration="3.795741105s" totalImagesPullingTime="1.811214392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:43:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:43:41.793801005 +0000 UTC m=+1931.710608478" watchObservedRunningTime="2026-07-15 13:43:41.795741105 +0000 UTC m=+1931.712548606"
Jul 15 13:43:42.779969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:42.779927    2571 generic.go:356] "Generic (PLEG): container finished" podID="d66d105c-9837-45e2-9803-79778e9a3704" containerID="a8682ce380e6153e277b4ddf4480128b6a8caff30673da7af89f6f7b51229ef0" exitCode=0
Jul 15 13:43:42.780367 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:42.780007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk" event={"ID":"d66d105c-9837-45e2-9803-79778e9a3704","Type":"ContainerDied","Data":"a8682ce380e6153e277b4ddf4480128b6a8caff30673da7af89f6f7b51229ef0"}
Jul 15 13:43:43.925178 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:43.925145    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:44.109569 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.109535    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca\") pod \"d66d105c-9837-45e2-9803-79778e9a3704\" (UID: \"d66d105c-9837-45e2-9803-79778e9a3704\") "
Jul 15 13:43:44.109925 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.109900    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d66d105c-9837-45e2-9803-79778e9a3704" (UID: "d66d105c-9837-45e2-9803-79778e9a3704"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:43:44.210951 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.210923    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d66d105c-9837-45e2-9803-79778e9a3704-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:43:44.798154 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.798116    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk"
Jul 15 13:43:44.798343 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.798150    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk" event={"ID":"d66d105c-9837-45e2-9803-79778e9a3704","Type":"ContainerDied","Data":"c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236"}
Jul 15 13:43:44.798343 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:44.798236    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c17c91647a48907bd45311c376bd553bd57c3bc1fd3d92bfb0ee4bff51547236"
Jul 15 13:43:52.820911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:43:52.820877    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:44:11.016342 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.016289    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:11.016903 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.016750    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66d105c-9837-45e2-9803-79778e9a3704" containerName="revoke-keys"
Jul 15 13:44:11.016903 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.016763    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66d105c-9837-45e2-9803-79778e9a3704" containerName="revoke-keys"
Jul 15 13:44:11.016903 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.016849    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66d105c-9837-45e2-9803-79778e9a3704" containerName="revoke-keys"
Jul 15 13:44:11.020821 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.020799    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:11.024385 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.024363    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:44:11.030379 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.030351    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:11.161091 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.161052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln\" (UID: \"14f82614-b7df-4ec4-a65d-361760700fe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:11.262267 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.262229    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln\" (UID: \"14f82614-b7df-4ec4-a65d-361760700fe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:11.262880 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.262858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln\" (UID: \"14f82614-b7df-4ec4-a65d-361760700fe6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:11.332428 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.332327    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:11.481702 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.481672    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:11.485127 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:44:11.485098    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f82614_b7df_4ec4_a65d_361760700fe6.slice/crio-e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a WatchSource:0}: Error finding container e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a: Status 404 returned error can't find the container with id e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a
Jul 15 13:44:11.935701 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.935659    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerStarted","Data":"040ab005eaf8b28415b638f810f68a95bec6c7ff2b9897040a6dc507174a6dca"}
Jul 15 13:44:11.935892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.935722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerStarted","Data":"e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a"}
Jul 15 13:44:11.954375 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:11.954312    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" podStartSLOduration=1.954294058 podStartE2EDuration="1.954294058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:44:11.951811069 +0000 UTC m=+1961.868618536" watchObservedRunningTime="2026-07-15 13:44:11.954294058 +0000 UTC m=+1961.871101497"
Jul 15 13:44:12.943140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:12.943106    2571 generic.go:356] "Generic (PLEG): container finished" podID="14f82614-b7df-4ec4-a65d-361760700fe6" containerID="040ab005eaf8b28415b638f810f68a95bec6c7ff2b9897040a6dc507174a6dca" exitCode=7
Jul 15 13:44:12.943140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:12.943146    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerDied","Data":"040ab005eaf8b28415b638f810f68a95bec6c7ff2b9897040a6dc507174a6dca"}
Jul 15 13:44:12.943610 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:12.943379    2571 scope.go:117] "RemoveContainer" containerID="040ab005eaf8b28415b638f810f68a95bec6c7ff2b9897040a6dc507174a6dca"
Jul 15 13:44:13.950569 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:13.950533    2571 generic.go:356] "Generic (PLEG): container finished" podID="14f82614-b7df-4ec4-a65d-361760700fe6" containerID="d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d" exitCode=7
Jul 15 13:44:13.951051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:13.950600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerDied","Data":"d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d"}
Jul 15 13:44:13.951051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:13.950650    2571 scope.go:117] "RemoveContainer" containerID="040ab005eaf8b28415b638f810f68a95bec6c7ff2b9897040a6dc507174a6dca"
Jul 15 13:44:13.951051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:13.950861    2571 scope.go:117] "RemoveContainer" containerID="d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d"
Jul 15 13:44:13.951229 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:44:13.951124    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln_odh-ai-gateway-infra(14f82614-b7df-4ec4-a65d-361760700fe6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" podUID="14f82614-b7df-4ec4-a65d-361760700fe6"
Jul 15 13:44:14.394594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:14.394555    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:44:14.958422 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:14.958393    2571 scope.go:117] "RemoveContainer" containerID="d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d"
Jul 15 13:44:14.959223 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:44:14.959192    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln_odh-ai-gateway-infra(14f82614-b7df-4ec4-a65d-361760700fe6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" podUID="14f82614-b7df-4ec4-a65d-361760700fe6"
Jul 15 13:44:28.711942 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:28.711907    2571 scope.go:117] "RemoveContainer" containerID="d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d"
Jul 15 13:44:30.035592 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:30.035557    2571 generic.go:356] "Generic (PLEG): container finished" podID="14f82614-b7df-4ec4-a65d-361760700fe6" containerID="1cdc2d772a183d5194ce0e9b47766c856f3ebd646bc00bd52d98b4ff2e970c8b" exitCode=0
Jul 15 13:44:30.036020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:30.035633    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerDied","Data":"1cdc2d772a183d5194ce0e9b47766c856f3ebd646bc00bd52d98b4ff2e970c8b"}
Jul 15 13:44:30.036020 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:30.035693    2571 scope.go:117] "RemoveContainer" containerID="d3941a16c1d1af30d677bd9e5eb58c031570f5b1544e9fac3caeea3ac816fc5d"
Jul 15 13:44:31.075726 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:31.075691    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:31.190022 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:31.189992    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:31.355551 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:31.355520    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca\") pod \"14f82614-b7df-4ec4-a65d-361760700fe6\" (UID: \"14f82614-b7df-4ec4-a65d-361760700fe6\") "
Jul 15 13:44:31.355877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:31.355855    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14f82614-b7df-4ec4-a65d-361760700fe6" (UID: "14f82614-b7df-4ec4-a65d-361760700fe6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:44:31.456915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:31.456875    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14f82614-b7df-4ec4-a65d-361760700fe6-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:44:32.049342 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.049308    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"
Jul 15 13:44:32.049529 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.049313    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln" event={"ID":"14f82614-b7df-4ec4-a65d-361760700fe6","Type":"ContainerDied","Data":"e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a"}
Jul 15 13:44:32.049529 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.049440    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e605c0f8445b1dd3ad136b6e9be0bf2e6c8b54d4bc3f78ceb9a8358bd698081a"
Jul 15 13:44:32.085821 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.085784    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:32.093994 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.093967    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9e5a80bf-dxjln"]
Jul 15 13:44:32.717818 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:44:32.717785    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" path="/var/lib/kubelet/pods/14f82614-b7df-4ec4-a65d-361760700fe6/volumes"
Jul 15 13:45:00.145273 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145238    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"]
Jul 15 13:45:00.145722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145662    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145674    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145684    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145722 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145690    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145856 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145765    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145856 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145774    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.145856 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.145782    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:45:00.148773 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.148755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"
Jul 15 13:45:00.151494 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.151474    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:45:00.159319 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.159288    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"]
Jul 15 13:45:00.159441 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.159427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"
Jul 15 13:45:00.309601 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:00.309571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"]
Jul 15 13:45:00.312149 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:45:00.312118    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a5f21a7_9e84_4af5_aa64_dc014f2c6791.slice/crio-4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197 WatchSource:0}: Error finding container 4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197: Status 404 returned error can't find the container with id 4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197
Jul 15 13:45:01.210617 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:01.210581    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl" event={"ID":"1a5f21a7-9e84-4af5-aa64-dc014f2c6791","Type":"ContainerStarted","Data":"d98d0d08dd7eef560a5e1f17d64966e4981c4cc8d3224456d09b5445a673e26c"}
Jul 15 13:45:01.211004 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:01.210634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl" event={"ID":"1a5f21a7-9e84-4af5-aa64-dc014f2c6791","Type":"ContainerStarted","Data":"4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197"}
Jul 15 13:45:01.229602 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:01.229549    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl" podStartSLOduration=1.229533501 podStartE2EDuration="1.229533501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:45:01.227350454 +0000 UTC m=+2011.144157921" watchObservedRunningTime="2026-07-15 13:45:01.229533501 +0000 UTC m=+2011.146340971"
Jul 15 13:45:02.216741 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:02.216704    2571 generic.go:356] "Generic (PLEG): container finished" podID="1a5f21a7-9e84-4af5-aa64-dc014f2c6791" containerID="d98d0d08dd7eef560a5e1f17d64966e4981c4cc8d3224456d09b5445a673e26c" exitCode=0
Jul 15 13:45:02.217381 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:02.216801    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl" event={"ID":"1a5f21a7-9e84-4af5-aa64-dc014f2c6791","Type":"ContainerDied","Data":"d98d0d08dd7eef560a5e1f17d64966e4981c4cc8d3224456d09b5445a673e26c"}
Jul 15 13:45:03.351115 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:03.351086    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"
Jul 15 13:45:04.228036 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:04.228012    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl"
Jul 15 13:45:04.228208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:04.228012    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735385-48ddl" event={"ID":"1a5f21a7-9e84-4af5-aa64-dc014f2c6791","Type":"ContainerDied","Data":"4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197"}
Jul 15 13:45:04.228208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:04.228130    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fc6f5263cfd0864f2036b32e1fdfdcaa2cdbaee7b00f8e773aa673b9a221197"
Jul 15 13:45:24.592939 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:45:24.592902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:46:30.723038 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:46:30.723009    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:46:30.731805 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:46:30.731779    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:46:59.887102 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:46:59.887064    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:47:07.595031 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:47:07.594995    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:47:16.194579 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:47:16.194541    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:47:26.680448 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:47:26.680416    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:47:43.687780 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:47:43.687736    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:48:25.287746 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:25.287709    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:48:36.503050 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503013    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:48:36.503592 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503538    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:48:36.503592 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503552    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="14f82614-b7df-4ec4-a65d-361760700fe6" containerName="revoke-keys"
Jul 15 13:48:36.503592 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503563    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a5f21a7-9e84-4af5-aa64-dc014f2c6791" containerName="cleanup"
Jul 15 13:48:36.503592 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503568    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a5f21a7-9e84-4af5-aa64-dc014f2c6791" containerName="cleanup"
Jul 15 13:48:36.503729 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.503640    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a5f21a7-9e84-4af5-aa64-dc014f2c6791" containerName="cleanup"
Jul 15 13:48:36.506206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.506186    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.510650 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.510626    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-954f0f75\"/\"default-dockercfg-9zhfx\""
Jul 15 13:48:36.510770 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.510627    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-954f0f75\"/\"kube-root-ca.crt\""
Jul 15 13:48:36.510770 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.510679    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-954f0f75\"/\"e2e-lifecycle-model-954f0f75-kserve-self-signed-certs\""
Jul 15 13:48:36.510867 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.510768    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-954f0f75\"/\"openshift-service-ca.crt\""
Jul 15 13:48:36.515789 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.515769    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:48:36.591575 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591542    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.591778 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.591778 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591602    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.591778 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.591778 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.591930 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.591828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692574    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692624    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692720    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.692877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.692760    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.693183 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.693154    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.693349 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.693321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.693487 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.693470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.695557 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.695533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.695795 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.695776    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.704975 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.704946    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz\") pod \"e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") " pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.816611 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.816515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:36.958006 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:36.957981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:48:36.960339 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:48:36.960258    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf906019d_eb3d_4d94_871f_ad9b79793a14.slice/crio-5f642697a16012d1057abde0b2ded39eedf3d151fad7d3f0ad5351cee26c8b0d WatchSource:0}: Error finding container 5f642697a16012d1057abde0b2ded39eedf3d151fad7d3f0ad5351cee26c8b0d: Status 404 returned error can't find the container with id 5f642697a16012d1057abde0b2ded39eedf3d151fad7d3f0ad5351cee26c8b0d
Jul 15 13:48:37.330361 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:37.330321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" event={"ID":"f906019d-eb3d-4d94-871f-ad9b79793a14","Type":"ContainerStarted","Data":"8238cf3617170f9497691cf0425977328874501f8308c8f820a71eac324f0c59"}
Jul 15 13:48:37.330528 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:37.330371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" event={"ID":"f906019d-eb3d-4d94-871f-ad9b79793a14","Type":"ContainerStarted","Data":"5f642697a16012d1057abde0b2ded39eedf3d151fad7d3f0ad5351cee26c8b0d"}
Jul 15 13:48:37.349797 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:37.349744    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" podStartSLOduration=1.349727621 podStartE2EDuration="1.349727621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:48:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:48:37.348163224 +0000 UTC m=+2227.264970665" watchObservedRunningTime="2026-07-15 13:48:37.349727621 +0000 UTC m=+2227.266535069"
Jul 15 13:48:40.497895 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:40.497864    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:48:46.816964 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:46.816914    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:46.816964 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:46.816980    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:46.831511 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:46.831484    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:47.393576 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:47.393550    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:48:56.190899 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:48:56.190822    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:49:16.300059 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:16.300021    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:49:22.419536 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:22.419497    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:49:37.440348 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.440267    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" podUID="f906019d-eb3d-4d94-871f-ad9b79793a14" containerName="main" containerID="cri-o://8238cf3617170f9497691cf0425977328874501f8308c8f820a71eac324f0c59" gracePeriod=45
Jul 15 13:49:37.648359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.648325    2571 generic.go:356] "Generic (PLEG): container finished" podID="f906019d-eb3d-4d94-871f-ad9b79793a14" containerID="8238cf3617170f9497691cf0425977328874501f8308c8f820a71eac324f0c59" exitCode=0
Jul 15 13:49:37.648552 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.648381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" event={"ID":"f906019d-eb3d-4d94-871f-ad9b79793a14","Type":"ContainerDied","Data":"8238cf3617170f9497691cf0425977328874501f8308c8f820a71eac324f0c59"}
Jul 15 13:49:37.690247 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.690221    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:49:37.786444 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786354    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786444 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786397    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786444 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786438    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786667 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786533    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786667 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786563    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786667 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786592    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache\") pod \"f906019d-eb3d-4d94-871f-ad9b79793a14\" (UID: \"f906019d-eb3d-4d94-871f-ad9b79793a14\") "
Jul 15 13:49:37.786822 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786691    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:49:37.786906 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786841    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home" (OuterVolumeSpecName: "home") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:49:37.786969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.786920    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache" (OuterVolumeSpecName: "model-cache") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:49:37.787024 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.787004    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-home\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:37.787066 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.787031    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-model-cache\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:37.787066 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.787047    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-tmp-dir\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:37.788795 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.788768    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:49:37.788915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.788804    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz" (OuterVolumeSpecName: "kube-api-access-sg7xz") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "kube-api-access-sg7xz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:49:37.788915 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.788859    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm" (OuterVolumeSpecName: "dshm") pod "f906019d-eb3d-4d94-871f-ad9b79793a14" (UID: "f906019d-eb3d-4d94-871f-ad9b79793a14"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:49:37.887938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.887887    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f906019d-eb3d-4d94-871f-ad9b79793a14-tls-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:37.887938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.887930    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f906019d-eb3d-4d94-871f-ad9b79793a14-dshm\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:37.887938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:37.887946    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg7xz\" (UniqueName: \"kubernetes.io/projected/f906019d-eb3d-4d94-871f-ad9b79793a14-kube-api-access-sg7xz\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:49:38.654786 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.654741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv" event={"ID":"f906019d-eb3d-4d94-871f-ad9b79793a14","Type":"ContainerDied","Data":"5f642697a16012d1057abde0b2ded39eedf3d151fad7d3f0ad5351cee26c8b0d"}
Jul 15 13:49:38.654786 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.654776    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"
Jul 15 13:49:38.654786 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.654795    2571 scope.go:117] "RemoveContainer" containerID="8238cf3617170f9497691cf0425977328874501f8308c8f820a71eac324f0c59"
Jul 15 13:49:38.676814 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.676789    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:49:38.685197 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.685172    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-954f0f75/e2e-lifecycle-model-954f0f75-kserve-5bd9fd5bdc-jrkcv"]
Jul 15 13:49:38.720470 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:49:38.718541    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f906019d-eb3d-4d94-871f-ad9b79793a14" path="/var/lib/kubelet/pods/f906019d-eb3d-4d94-871f-ad9b79793a14/volumes"
Jul 15 13:50:16.795751 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:50:16.795713    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:50:27.785570 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:50:27.785532    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:50:30.845932 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:50:30.845893    2571 scope.go:117] "RemoveContainer" containerID="1cdc2d772a183d5194ce0e9b47766c856f3ebd646bc00bd52d98b4ff2e970c8b"
Jul 15 13:51:16.206346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:16.206308    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:51:27.718088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:27.718051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:51:28.025607 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.025520    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:51:28.025949 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.025927    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f906019d-eb3d-4d94-871f-ad9b79793a14" containerName="main"
Jul 15 13:51:28.025949 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.025943    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f906019d-eb3d-4d94-871f-ad9b79793a14" containerName="main"
Jul 15 13:51:28.026148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.026042    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f906019d-eb3d-4d94-871f-ad9b79793a14" containerName="main"
Jul 15 13:51:28.029514 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.029491    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.036830 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.036809    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d22f29\"/\"kube-root-ca.crt\""
Jul 15 13:51:28.038140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.038106    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d22f29\"/\"test-model-d22f29-kserve-self-signed-certs\""
Jul 15 13:51:28.038262 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.038163    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d22f29\"/\"default-dockercfg-8vfsz\""
Jul 15 13:51:28.038262 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.038192    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d22f29\"/\"openshift-service-ca.crt\""
Jul 15 13:51:28.046094 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.046058    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:51:28.071684 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.071843 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071695    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jvq\" (UniqueName: \"kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.071843 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071787    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.071938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.071938 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071897    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.072017 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.071935    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.172945 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.172896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.172960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.172995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173051    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173146 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jvq\" (UniqueName: \"kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173484 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173460    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173548 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.173594 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.173549    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.175209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.175188    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.175481 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.175464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.184321 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.184299    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jvq\" (UniqueName: \"kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq\") pod \"test-model-d22f29-kserve-574cd45b6c-wvxnb\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") " pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.339341 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.339305    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:28.484194 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:28.484163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:51:28.486870 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:51:28.486844    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad3a2b49_53b9_420a_a4a6_47a73fbb68e4.slice/crio-58659e6ccf3f3b213480586801facee07c0a79e4862e2817d438cbf2bd2895a0 WatchSource:0}: Error finding container 58659e6ccf3f3b213480586801facee07c0a79e4862e2817d438cbf2bd2895a0: Status 404 returned error can't find the container with id 58659e6ccf3f3b213480586801facee07c0a79e4862e2817d438cbf2bd2895a0
Jul 15 13:51:29.226505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:29.226466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" event={"ID":"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4","Type":"ContainerStarted","Data":"842318c8c375360d56b89765aeac25866ab464b3e18af690d9900d69b9152a90"}
Jul 15 13:51:29.226505 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:29.226514    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" event={"ID":"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4","Type":"ContainerStarted","Data":"58659e6ccf3f3b213480586801facee07c0a79e4862e2817d438cbf2bd2895a0"}
Jul 15 13:51:29.248392 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:29.248337    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" podStartSLOduration=2.248319802 podStartE2EDuration="2.248319802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:51:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:51:29.247175141 +0000 UTC m=+2399.163982609" watchObservedRunningTime="2026-07-15 13:51:29.248319802 +0000 UTC m=+2399.165127250"
Jul 15 13:51:30.755838 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:30.755809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:51:30.764413 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:30.764391    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:51:38.339650 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:38.339614    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:38.340113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:38.339715    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:38.353045 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:38.353017    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:51:38.488491 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:38.488441    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:51:39.296559 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:51:39.296523    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:52:07.098197 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:07.098161    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:52:19.419300 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:19.419245    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:52:20.569268 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.569231    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"]
Jul 15 13:52:20.573289 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.573260    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:20.580927 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.580905    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:52:20.595558 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.595530    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"]
Jul 15 13:52:20.674342 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.674307    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw\" (UID: \"1e37b40c-d000-4fc4-86b6-ac8f2103649d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:20.775738 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.775692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw\" (UID: \"1e37b40c-d000-4fc4-86b6-ac8f2103649d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:20.776367 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.776346    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw\" (UID: \"1e37b40c-d000-4fc4-86b6-ac8f2103649d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:20.882744 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:20.882717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:21.030518 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:21.030492    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"]
Jul 15 13:52:21.032856 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:52:21.032821    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e37b40c_d000_4fc4_86b6_ac8f2103649d.slice/crio-401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc WatchSource:0}: Error finding container 401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc: Status 404 returned error can't find the container with id 401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc
Jul 15 13:52:21.505996 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:21.505892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw" event={"ID":"1e37b40c-d000-4fc4-86b6-ac8f2103649d","Type":"ContainerStarted","Data":"b1affc5d7e7475a473c821ff23d9b53b1f48840b4197f0ea2bcb7244505f5d69"}
Jul 15 13:52:21.505996 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:21.505951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw" event={"ID":"1e37b40c-d000-4fc4-86b6-ac8f2103649d","Type":"ContainerStarted","Data":"401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc"}
Jul 15 13:52:21.523088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:21.523036    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw" podStartSLOduration=1.523021095 podStartE2EDuration="1.523021095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:21.521334837 +0000 UTC m=+2451.438142309" watchObservedRunningTime="2026-07-15 13:52:21.523021095 +0000 UTC m=+2451.439828543"
Jul 15 13:52:22.512394 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:22.512359    2571 generic.go:356] "Generic (PLEG): container finished" podID="1e37b40c-d000-4fc4-86b6-ac8f2103649d" containerID="b1affc5d7e7475a473c821ff23d9b53b1f48840b4197f0ea2bcb7244505f5d69" exitCode=0
Jul 15 13:52:22.512841 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:22.512417    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw" event={"ID":"1e37b40c-d000-4fc4-86b6-ac8f2103649d","Type":"ContainerDied","Data":"b1affc5d7e7475a473c821ff23d9b53b1f48840b4197f0ea2bcb7244505f5d69"}
Jul 15 13:52:23.660955 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:23.660931    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:23.805239 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:23.805146    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca\") pod \"1e37b40c-d000-4fc4-86b6-ac8f2103649d\" (UID: \"1e37b40c-d000-4fc4-86b6-ac8f2103649d\") "
Jul 15 13:52:23.805605 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:23.805571    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1e37b40c-d000-4fc4-86b6-ac8f2103649d" (UID: "1e37b40c-d000-4fc4-86b6-ac8f2103649d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:52:23.906189 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:23.906159    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e37b40c-d000-4fc4-86b6-ac8f2103649d-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:24.525662 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:24.525623    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw" event={"ID":"1e37b40c-d000-4fc4-86b6-ac8f2103649d","Type":"ContainerDied","Data":"401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc"}
Jul 15 13:52:24.525828 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:24.525674    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="401b71b8a4a1a09e4f147e8a65ef18b4cd071504938a7f8e4d70d19468fd44bc"
Jul 15 13:52:24.525828 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:24.525634    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw"
Jul 15 13:52:25.887492 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:25.887451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:52:34.440631 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.440582    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" podUID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" containerName="main" containerID="cri-o://842318c8c375360d56b89765aeac25866ab464b3e18af690d9900d69b9152a90" gracePeriod=45
Jul 15 13:52:34.581199 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.581165    2571 generic.go:356] "Generic (PLEG): container finished" podID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" containerID="842318c8c375360d56b89765aeac25866ab464b3e18af690d9900d69b9152a90" exitCode=0
Jul 15 13:52:34.581413 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.581235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" event={"ID":"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4","Type":"ContainerDied","Data":"842318c8c375360d56b89765aeac25866ab464b3e18af690d9900d69b9152a90"}
Jul 15 13:52:34.707161 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.707138    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:52:34.807557 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807525    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807747 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807589    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89jvq\" (UniqueName: \"kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807747 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807627    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807747 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807652    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807747 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807675    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807752    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache\") pod \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\" (UID: \"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4\") "
Jul 15 13:52:34.807969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807887    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home" (OuterVolumeSpecName: "home") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:34.807969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.807931    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:34.808113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.808043    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tmp-dir\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:34.808113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.808040    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:34.808113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.808062    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-home\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:34.810019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.809996    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:52:34.810139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.810016    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm" (OuterVolumeSpecName: "dshm") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:52:34.810139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.810036    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq" (OuterVolumeSpecName: "kube-api-access-89jvq") pod "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" (UID: "ad3a2b49-53b9-420a-a4a6-47a73fbb68e4"). InnerVolumeSpecName "kube-api-access-89jvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:52:34.908966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.908936    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-model-cache\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:34.908966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.908965    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89jvq\" (UniqueName: \"kubernetes.io/projected/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-kube-api-access-89jvq\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:34.908966 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.908975    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-dshm\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:34.909195 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:34.908984    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4-tls-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:35.587752 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:35.587725    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"
Jul 15 13:52:35.587752 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:35.587743    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb" event={"ID":"ad3a2b49-53b9-420a-a4a6-47a73fbb68e4","Type":"ContainerDied","Data":"58659e6ccf3f3b213480586801facee07c0a79e4862e2817d438cbf2bd2895a0"}
Jul 15 13:52:35.588225 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:35.587789    2571 scope.go:117] "RemoveContainer" containerID="842318c8c375360d56b89765aeac25866ab464b3e18af690d9900d69b9152a90"
Jul 15 13:52:35.621748 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:35.621718    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:52:35.626065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:35.626038    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d22f29/test-model-d22f29-kserve-574cd45b6c-wvxnb"]
Jul 15 13:52:36.590309 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:36.590263    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:52:36.718224 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:36.718195    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" path="/var/lib/kubelet/pods/ad3a2b49-53b9-420a-a4a6-47a73fbb68e4/volumes"
Jul 15 13:52:46.718763 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.718733    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"]
Jul 15 13:52:46.719313 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719294    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e37b40c-d000-4fc4-86b6-ac8f2103649d" containerName="revoke-keys"
Jul 15 13:52:46.719313 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719315    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e37b40c-d000-4fc4-86b6-ac8f2103649d" containerName="revoke-keys"
Jul 15 13:52:46.719461 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719334    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" containerName="main"
Jul 15 13:52:46.719461 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719342    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" containerName="main"
Jul 15 13:52:46.719568 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719485    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e37b40c-d000-4fc4-86b6-ac8f2103649d" containerName="revoke-keys"
Jul 15 13:52:46.719568 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.719504    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad3a2b49-53b9-420a-a4a6-47a73fbb68e4" containerName="main"
Jul 15 13:52:46.723637 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.723021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:46.730296 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.725716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"]
Jul 15 13:52:46.730296 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.726581    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:52:46.822573 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.822538    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq\" (UID: \"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:46.923981 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.923946    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq\" (UID: \"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:46.924623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:46.924601    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq\" (UID: \"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:47.038259 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:47.038169    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:47.189507 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:47.189477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"]
Jul 15 13:52:47.191376 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:52:47.191342    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e57ff7_6d59_40f2_ab76_f961ab4f2cf2.slice/crio-ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f WatchSource:0}: Error finding container ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f: Status 404 returned error can't find the container with id ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f
Jul 15 13:52:47.652711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:47.652675    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq" event={"ID":"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2","Type":"ContainerStarted","Data":"52208d907e8940fe38848efe0b0a0391725198b25723203f2703b0d2567ed314"}
Jul 15 13:52:47.652884 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:47.652728    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq" event={"ID":"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2","Type":"ContainerStarted","Data":"ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f"}
Jul 15 13:52:47.670809 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:47.670758    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq" podStartSLOduration=1.6707411909999998 podStartE2EDuration="1.670741191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:52:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:52:47.67053611 +0000 UTC m=+2477.587343574" watchObservedRunningTime="2026-07-15 13:52:47.670741191 +0000 UTC m=+2477.587548639"
Jul 15 13:52:48.658666 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:48.658627    2571 generic.go:356] "Generic (PLEG): container finished" podID="63e57ff7-6d59-40f2-ab76-f961ab4f2cf2" containerID="52208d907e8940fe38848efe0b0a0391725198b25723203f2703b0d2567ed314" exitCode=0
Jul 15 13:52:48.659051 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:48.658719    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq" event={"ID":"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2","Type":"ContainerDied","Data":"52208d907e8940fe38848efe0b0a0391725198b25723203f2703b0d2567ed314"}
Jul 15 13:52:49.809191 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:49.809166    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:49.850464 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:49.850430    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca\") pod \"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2\" (UID: \"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2\") "
Jul 15 13:52:49.850877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:49.850845    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63e57ff7-6d59-40f2-ab76-f961ab4f2cf2" (UID: "63e57ff7-6d59-40f2-ab76-f961ab4f2cf2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:52:49.952088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:49.952010    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63e57ff7-6d59-40f2-ab76-f961ab4f2cf2-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:52:50.671785 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:50.671757    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq"
Jul 15 13:52:50.671959 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:50.671798    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq" event={"ID":"63e57ff7-6d59-40f2-ab76-f961ab4f2cf2","Type":"ContainerDied","Data":"ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f"}
Jul 15 13:52:50.671959 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:52:50.671845    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce3f6d0748450d9b5b41d4d58ca378a6e57be34b73fabb1e12527b725bfbb96f"
Jul 15 13:53:00.515825 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:00.515785    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:53:21.396912 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:21.396832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:53:34.199908 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:34.199866    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:53:37.583877 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.583842    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"]
Jul 15 13:53:37.584299 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.584253    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e57ff7-6d59-40f2-ab76-f961ab4f2cf2" containerName="revoke-keys"
Jul 15 13:53:37.584299 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.584264    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e57ff7-6d59-40f2-ab76-f961ab4f2cf2" containerName="revoke-keys"
Jul 15 13:53:37.584386 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.584346    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e57ff7-6d59-40f2-ab76-f961ab4f2cf2" containerName="revoke-keys"
Jul 15 13:53:37.595616 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.595583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:37.595833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.595693    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"]
Jul 15 13:53:37.599118 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.599091    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:53:37.704148 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.704112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr\" (UID: \"27e3ba4f-0b23-46fa-b0a1-1f47591cb946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:37.805651 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.805618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr\" (UID: \"27e3ba4f-0b23-46fa-b0a1-1f47591cb946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:37.806247 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.806226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr\" (UID: \"27e3ba4f-0b23-46fa-b0a1-1f47591cb946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:37.907557 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:37.907469    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:38.050716 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:38.050690    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"]
Jul 15 13:53:38.053024 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:53:38.052995    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e3ba4f_0b23_46fa_b0a1_1f47591cb946.slice/crio-32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52 WatchSource:0}: Error finding container 32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52: Status 404 returned error can't find the container with id 32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52
Jul 15 13:53:38.925086 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:38.925052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr" event={"ID":"27e3ba4f-0b23-46fa-b0a1-1f47591cb946","Type":"ContainerStarted","Data":"3802aecb69bb0ac17271eff0ac898c6750032ab0c1174fe098ef85f15b068717"}
Jul 15 13:53:38.925533 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:38.925106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr" event={"ID":"27e3ba4f-0b23-46fa-b0a1-1f47591cb946","Type":"ContainerStarted","Data":"32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52"}
Jul 15 13:53:38.943122 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:38.943067    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr" podStartSLOduration=1.943050994 podStartE2EDuration="1.943050994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:53:38.940862573 +0000 UTC m=+2528.857670025" watchObservedRunningTime="2026-07-15 13:53:38.943050994 +0000 UTC m=+2528.859858443"
Jul 15 13:53:39.931931 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:39.931890    2571 generic.go:356] "Generic (PLEG): container finished" podID="27e3ba4f-0b23-46fa-b0a1-1f47591cb946" containerID="3802aecb69bb0ac17271eff0ac898c6750032ab0c1174fe098ef85f15b068717" exitCode=0
Jul 15 13:53:39.932358 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:39.931930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr" event={"ID":"27e3ba4f-0b23-46fa-b0a1-1f47591cb946","Type":"ContainerDied","Data":"3802aecb69bb0ac17271eff0ac898c6750032ab0c1174fe098ef85f15b068717"}
Jul 15 13:53:41.080630 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.080595    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:41.235233 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.235136    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca\") pod \"27e3ba4f-0b23-46fa-b0a1-1f47591cb946\" (UID: \"27e3ba4f-0b23-46fa-b0a1-1f47591cb946\") "
Jul 15 13:53:41.235604 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.235577    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27e3ba4f-0b23-46fa-b0a1-1f47591cb946" (UID: "27e3ba4f-0b23-46fa-b0a1-1f47591cb946"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:53:41.336675 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.336633    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27e3ba4f-0b23-46fa-b0a1-1f47591cb946-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:53:41.943969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.943935    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr"
Jul 15 13:53:41.944160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.943972    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr" event={"ID":"27e3ba4f-0b23-46fa-b0a1-1f47591cb946","Type":"ContainerDied","Data":"32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52"}
Jul 15 13:53:41.944160 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:41.944027    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32c73fec1d58a6b521ff5dd949a1a1f7f2708ba31e622a00f995f7e754e78c52"
Jul 15 13:53:51.509312 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:53:51.509263    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:54:03.881461 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.881424    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"]
Jul 15 13:54:03.881898 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.881837    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e3ba4f-0b23-46fa-b0a1-1f47591cb946" containerName="revoke-keys"
Jul 15 13:54:03.881898 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.881849    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e3ba4f-0b23-46fa-b0a1-1f47591cb946" containerName="revoke-keys"
Jul 15 13:54:03.881975 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.881925    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e3ba4f-0b23-46fa-b0a1-1f47591cb946" containerName="revoke-keys"
Jul 15 13:54:03.885188 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.885168    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:03.888244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.888221    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpj2c\""
Jul 15 13:54:03.893062 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.893036    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"]
Jul 15 13:54:03.955210 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:03.955180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc\" (UID: \"52d9842a-8277-46ba-bdcf-f1b3997cc758\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:04.056649 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:04.056610    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc\" (UID: \"52d9842a-8277-46ba-bdcf-f1b3997cc758\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:04.057359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:04.057337    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc\" (UID: \"52d9842a-8277-46ba-bdcf-f1b3997cc758\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:04.197008 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:04.196924    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:04.344757 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:04.344730    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"]
Jul 15 13:54:04.347734 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:54:04.347700    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d9842a_8277_46ba_bdcf_f1b3997cc758.slice/crio-0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae WatchSource:0}: Error finding container 0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae: Status 404 returned error can't find the container with id 0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae
Jul 15 13:54:05.061839 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:05.061807    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc" event={"ID":"52d9842a-8277-46ba-bdcf-f1b3997cc758","Type":"ContainerStarted","Data":"e524235f2c3c70818783a2cff06f85e039932e299a4871eba9cf1afa6c8c588c"}
Jul 15 13:54:05.062212 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:05.061858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc" event={"ID":"52d9842a-8277-46ba-bdcf-f1b3997cc758","Type":"ContainerStarted","Data":"0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae"}
Jul 15 13:54:05.119199 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:05.119139    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc" podStartSLOduration=2.11912261 podStartE2EDuration="2.11912261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:05.116907596 +0000 UTC m=+2555.033715044" watchObservedRunningTime="2026-07-15 13:54:05.11912261 +0000 UTC m=+2555.035930057"
Jul 15 13:54:06.068331 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:06.068293    2571 generic.go:356] "Generic (PLEG): container finished" podID="52d9842a-8277-46ba-bdcf-f1b3997cc758" containerID="e524235f2c3c70818783a2cff06f85e039932e299a4871eba9cf1afa6c8c588c" exitCode=0
Jul 15 13:54:06.068804 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:06.068379    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc" event={"ID":"52d9842a-8277-46ba-bdcf-f1b3997cc758","Type":"ContainerDied","Data":"e524235f2c3c70818783a2cff06f85e039932e299a4871eba9cf1afa6c8c588c"}
Jul 15 13:54:07.217935 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:07.217897    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:07.287405 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:07.287375    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca\") pod \"52d9842a-8277-46ba-bdcf-f1b3997cc758\" (UID: \"52d9842a-8277-46ba-bdcf-f1b3997cc758\") "
Jul 15 13:54:07.287762 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:07.287737    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "52d9842a-8277-46ba-bdcf-f1b3997cc758" (UID: "52d9842a-8277-46ba-bdcf-f1b3997cc758"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:54:07.389013 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:07.388982    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9842a-8277-46ba-bdcf-f1b3997cc758-maas-api-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:54:08.081096 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:08.081064    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc"
Jul 15 13:54:08.081293 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:08.081096    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc" event={"ID":"52d9842a-8277-46ba-bdcf-f1b3997cc758","Type":"ContainerDied","Data":"0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae"}
Jul 15 13:54:08.081293 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:08.081145    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fe35aa43d951a693fe46a812264cd76f10d9160928ea7552c21d616bb6719ae"
Jul 15 13:54:17.805694 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:17.805654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:54:34.092345 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.092311    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 13:54:34.093088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.093037    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52d9842a-8277-46ba-bdcf-f1b3997cc758" containerName="revoke-keys"
Jul 15 13:54:34.093088 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.093061    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="52d9842a-8277-46ba-bdcf-f1b3997cc758" containerName="revoke-keys"
Jul 15 13:54:34.093305 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.093176    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="52d9842a-8277-46ba-bdcf-f1b3997cc758" containerName="revoke-keys"
Jul 15 13:54:34.096514 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.096496    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.100149 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.100115    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8c00d1-serving-cert\""
Jul 15 13:54:34.100437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.100415    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-swdqt\""
Jul 15 13:54:34.107996 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.107966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 13:54:34.235796 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.235764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.235976 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.235824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.235976 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.235926    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j242s\" (UniqueName: \"kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.337111 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.337075    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j242s\" (UniqueName: \"kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.337340 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.337150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.337340 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.337197    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.337887 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.337861    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.339623 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.339602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.345500 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.345435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j242s\" (UniqueName: \"kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s\") pod \"maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.410397 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.410357    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:34.563835 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.563805    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 13:54:34.565619 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:54:34.565590    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ce5e09_0410_460f_8f26_8106a385923b.slice/crio-398b6683957d51ad0b90c985a78f0956ee2b3d74465503bcdb62a952356866f0 WatchSource:0}: Error finding container 398b6683957d51ad0b90c985a78f0956ee2b3d74465503bcdb62a952356866f0: Status 404 returned error can't find the container with id 398b6683957d51ad0b90c985a78f0956ee2b3d74465503bcdb62a952356866f0
Jul 15 13:54:34.567074 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:34.567054    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:54:35.221892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:35.221857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" event={"ID":"38ce5e09-0410-460f-8f26-8106a385923b","Type":"ContainerStarted","Data":"398b6683957d51ad0b90c985a78f0956ee2b3d74465503bcdb62a952356866f0"}
Jul 15 13:54:36.229377 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:36.229343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" event={"ID":"38ce5e09-0410-460f-8f26-8106a385923b","Type":"ContainerStarted","Data":"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"}
Jul 15 13:54:36.229794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:36.229477    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:36.255209 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:36.255140    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" podStartSLOduration=1.128979292 podStartE2EDuration="2.255123307s" totalImagesPullingTime="1.126144015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:36.25283256 +0000 UTC m=+2586.169640033" watchObservedRunningTime="2026-07-15 13:54:36.255123307 +0000 UTC m=+2586.171930754"
Jul 15 13:54:38.301687 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:38.301650    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:54:42.241853 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.241825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 13:54:42.507685 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.507608    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 13:54:42.511480 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.511458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.514815 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.514787    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7746ae-serving-cert\""
Jul 15 13:54:42.521925 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.521890    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 13:54:42.610120 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.610090    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.610387 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.610140    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.610387 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.610304    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjh8g\" (UniqueName: \"kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.710943 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.710910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjh8g\" (UniqueName: \"kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.711117 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.710972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.711117 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.711029    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.711862 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.711836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.713628 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.713606    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.724332 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.724307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjh8g\" (UniqueName: \"kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g\") pod \"maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:42.825422 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:42.825336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:43.010478 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:43.010453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 13:54:43.012478 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:54:43.012431    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d200d11_2115_4e37_a746_4fd715178f0e.slice/crio-8163083462e5c37020abf008647e193ca09473a637fdf7fac7c297027ee46fca WatchSource:0}: Error finding container 8163083462e5c37020abf008647e193ca09473a637fdf7fac7c297027ee46fca: Status 404 returned error can't find the container with id 8163083462e5c37020abf008647e193ca09473a637fdf7fac7c297027ee46fca
Jul 15 13:54:43.269296 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:43.269240    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" event={"ID":"3d200d11-2115-4e37-a746-4fd715178f0e","Type":"ContainerStarted","Data":"8163083462e5c37020abf008647e193ca09473a637fdf7fac7c297027ee46fca"}
Jul 15 13:54:44.275865 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:44.275834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" event={"ID":"3d200d11-2115-4e37-a746-4fd715178f0e","Type":"ContainerStarted","Data":"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"}
Jul 15 13:54:44.276363 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:44.275956    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:44.321690 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:44.321639    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" podStartSLOduration=1.9446578300000001 podStartE2EDuration="2.321621073s" totalImagesPullingTime="376.963243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:44.317347062 +0000 UTC m=+2594.234154529" watchObservedRunningTime="2026-07-15 13:54:44.321621073 +0000 UTC m=+2594.238428521"
Jul 15 13:54:49.752068 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:49.752038    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:54:50.286338 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:50.286307    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 13:54:58.116130 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.116091    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:54:58.119881 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.119862    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.125198 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.125174    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"kube-root-ca.crt\""
Jul 15 13:54:58.126098 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.126077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"default-dockercfg-vqv2d\""
Jul 15 13:54:58.126206 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.126078    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"openshift-service-ca.crt\""
Jul 15 13:54:58.126407 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.126357    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8c00d1\"/\"auth-test-model-8c00d1-kserve-self-signed-certs\""
Jul 15 13:54:58.135991 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.135652    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.136338 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.136248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.136532 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.136515    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.136666 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.136651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.136792 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.136778    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjzl4\" (UniqueName: \"kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.139600 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.136892    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.139710 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.139645    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:54:58.237555 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237513    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjzl4\" (UniqueName: \"kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237650    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237666    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238019 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.237711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.238163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238346 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.238208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.238451 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.238427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.240362 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.240342    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.240662 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.240643    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.249169 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.249145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjzl4\" (UniqueName: \"kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4\") pod \"auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") " pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.430403 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.430297    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:54:58.588169 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:58.588141    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:54:58.590566 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:54:58.590532    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb816d9d_c31f_497b_a44b_0cfbba91cef4.slice/crio-88dd01c23ad9127fba0aa75b030c005f0b826f791ceea2fbda285db222b1a809 WatchSource:0}: Error finding container 88dd01c23ad9127fba0aa75b030c005f0b826f791ceea2fbda285db222b1a809: Status 404 returned error can't find the container with id 88dd01c23ad9127fba0aa75b030c005f0b826f791ceea2fbda285db222b1a809
Jul 15 13:54:59.358410 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:59.358371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" event={"ID":"fb816d9d-c31f-497b-a44b-0cfbba91cef4","Type":"ContainerStarted","Data":"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"}
Jul 15 13:54:59.358788 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:54:59.358418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" event={"ID":"fb816d9d-c31f-497b-a44b-0cfbba91cef4","Type":"ContainerStarted","Data":"88dd01c23ad9127fba0aa75b030c005f0b826f791ceea2fbda285db222b1a809"}
Jul 15 13:55:03.418058 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:03.417998    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" podStartSLOduration=5.417981812 podStartE2EDuration="5.417981812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:54:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:54:59.380974008 +0000 UTC m=+2609.297781471" watchObservedRunningTime="2026-07-15 13:55:03.417981812 +0000 UTC m=+2613.334789259"
Jul 15 13:55:03.420144 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:03.420120    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:55:08.431445 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:08.431390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:55:08.431853 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:08.431466    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:55:08.443969 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:08.443941    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:55:09.424437 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:09.424409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:55:26.587348 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:26.587309    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:55:40.591610 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:40.591574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:55:59.988139 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:55:59.988096    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:56:12.593392 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:56:12.593361    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:56:27.493251 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:56:27.493211    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:56:30.789293 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:56:30.789252    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:56:30.797869 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:56:30.797843    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 13:56:44.793833 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:56:44.793795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:57:01.988560 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:01.988518    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:57:20.801873 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:20.801837    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:57:26.480087 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:26.480048    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:57:39.706549 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:39.706507    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:57:41.500541 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.500471    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" podUID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" containerName="main" containerID="cri-o://6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3" gracePeriod=45
Jul 15 13:57:41.758965 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.758904    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:57:41.821562 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821529    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.821562 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821566    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.821794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.821794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821606    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.821794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821631    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjzl4\" (UniqueName: \"kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.821794 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821695    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache\") pod \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\" (UID: \"fb816d9d-c31f-497b-a44b-0cfbba91cef4\") "
Jul 15 13:57:41.822015 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821862    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:41.822015 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821871    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home" (OuterVolumeSpecName: "home") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:41.822015 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.821984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:41.822177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.822155    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tmp-dir\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:41.822177 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.822175    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-home\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:41.822398 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.822186    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-model-cache\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:41.823850 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.823822    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:57:41.823947 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.823854    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm" (OuterVolumeSpecName: "dshm") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:57:41.823947 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.823876    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4" (OuterVolumeSpecName: "kube-api-access-tjzl4") pod "fb816d9d-c31f-497b-a44b-0cfbba91cef4" (UID: "fb816d9d-c31f-497b-a44b-0cfbba91cef4"). InnerVolumeSpecName "kube-api-access-tjzl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:57:41.923404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.923363    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb816d9d-c31f-497b-a44b-0cfbba91cef4-dshm\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:41.923404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.923396    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb816d9d-c31f-497b-a44b-0cfbba91cef4-tls-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:41.923404 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:41.923407    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjzl4\" (UniqueName: \"kubernetes.io/projected/fb816d9d-c31f-497b-a44b-0cfbba91cef4-kube-api-access-tjzl4\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:57:42.253255 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.253221    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" containerID="6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3" exitCode=0
Jul 15 13:57:42.253442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.253270    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"
Jul 15 13:57:42.253442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.253310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" event={"ID":"fb816d9d-c31f-497b-a44b-0cfbba91cef4","Type":"ContainerDied","Data":"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"}
Jul 15 13:57:42.253442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.253355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf" event={"ID":"fb816d9d-c31f-497b-a44b-0cfbba91cef4","Type":"ContainerDied","Data":"88dd01c23ad9127fba0aa75b030c005f0b826f791ceea2fbda285db222b1a809"}
Jul 15 13:57:42.253442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.253373    2571 scope.go:117] "RemoveContainer" containerID="6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"
Jul 15 13:57:42.262807 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.262789    2571 scope.go:117] "RemoveContainer" containerID="6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"
Jul 15 13:57:42.263104 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:57:42.263086    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3\": container with ID starting with 6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3 not found: ID does not exist" containerID="6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"
Jul 15 13:57:42.263144 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.263113    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3"} err="failed to get container status \"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3\": rpc error: code = NotFound desc = could not find container \"6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3\": container with ID starting with 6e1a8dc42863b1f1904fe12552f4532ce0c0c9309421ea1b5d819af1ba0b0de3 not found: ID does not exist"
Jul 15 13:57:42.285734 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.285694    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:57:42.288892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.288866    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8c00d1/auth-test-model-8c00d1-kserve-9f9cf5fd7-jj4jf"]
Jul 15 13:57:42.717402 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:42.717361    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" path="/var/lib/kubelet/pods/fb816d9d-c31f-497b-a44b-0cfbba91cef4/volumes"
Jul 15 13:57:52.205693 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:57:52.205613    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:58:25.694301 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.692014    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:58:25.694301 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.693010    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" containerName="main"
Jul 15 13:58:25.694301 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.693031    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" containerName="main"
Jul 15 13:58:25.694301 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.693247    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb816d9d-c31f-497b-a44b-0cfbba91cef4" containerName="main"
Jul 15 13:58:25.699135 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.699104    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.703520 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.703489    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"kube-root-ca.crt\""
Jul 15 13:58:25.710731 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.710711    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"default-dockercfg-xhc77\""
Jul 15 13:58:25.710967 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.710950    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"sub-test-model-7746ae-kserve-self-signed-certs\""
Jul 15 13:58:25.711243 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.711224    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"openshift-service-ca.crt\""
Jul 15 13:58:25.732455 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.732423    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:58:25.737144 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.737314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjx8s\" (UniqueName: \"kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.737314 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.737440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.737440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737343    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.737440 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.737371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838245 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838245 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838247    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838290    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjx8s\" (UniqueName: \"kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838519 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838639    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838711 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.838827 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.838807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.840611 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.840591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.840861 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.840845    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:25.851442 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:25.851417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjx8s\" (UniqueName: \"kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s\") pod \"sub-test-model-7746ae-kserve-795bff5ddc-dqkx2\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") " pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:26.008993 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:26.008899    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:26.168232 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:26.168204    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:58:26.169439 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:58:26.169414    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39c0697a_766e_48a6_a288_528fb6089406.slice/crio-a7d48f909d2344d0bd110a9821ff8e0f6c17ccd39847c76a01d3bf6d1cbd96ab WatchSource:0}: Error finding container a7d48f909d2344d0bd110a9821ff8e0f6c17ccd39847c76a01d3bf6d1cbd96ab: Status 404 returned error can't find the container with id a7d48f909d2344d0bd110a9821ff8e0f6c17ccd39847c76a01d3bf6d1cbd96ab
Jul 15 13:58:26.488045 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:26.488005    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" event={"ID":"39c0697a-766e-48a6-a288-528fb6089406","Type":"ContainerStarted","Data":"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"}
Jul 15 13:58:26.488045 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:26.488052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" event={"ID":"39c0697a-766e-48a6-a288-528fb6089406","Type":"ContainerStarted","Data":"a7d48f909d2344d0bd110a9821ff8e0f6c17ccd39847c76a01d3bf6d1cbd96ab"}
Jul 15 13:58:26.512420 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:26.512367    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" podStartSLOduration=1.5123504460000001 podStartE2EDuration="1.512350446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:58:26.512191108 +0000 UTC m=+2816.428998555" watchObservedRunningTime="2026-07-15 13:58:26.512350446 +0000 UTC m=+2816.429157894"
Jul 15 13:58:31.168347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:31.168300    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:58:36.009244 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:36.009176    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:36.009678 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:36.009268    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:36.021935 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:36.021903    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:36.553385 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:36.553356    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:58:45.199323 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:58:45.199285    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:59:05.116911 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:05.116877    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:59:07.494936 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:07.494902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:59:20.141455 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.141413    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" podUID="39c0697a-766e-48a6-a288-528fb6089406" containerName="main" containerID="cri-o://bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8" gracePeriod=45
Jul 15 13:59:20.402149 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.402085    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:59:20.458573 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458521    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.458573 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458579    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjx8s\" (UniqueName: \"kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.458846 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458596    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.458846 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458671    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.458846 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458727    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.458846 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458742    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home\") pod \"39c0697a-766e-48a6-a288-528fb6089406\" (UID: \"39c0697a-766e-48a6-a288-528fb6089406\") "
Jul 15 13:59:20.459060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.458881    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache" (OuterVolumeSpecName: "model-cache") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:20.459060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.459005    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:20.459060 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.459033    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home" (OuterVolumeSpecName: "home") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:20.459260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.459240    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-tmp-dir\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.459260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.459258    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-home\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.459260 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.459267    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-model-cache\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.460919 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.460896    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm" (OuterVolumeSpecName: "dshm") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:59:20.461208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.461190    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s" (OuterVolumeSpecName: "kube-api-access-mjx8s") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "kube-api-access-mjx8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:59:20.461208 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.461195    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "39c0697a-766e-48a6-a288-528fb6089406" (UID: "39c0697a-766e-48a6-a288-528fb6089406"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:59:20.560630 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.560590    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39c0697a-766e-48a6-a288-528fb6089406-dshm\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.560630 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.560620    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjx8s\" (UniqueName: \"kubernetes.io/projected/39c0697a-766e-48a6-a288-528fb6089406-kube-api-access-mjx8s\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.560630 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.560631    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39c0697a-766e-48a6-a288-528fb6089406-tls-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 13:59:20.777125 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.777083    2571 generic.go:356] "Generic (PLEG): container finished" podID="39c0697a-766e-48a6-a288-528fb6089406" containerID="bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8" exitCode=0
Jul 15 13:59:20.777347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.777142    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"
Jul 15 13:59:20.777347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.777179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" event={"ID":"39c0697a-766e-48a6-a288-528fb6089406","Type":"ContainerDied","Data":"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"}
Jul 15 13:59:20.777347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.777246    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2" event={"ID":"39c0697a-766e-48a6-a288-528fb6089406","Type":"ContainerDied","Data":"a7d48f909d2344d0bd110a9821ff8e0f6c17ccd39847c76a01d3bf6d1cbd96ab"}
Jul 15 13:59:20.777347 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.777303    2571 scope.go:117] "RemoveContainer" containerID="bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"
Jul 15 13:59:20.787825 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.787803    2571 scope.go:117] "RemoveContainer" containerID="bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"
Jul 15 13:59:20.788165 ip-10-0-136-182 kubenswrapper[2571]: E0715 13:59:20.788142    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8\": container with ID starting with bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8 not found: ID does not exist" containerID="bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"
Jul 15 13:59:20.788257 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.788177    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8"} err="failed to get container status \"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8\": rpc error: code = NotFound desc = could not find container \"bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8\": container with ID starting with bde4fe72b87dfa9a831583e5341c9f8b5994c88f82aeeaad83ac8dc7d75eb7f8 not found: ID does not exist"
Jul 15 13:59:20.797984 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.797954    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:59:20.802359 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:20.802335    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/sub-test-model-7746ae-kserve-795bff5ddc-dqkx2"]
Jul 15 13:59:22.724686 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:22.724611    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39c0697a-766e-48a6-a288-528fb6089406" path="/var/lib/kubelet/pods/39c0697a-766e-48a6-a288-528fb6089406/volumes"
Jul 15 13:59:22.892601 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:22.892559    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 13:59:51.694104 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.694064    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 13:59:51.694588 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.694573    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39c0697a-766e-48a6-a288-528fb6089406" containerName="main"
Jul 15 13:59:51.694642 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.694590    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="39c0697a-766e-48a6-a288-528fb6089406" containerName="main"
Jul 15 13:59:51.694679 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.694656    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="39c0697a-766e-48a6-a288-528fb6089406" containerName="main"
Jul 15 13:59:51.697656 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.697641    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.700792 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.700771    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"openshift-service-ca.crt\""
Jul 15 13:59:51.700924 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.700792    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"kube-root-ca.crt\""
Jul 15 13:59:51.701895 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.701876    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"default-dockercfg-xhc77\""
Jul 15 13:59:51.702140 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.702126    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7746ae\"/\"rate-test-model-7746ae-kserve-self-signed-certs\""
Jul 15 13:59:51.713892 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.713860    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 13:59:51.760734 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.760699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.760909 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.760750    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jrjv\" (UniqueName: \"kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.760909 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.760901    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.761004 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.760918    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.761042 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.761012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.761084 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.761068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862113 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862317 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862118    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jrjv\" (UniqueName: \"kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862317 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862317 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862317 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862252    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862506 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862661 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.862661 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.862652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.864610 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.864580    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.864840 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.864824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:51.872612 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:51.872586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jrjv\" (UniqueName: \"kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv\") pod \"rate-test-model-7746ae-kserve-66f8b868b7-6vpk5\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") " pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:52.009153 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:52.009054    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 13:59:52.156396 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:52.156370    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 13:59:52.157249 ip-10-0-136-182 kubenswrapper[2571]: W0715 13:59:52.157226    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a017bb6_cf09_4938_878b_680cfc616860.slice/crio-64be4a38bc8335129fa8b746cc54c9ea32f05aa42b5a6386b68149ddf1d6e37c WatchSource:0}: Error finding container 64be4a38bc8335129fa8b746cc54c9ea32f05aa42b5a6386b68149ddf1d6e37c: Status 404 returned error can't find the container with id 64be4a38bc8335129fa8b746cc54c9ea32f05aa42b5a6386b68149ddf1d6e37c
Jul 15 13:59:52.955065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:52.955024    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" event={"ID":"8a017bb6-cf09-4938-878b-680cfc616860","Type":"ContainerStarted","Data":"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"}
Jul 15 13:59:52.955065 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:52.955072    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" event={"ID":"8a017bb6-cf09-4938-878b-680cfc616860","Type":"ContainerStarted","Data":"64be4a38bc8335129fa8b746cc54c9ea32f05aa42b5a6386b68149ddf1d6e37c"}
Jul 15 13:59:52.979120 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:52.979070    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" podStartSLOduration=1.979054103 podStartE2EDuration="1.979054103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:59:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:59:52.976848319 +0000 UTC m=+2902.893655785" watchObservedRunningTime="2026-07-15 13:59:52.979054103 +0000 UTC m=+2902.895861598"
Jul 15 13:59:56.400532 ip-10-0-136-182 kubenswrapper[2571]: I0715 13:59:56.400496    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:00:02.009215 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:02.009174    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:00:02.009737 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:02.009239    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:00:02.021746 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:02.021716    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:00:03.019495 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:03.019464    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:00:31.706793 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:31.706753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:00:47.590375 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:47.590338    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:00:56.032858 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:56.032774    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 14:00:57.043169 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.043133    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715318552624"]
Jul 15 14:00:57.046864 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.046843    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:00:57.049977 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.049942    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6nqw9\""
Jul 15 14:00:57.052056 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.052032    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318552624"]
Jul 15 14:00:57.177493 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.177461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkxg9\" (UniqueName: \"kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9\") pod \"test-curl-7757-140715318552624\" (UID: \"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa\") " pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:00:57.278223 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.278187    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkxg9\" (UniqueName: \"kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9\") pod \"test-curl-7757-140715318552624\" (UID: \"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa\") " pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:00:57.291530 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.291501    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkxg9\" (UniqueName: \"kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9\") pod \"test-curl-7757-140715318552624\" (UID: \"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa\") " pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:00:57.359095 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.359044    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:00:57.507357 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.507330    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318552624"]
Jul 15 14:00:57.509167 ip-10-0-136-182 kubenswrapper[2571]: W0715 14:00:57.509139    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce2dc2da_a37f_4c54_bd9e_dac918f04dfa.slice/crio-93bbfaf4385573956cc8e496e32162056310b04c540728aa1422175a7df159d0 WatchSource:0}: Error finding container 93bbfaf4385573956cc8e496e32162056310b04c540728aa1422175a7df159d0: Status 404 returned error can't find the container with id 93bbfaf4385573956cc8e496e32162056310b04c540728aa1422175a7df159d0
Jul 15 14:00:57.510620 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:57.510601    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:00:58.308918 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:58.308881    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318552624" event={"ID":"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa","Type":"ContainerStarted","Data":"93bbfaf4385573956cc8e496e32162056310b04c540728aa1422175a7df159d0"}
Jul 15 14:00:59.315406 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:59.315371    2571 generic.go:356] "Generic (PLEG): container finished" podID="ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" containerID="19e9a1b577a0a05e878b2838ce16bb8fbe0695d14b38d2f82c4d1f6f3742ed83" exitCode=0
Jul 15 14:00:59.315790 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:00:59.315461    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318552624" event={"ID":"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa","Type":"ContainerDied","Data":"19e9a1b577a0a05e878b2838ce16bb8fbe0695d14b38d2f82c4d1f6f3742ed83"}
Jul 15 14:01:00.466057 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.466029    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:01:00.530078 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.530046    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715318552624_ce2dc2da-a37f-4c54-bd9e-dac918f04dfa/test-curl-7757-140715318552624/0.log"
Jul 15 14:01:00.560096 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.560055    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715318552624"]
Jul 15 14:01:00.565584 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.565554    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715318552624"]
Jul 15 14:01:00.612359 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.612330    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkxg9\" (UniqueName: \"kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9\") pod \"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa\" (UID: \"ce2dc2da-a37f-4c54-bd9e-dac918f04dfa\") "
Jul 15 14:01:00.614481 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.614453    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9" (OuterVolumeSpecName: "kube-api-access-fkxg9") pod "ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" (UID: "ce2dc2da-a37f-4c54-bd9e-dac918f04dfa"). InnerVolumeSpecName "kube-api-access-fkxg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:00.713530 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.713494    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkxg9\" (UniqueName: \"kubernetes.io/projected/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa-kube-api-access-fkxg9\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:00.719093 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:00.719062    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" path="/var/lib/kubelet/pods/ce2dc2da-a37f-4c54-bd9e-dac918f04dfa/volumes"
Jul 15 14:01:01.327539 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:01.327509    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318552624"
Jul 15 14:01:01.327751 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:01.327564    2571 scope.go:117] "RemoveContainer" containerID="19e9a1b577a0a05e878b2838ce16bb8fbe0695d14b38d2f82c4d1f6f3742ed83"
Jul 15 14:01:01.692827 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:01.692786    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:01:07.474731 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.474692    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:07.475218 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.475115    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" containerName="test-curl-7757-140715318552624"
Jul 15 14:01:07.475218 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.475129    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" containerName="test-curl-7757-140715318552624"
Jul 15 14:01:07.475218 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.475217    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce2dc2da-a37f-4c54-bd9e-dac918f04dfa" containerName="test-curl-7757-140715318552624"
Jul 15 14:01:07.480227 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.480209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.483645 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.483625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6nqw9\""
Jul 15 14:01:07.489778 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.489753    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:07.582007 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.581969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffvg\" (UniqueName: \"kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg\") pod \"test-curl-7757-140715318531824\" (UID: \"8ce6a949-a28c-4e89-a438-5dcda8e20996\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.683172 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.683139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffvg\" (UniqueName: \"kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg\") pod \"test-curl-7757-140715318531824\" (UID: \"8ce6a949-a28c-4e89-a438-5dcda8e20996\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.692925 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.692898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffvg\" (UniqueName: \"kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg\") pod \"test-curl-7757-140715318531824\" (UID: \"8ce6a949-a28c-4e89-a438-5dcda8e20996\") " pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.790093 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.789997    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:07.929967 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:07.929940    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:07.933151 ip-10-0-136-182 kubenswrapper[2571]: W0715 14:01:07.933121    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ce6a949_a28c_4e89_a438_5dcda8e20996.slice/crio-17acf89e6f3e3676fd27b87f53a23b4a1d02f0b305f81b2bd6f52c86e561c909 WatchSource:0}: Error finding container 17acf89e6f3e3676fd27b87f53a23b4a1d02f0b305f81b2bd6f52c86e561c909: Status 404 returned error can't find the container with id 17acf89e6f3e3676fd27b87f53a23b4a1d02f0b305f81b2bd6f52c86e561c909
Jul 15 14:01:08.370410 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:08.370374    2571 generic.go:356] "Generic (PLEG): container finished" podID="8ce6a949-a28c-4e89-a438-5dcda8e20996" containerID="ef3d76e53459f291f5cb357907d78505633410ef15f3816ce7638e11a9551981" exitCode=0
Jul 15 14:01:08.370561 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:08.370423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318531824" event={"ID":"8ce6a949-a28c-4e89-a438-5dcda8e20996","Type":"ContainerDied","Data":"ef3d76e53459f291f5cb357907d78505633410ef15f3816ce7638e11a9551981"}
Jul 15 14:01:08.370561 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:08.370451    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715318531824" event={"ID":"8ce6a949-a28c-4e89-a438-5dcda8e20996","Type":"ContainerStarted","Data":"17acf89e6f3e3676fd27b87f53a23b4a1d02f0b305f81b2bd6f52c86e561c909"}
Jul 15 14:01:09.526479 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.526453    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:09.549594 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.549563    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715318531824_8ce6a949-a28c-4e89-a438-5dcda8e20996/test-curl-7757-140715318531824/0.log"
Jul 15 14:01:09.573327 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.573290    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:09.577050 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.577022    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715318531824"]
Jul 15 14:01:09.700617 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.700526    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bffvg\" (UniqueName: \"kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg\") pod \"8ce6a949-a28c-4e89-a438-5dcda8e20996\" (UID: \"8ce6a949-a28c-4e89-a438-5dcda8e20996\") "
Jul 15 14:01:09.702007 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.701987    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:09.702515 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.702497    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" containerName="test-curl-7757-140715318531824"
Jul 15 14:01:09.702574 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.702517    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" containerName="test-curl-7757-140715318531824"
Jul 15 14:01:09.702672 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.702651    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" containerName="test-curl-7757-140715318531824"
Jul 15 14:01:09.702782 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.702759    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg" (OuterVolumeSpecName: "kube-api-access-bffvg") pod "8ce6a949-a28c-4e89-a438-5dcda8e20996" (UID: "8ce6a949-a28c-4e89-a438-5dcda8e20996"). InnerVolumeSpecName "kube-api-access-bffvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:09.706088 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.706070    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:09.710452 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.710427    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:09.801737 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.801701    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dss4v\" (UniqueName: \"kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v\") pod \"test-curl-7757-140715320362304\" (UID: \"c774aeb4-239a-4452-b0c5-17bc369e082c\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:09.801934 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.801856    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bffvg\" (UniqueName: \"kubernetes.io/projected/8ce6a949-a28c-4e89-a438-5dcda8e20996-kube-api-access-bffvg\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:09.902813 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.902771    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dss4v\" (UniqueName: \"kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v\") pod \"test-curl-7757-140715320362304\" (UID: \"c774aeb4-239a-4452-b0c5-17bc369e082c\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:09.912569 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:09.912535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dss4v\" (UniqueName: \"kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v\") pod \"test-curl-7757-140715320362304\" (UID: \"c774aeb4-239a-4452-b0c5-17bc369e082c\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:10.022529 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.022437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:10.372295 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.372249    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:10.374575 ip-10-0-136-182 kubenswrapper[2571]: W0715 14:01:10.374547    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc774aeb4_239a_4452_b0c5_17bc369e082c.slice/crio-ffd779db9c7a3fe0d2c4c97bf45b4d7478afd888ca51c9a44ee3cf6617dbaa86 WatchSource:0}: Error finding container ffd779db9c7a3fe0d2c4c97bf45b4d7478afd888ca51c9a44ee3cf6617dbaa86: Status 404 returned error can't find the container with id ffd779db9c7a3fe0d2c4c97bf45b4d7478afd888ca51c9a44ee3cf6617dbaa86
Jul 15 14:01:10.384586 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.384556    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715320362304" event={"ID":"c774aeb4-239a-4452-b0c5-17bc369e082c","Type":"ContainerStarted","Data":"ffd779db9c7a3fe0d2c4c97bf45b4d7478afd888ca51c9a44ee3cf6617dbaa86"}
Jul 15 14:01:10.385889 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.385859    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17acf89e6f3e3676fd27b87f53a23b4a1d02f0b305f81b2bd6f52c86e561c909"
Jul 15 14:01:10.385889 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.385861    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:10.397223 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:10.397192    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140715318531824\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:10.716595 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:10.716530    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140715318531824\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" pod="opendatahub/test-curl-7757-140715318531824"
Jul 15 14:01:10.718232 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:10.718207    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce6a949-a28c-4e89-a438-5dcda8e20996" path="/var/lib/kubelet/pods/8ce6a949-a28c-4e89-a438-5dcda8e20996/volumes"
Jul 15 14:01:11.053521 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.053430    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" podUID="8a017bb6-cf09-4938-878b-680cfc616860" containerName="main" containerID="cri-o://0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c" gracePeriod=45
Jul 15 14:01:11.320042 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.319980    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:01:11.394050 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.394013    2571 generic.go:356] "Generic (PLEG): container finished" podID="c774aeb4-239a-4452-b0c5-17bc369e082c" containerID="8bc33aac944862c1d94b2f18496cf8c3b1a3c8cb70a763770d10313ca0cc3c78" exitCode=0
Jul 15 14:01:11.394261 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.394101    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715320362304" event={"ID":"c774aeb4-239a-4452-b0c5-17bc369e082c","Type":"ContainerDied","Data":"8bc33aac944862c1d94b2f18496cf8c3b1a3c8cb70a763770d10313ca0cc3c78"}
Jul 15 14:01:11.395494 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.395468    2571 generic.go:356] "Generic (PLEG): container finished" podID="8a017bb6-cf09-4938-878b-680cfc616860" containerID="0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c" exitCode=0
Jul 15 14:01:11.395614 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.395501    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"
Jul 15 14:01:11.395614 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.395535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" event={"ID":"8a017bb6-cf09-4938-878b-680cfc616860","Type":"ContainerDied","Data":"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"}
Jul 15 14:01:11.395614 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.395571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5" event={"ID":"8a017bb6-cf09-4938-878b-680cfc616860","Type":"ContainerDied","Data":"64be4a38bc8335129fa8b746cc54c9ea32f05aa42b5a6386b68149ddf1d6e37c"}
Jul 15 14:01:11.395614 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.395595    2571 scope.go:117] "RemoveContainer" containerID="0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"
Jul 15 14:01:11.405937 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.405887    2571 scope.go:117] "RemoveContainer" containerID="0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"
Jul 15 14:01:11.406122 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:11.406102    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c\": container with ID starting with 0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c not found: ID does not exist" containerID="0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"
Jul 15 14:01:11.406185 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.406135    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c"} err="failed to get container status \"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c\": rpc error: code = NotFound desc = could not find container \"0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c\": container with ID starting with 0df981e6eaee36ac1d556991d8b9f7b138fef7c4286b4da333263a9c0498b28c not found: ID does not exist"
Jul 15 14:01:11.418510 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418484    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418674 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418520    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418674 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418572    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jrjv\" (UniqueName: \"kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418674 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418669    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418848 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418696    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418848 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418776    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home\") pod \"8a017bb6-cf09-4938-878b-680cfc616860\" (UID: \"8a017bb6-cf09-4938-878b-680cfc616860\") "
Jul 15 14:01:11.418975 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:11.419036 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.418989    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:11.419122 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.419098    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home" (OuterVolumeSpecName: "home") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:11.419184 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.419128    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-tmp-dir\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.419184 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.419147    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-model-cache\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.420734 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.420709    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:01:11.420823 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.420755    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm" (OuterVolumeSpecName: "dshm") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:01:11.420823 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.420772    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv" (OuterVolumeSpecName: "kube-api-access-2jrjv") pod "8a017bb6-cf09-4938-878b-680cfc616860" (UID: "8a017bb6-cf09-4938-878b-680cfc616860"). InnerVolumeSpecName "kube-api-access-2jrjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:11.520073 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.520037    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a017bb6-cf09-4938-878b-680cfc616860-tls-certs\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.520073 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.520066    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-dshm\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.520073 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.520076    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jrjv\" (UniqueName: \"kubernetes.io/projected/8a017bb6-cf09-4938-878b-680cfc616860-kube-api-access-2jrjv\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.520346 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.520085    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a017bb6-cf09-4938-878b-680cfc616860-home\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:11.719367 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.719337    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 14:01:11.722141 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:11.722114    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7746ae/rate-test-model-7746ae-kserve-66f8b868b7-6vpk5"]
Jul 15 14:01:12.559157 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.559129    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:12.582297 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.582240    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715320362304_c774aeb4-239a-4452-b0c5-17bc369e082c/test-curl-7757-140715320362304/0.log"
Jul 15 14:01:12.606177 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.606134    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:12.610954 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.610924    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:12.717436 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.717351    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a017bb6-cf09-4938-878b-680cfc616860" path="/var/lib/kubelet/pods/8a017bb6-cf09-4938-878b-680cfc616860/volumes"
Jul 15 14:01:12.731528 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.731482    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dss4v\" (UniqueName: \"kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v\") pod \"c774aeb4-239a-4452-b0c5-17bc369e082c\" (UID: \"c774aeb4-239a-4452-b0c5-17bc369e082c\") "
Jul 15 14:01:12.733604 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.733572    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v" (OuterVolumeSpecName: "kube-api-access-dss4v") pod "c774aeb4-239a-4452-b0c5-17bc369e082c" (UID: "c774aeb4-239a-4452-b0c5-17bc369e082c"). InnerVolumeSpecName "kube-api-access-dss4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:12.737258 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737234    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:12.737698 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737684    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a017bb6-cf09-4938-878b-680cfc616860" containerName="main"
Jul 15 14:01:12.737744 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737699    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a017bb6-cf09-4938-878b-680cfc616860" containerName="main"
Jul 15 14:01:12.737744 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737717    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c774aeb4-239a-4452-b0c5-17bc369e082c" containerName="test-curl-7757-140715320362304"
Jul 15 14:01:12.737744 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737725    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c774aeb4-239a-4452-b0c5-17bc369e082c" containerName="test-curl-7757-140715320362304"
Jul 15 14:01:12.737835 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737797    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a017bb6-cf09-4938-878b-680cfc616860" containerName="main"
Jul 15 14:01:12.737835 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.737809    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c774aeb4-239a-4452-b0c5-17bc369e082c" containerName="test-curl-7757-140715320362304"
Jul 15 14:01:12.741010 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.740992    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:12.748702 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.748677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:12.832824 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.832792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm795\" (UniqueName: \"kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795\") pod \"test-curl-7757-140715320362304\" (UID: \"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:12.833016 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.832938    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dss4v\" (UniqueName: \"kubernetes.io/projected/c774aeb4-239a-4452-b0c5-17bc369e082c-kube-api-access-dss4v\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:12.933972 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.933937    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm795\" (UniqueName: \"kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795\") pod \"test-curl-7757-140715320362304\" (UID: \"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:12.948772 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:12.948743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm795\" (UniqueName: \"kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795\") pod \"test-curl-7757-140715320362304\" (UID: \"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d\") " pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:13.052789 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:13.052677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:13.193339 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:13.193314    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:13.195164 ip-10-0-136-182 kubenswrapper[2571]: W0715 14:01:13.195132    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6c583e9_2496_4fb0_ab63_cbb9fc90fc1d.slice/crio-d9cea8717a04d8bcb8471fe73fa315e335475f60dce32854eea486b150dffd4c WatchSource:0}: Error finding container d9cea8717a04d8bcb8471fe73fa315e335475f60dce32854eea486b150dffd4c: Status 404 returned error can't find the container with id d9cea8717a04d8bcb8471fe73fa315e335475f60dce32854eea486b150dffd4c
Jul 15 14:01:13.411887 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:13.411857    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:13.411887 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:13.411876    2571 scope.go:117] "RemoveContainer" containerID="8bc33aac944862c1d94b2f18496cf8c3b1a3c8cb70a763770d10313ca0cc3c78"
Jul 15 14:01:13.413161 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:13.413132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715320362304" event={"ID":"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d","Type":"ContainerStarted","Data":"d9cea8717a04d8bcb8471fe73fa315e335475f60dce32854eea486b150dffd4c"}
Jul 15 14:01:14.420669 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:14.420636    2571 generic.go:356] "Generic (PLEG): container finished" podID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" containerID="276c5497be660bf0d3370485eb137801b6a5d39468d2331adee5ea0ea24321a6" exitCode=0
Jul 15 14:01:14.421051 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:14.420716    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7757-140715320362304" event={"ID":"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d","Type":"ContainerDied","Data":"276c5497be660bf0d3370485eb137801b6a5d39468d2331adee5ea0ea24321a6"}
Jul 15 14:01:14.717130 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:14.717050    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c774aeb4-239a-4452-b0c5-17bc369e082c" path="/var/lib/kubelet/pods/c774aeb4-239a-4452-b0c5-17bc369e082c/volumes"
Jul 15 14:01:15.572796 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.572769    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:15.620972 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.620945    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7757-140715320362304_c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d/test-curl-7757-140715320362304/0.log"
Jul 15 14:01:15.661954 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.661920    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:15.675870 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.675790    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7757-140715320362304"]
Jul 15 14:01:15.763502 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.763471    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm795\" (UniqueName: \"kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795\") pod \"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d\" (UID: \"c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d\") "
Jul 15 14:01:15.765591 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.765559    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795" (OuterVolumeSpecName: "kube-api-access-jm795") pod "c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" (UID: "c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d"). InnerVolumeSpecName "kube-api-access-jm795". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:15.864870 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:15.864832    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm795\" (UniqueName: \"kubernetes.io/projected/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d-kube-api-access-jm795\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:16.432242 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:16.432205    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:16.432242 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:16.432218    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9cea8717a04d8bcb8471fe73fa315e335475f60dce32854eea486b150dffd4c"
Jul 15 14:01:16.442753 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:16.442720    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7757-140715320362304\" is forbidden: User \"system:node:ip-10-0-136-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-182.ec2.internal' and this object" podUID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" pod="opendatahub/test-curl-7757-140715320362304"
Jul 15 14:01:16.718067 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:16.717989    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" path="/var/lib/kubelet/pods/c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d/volumes"
Jul 15 14:01:26.693053 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:26.693016    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 14:01:26.693482 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:26.693226    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" podUID="38ce5e09-0410-460f-8f26-8106a385923b" containerName="maas-api" containerID="cri-o://e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a" gracePeriod=30
Jul 15 14:01:26.971630 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:26.971603    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 14:01:27.058136 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.058095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca\") pod \"38ce5e09-0410-460f-8f26-8106a385923b\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") "
Jul 15 14:01:27.058136 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.058132    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls\") pod \"38ce5e09-0410-460f-8f26-8106a385923b\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") "
Jul 15 14:01:27.058394 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.058212    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j242s\" (UniqueName: \"kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s\") pod \"38ce5e09-0410-460f-8f26-8106a385923b\" (UID: \"38ce5e09-0410-460f-8f26-8106a385923b\") "
Jul 15 14:01:27.058546 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.058524    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38ce5e09-0410-460f-8f26-8106a385923b" (UID: "38ce5e09-0410-460f-8f26-8106a385923b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:01:27.060435 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.060412    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38ce5e09-0410-460f-8f26-8106a385923b" (UID: "38ce5e09-0410-460f-8f26-8106a385923b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:01:27.060523 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.060429    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s" (OuterVolumeSpecName: "kube-api-access-j242s") pod "38ce5e09-0410-460f-8f26-8106a385923b" (UID: "38ce5e09-0410-460f-8f26-8106a385923b"). InnerVolumeSpecName "kube-api-access-j242s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:27.165537 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.159322    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38ce5e09-0410-460f-8f26-8106a385923b-maas-api-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:27.165537 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.165011    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j242s\" (UniqueName: \"kubernetes.io/projected/38ce5e09-0410-460f-8f26-8106a385923b-kube-api-access-j242s\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:27.165537 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.165048    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38ce5e09-0410-460f-8f26-8106a385923b-openshift-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:27.495363 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.495329    2571 generic.go:356] "Generic (PLEG): container finished" podID="38ce5e09-0410-460f-8f26-8106a385923b" containerID="e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a" exitCode=0
Jul 15 14:01:27.495553 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.495388    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"
Jul 15 14:01:27.495553 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.495413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" event={"ID":"38ce5e09-0410-460f-8f26-8106a385923b","Type":"ContainerDied","Data":"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"}
Jul 15 14:01:27.495553 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.495491    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8" event={"ID":"38ce5e09-0410-460f-8f26-8106a385923b","Type":"ContainerDied","Data":"398b6683957d51ad0b90c985a78f0956ee2b3d74465503bcdb62a952356866f0"}
Jul 15 14:01:27.495553 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.495513    2571 scope.go:117] "RemoveContainer" containerID="e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"
Jul 15 14:01:27.504933 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.504911    2571 scope.go:117] "RemoveContainer" containerID="e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"
Jul 15 14:01:27.505188 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:27.505169    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a\": container with ID starting with e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a not found: ID does not exist" containerID="e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"
Jul 15 14:01:27.505238 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.505198    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a"} err="failed to get container status \"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a\": rpc error: code = NotFound desc = could not find container \"e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a\": container with ID starting with e6b063bea030e774c102348ee18bcfdb7ede1d9c7407620a3d613ce33fbb0d0a not found: ID does not exist"
Jul 15 14:01:27.521431 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.521402    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 14:01:27.523694 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:27.523667    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8c00d1-5cdcf64b97-jflj8"]
Jul 15 14:01:28.717022 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:28.716984    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ce5e09-0410-460f-8f26-8106a385923b" path="/var/lib/kubelet/pods/38ce5e09-0410-460f-8f26-8106a385923b/volumes"
Jul 15 14:01:29.802997 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:29.802962    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:01:30.824789 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:30.824762    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 14:01:30.834730 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:30.834707    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8p8w_5806175a-7db8-4cdb-84bf-a69611eeccf9/ovn-acl-logging/0.log"
Jul 15 14:01:52.890981 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:52.890937    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 14:01:52.891528 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:52.891202    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" podUID="3d200d11-2115-4e37-a746-4fd715178f0e" containerName="maas-api" containerID="cri-o://c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9" gracePeriod=30
Jul 15 14:01:53.357360 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.357334    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 14:01:53.514903 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.514810    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca\") pod \"3d200d11-2115-4e37-a746-4fd715178f0e\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") "
Jul 15 14:01:53.514903 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.514847    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjh8g\" (UniqueName: \"kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g\") pod \"3d200d11-2115-4e37-a746-4fd715178f0e\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") "
Jul 15 14:01:53.514903 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.514873    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls\") pod \"3d200d11-2115-4e37-a746-4fd715178f0e\" (UID: \"3d200d11-2115-4e37-a746-4fd715178f0e\") "
Jul 15 14:01:53.515243 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.515220    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d200d11-2115-4e37-a746-4fd715178f0e" (UID: "3d200d11-2115-4e37-a746-4fd715178f0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:01:53.517059 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.517035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d200d11-2115-4e37-a746-4fd715178f0e" (UID: "3d200d11-2115-4e37-a746-4fd715178f0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:01:53.517172 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.517063    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g" (OuterVolumeSpecName: "kube-api-access-jjh8g") pod "3d200d11-2115-4e37-a746-4fd715178f0e" (UID: "3d200d11-2115-4e37-a746-4fd715178f0e"). InnerVolumeSpecName "kube-api-access-jjh8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:01:53.615708 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.615678    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d200d11-2115-4e37-a746-4fd715178f0e-openshift-service-ca\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:53.615708 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.615704    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjh8g\" (UniqueName: \"kubernetes.io/projected/3d200d11-2115-4e37-a746-4fd715178f0e-kube-api-access-jjh8g\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:53.615708 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.615716    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d200d11-2115-4e37-a746-4fd715178f0e-maas-api-tls\") on node \"ip-10-0-136-182.ec2.internal\" DevicePath \"\""
Jul 15 14:01:53.638772 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.638741    2571 generic.go:356] "Generic (PLEG): container finished" podID="3d200d11-2115-4e37-a746-4fd715178f0e" containerID="c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9" exitCode=0
Jul 15 14:01:53.638947 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.638788    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"
Jul 15 14:01:53.638947 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.638834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" event={"ID":"3d200d11-2115-4e37-a746-4fd715178f0e","Type":"ContainerDied","Data":"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"}
Jul 15 14:01:53.638947 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.638885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4" event={"ID":"3d200d11-2115-4e37-a746-4fd715178f0e","Type":"ContainerDied","Data":"8163083462e5c37020abf008647e193ca09473a637fdf7fac7c297027ee46fca"}
Jul 15 14:01:53.638947 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.638908    2571 scope.go:117] "RemoveContainer" containerID="c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"
Jul 15 14:01:53.648596 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.648574    2571 scope.go:117] "RemoveContainer" containerID="c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"
Jul 15 14:01:53.648864 ip-10-0-136-182 kubenswrapper[2571]: E0715 14:01:53.648846    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9\": container with ID starting with c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9 not found: ID does not exist" containerID="c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"
Jul 15 14:01:53.648913 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.648874    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9"} err="failed to get container status \"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9\": rpc error: code = NotFound desc = could not find container \"c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9\": container with ID starting with c3686a738a74ccac517a054dfffe91093376d6c711c85925d973723ca0c66fa9 not found: ID does not exist"
Jul 15 14:01:53.668146 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.668114    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 14:01:53.675771 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:53.675740    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7746ae-cc8c7bff4-ktwt4"]
Jul 15 14:01:54.717165 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:54.717136    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d200d11-2115-4e37-a746-4fd715178f0e" path="/var/lib/kubelet/pods/3d200d11-2115-4e37-a746-4fd715178f0e/volumes"
Jul 15 14:01:56.196627 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:01:56.196592    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-z2bb4"]
Jul 15 14:02:08.899289 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:08.899254    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77464bdd47-44mnz_a38ee069-ba33-4f8d-b233-77203524f57a/authorino/0.log"
Jul 15 14:02:14.025649 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.025614    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j5xbb_3c1c6322-285f-4826-8d78-59d64400fc50/manager/0.log"
Jul 15 14:02:14.146305 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.146262    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h9q97_9886d400-c966-41ff-8ad6-9835607a9f1d/manager/0.log"
Jul 15 14:02:14.262506 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.262475    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dcb58757c-9k69x_920036f6-c17e-48c1-b395-fa652049d1e6/manager/0.log"
Jul 15 14:02:14.374513 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.374482    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lng46_a2d7dd74-36d9-472f-b062-f4042ee99041/server/0.log"
Jul 15 14:02:14.494693 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.494664    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vjz5l_036ac88f-a94f-4874-b7d7-264148de2943/manager/0.log"
Jul 15 14:02:14.607438 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.607408    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-jv9xf_e73d4a8d-d21d-405b-9a21-8c5e80da690a/copy-manifests/0.log"
Jul 15 14:02:14.620390 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:14.620363    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-jv9xf_e73d4a8d-d21d-405b-9a21-8c5e80da690a/manager/0.log"
Jul 15 14:02:15.523567 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:15.523534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735385-48ddl_1a5f21a7-9e84-4af5-aa64-dc014f2c6791/cleanup/0.log"
Jul 15 14:02:15.866990 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:15.866967    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-f2fb3294-q8jwk_d66d105c-9837-45e2-9803-79778e9a3704/revoke-keys/0.log"
Jul 15 14:02:15.981059 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:15.981034    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-3b7ec0-d4zmr_27e3ba4f-0b23-46fa-b0a1-1f47591cb946/revoke-keys/0.log"
Jul 15 14:02:16.096223 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:16.096196    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-5dfbdf-52nlc_52d9842a-8277-46ba-bdcf-f1b3997cc758/revoke-keys/0.log"
Jul 15 14:02:16.323172 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:16.323096    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-d22f29-5t6tw_1e37b40c-d000-4fc4-86b6-ac8f2103649d/revoke-keys/0.log"
Jul 15 14:02:16.437266 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:16.437232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-114e4a-vv5tq_63e57ff7-6d59-40f2-ab76-f961ab4f2cf2/revoke-keys/0.log"
Jul 15 14:02:17.124008 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:17.123971    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kzmdr_380e9bd4-18ef-4f36-bc6c-8bb3581bae79/postgres/0.log"
Jul 15 14:02:18.431072 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:18.431044    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77464bdd47-44mnz_a38ee069-ba33-4f8d-b233-77203524f57a/authorino/0.log"
Jul 15 14:02:18.548753 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:18.548719    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4j7r_1f907139-5a6e-46e2-bcca-121984df75bc/manager/0.log"
Jul 15 14:02:18.668302 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:18.668260    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8mjrn_4ccfcd03-529c-4c1e-89f4-141d4ca243d7/manager/0.log"
Jul 15 14:02:18.778133 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:18.778053    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6wqcg_4c3dadb7-846f-4842-87f2-c1038ecfd552/kuadrant-console-plugin/0.log"
Jul 15 14:02:18.897220 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:18.897173    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4mzh9_cc8bf98d-cac7-4303-87ae-24c77367d73a/registry-server/0.log"
Jul 15 14:02:19.027736 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:19.027706    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-slprx_f921c98b-8270-4f7b-a662-f973568145d2/manager/0.log"
Jul 15 14:02:19.150914 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:19.150886    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z2bb4_4382dd63-5409-4cab-84da-fedcb972a3e2/limitador/0.log"
Jul 15 14:02:19.908045 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:19.907981    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-4vzjq_fbd428e7-903a-43c6-b120-255103223ade/kube-auth-proxy/0.log"
Jul 15 14:02:20.400905 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:20.400870    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-nphqg_78780206-1817-4cc1-8754-51af229537ac/payload-processing/0.log"
Jul 15 14:02:20.870914 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:20.870888    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7h54q_eecf5178-a55c-40c6-8daa-1b6f01acc02e/main/0.log"
Jul 15 14:02:21.252137 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:21.252060    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbmrsk9_fedc9504-da12-418a-9360-cff270bb0e61/main/0.log"
Jul 15 14:02:25.845031 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.844987    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvswn/must-gather-9dlnc"]
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845700    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" containerName="test-curl-7757-140715320362304"
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845726    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" containerName="test-curl-7757-140715320362304"
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845740    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d200d11-2115-4e37-a746-4fd715178f0e" containerName="maas-api"
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845759    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d200d11-2115-4e37-a746-4fd715178f0e" containerName="maas-api"
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845782    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ce5e09-0410-460f-8f26-8106a385923b" containerName="maas-api"
Jul 15 14:02:25.845809 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845792    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ce5e09-0410-460f-8f26-8106a385923b" containerName="maas-api"
Jul 15 14:02:25.846202 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845932    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6c583e9-2496-4fb0-ab63-cbb9fc90fc1d" containerName="test-curl-7757-140715320362304"
Jul 15 14:02:25.846202 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845945    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d200d11-2115-4e37-a746-4fd715178f0e" containerName="maas-api"
Jul 15 14:02:25.846202 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.845950    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ce5e09-0410-460f-8f26-8106a385923b" containerName="maas-api"
Jul 15 14:02:25.849104 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.849085    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:25.852394 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.852375    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mvswn\"/\"default-dockercfg-9z4gh\""
Jul 15 14:02:25.853733 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.853714    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"openshift-service-ca.crt\""
Jul 15 14:02:25.853733 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.853723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mvswn\"/\"kube-root-ca.crt\""
Jul 15 14:02:25.861889 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.861854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/must-gather-9dlnc"]
Jul 15 14:02:25.905879 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.905836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1857a7b7-b478-47fe-b45b-32b42a6e582b-must-gather-output\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:25.906065 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:25.905898    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkxmn\" (UniqueName: \"kubernetes.io/projected/1857a7b7-b478-47fe-b45b-32b42a6e582b-kube-api-access-wkxmn\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.006808 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.006769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1857a7b7-b478-47fe-b45b-32b42a6e582b-must-gather-output\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.007018 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.006824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkxmn\" (UniqueName: \"kubernetes.io/projected/1857a7b7-b478-47fe-b45b-32b42a6e582b-kube-api-access-wkxmn\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.007186 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.007163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1857a7b7-b478-47fe-b45b-32b42a6e582b-must-gather-output\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.016320 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.016262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkxmn\" (UniqueName: \"kubernetes.io/projected/1857a7b7-b478-47fe-b45b-32b42a6e582b-kube-api-access-wkxmn\") pod \"must-gather-9dlnc\" (UID: \"1857a7b7-b478-47fe-b45b-32b42a6e582b\") " pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.158605 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.158527    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/must-gather-9dlnc"
Jul 15 14:02:26.316987 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.316958    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/must-gather-9dlnc"]
Jul 15 14:02:26.318722 ip-10-0-136-182 kubenswrapper[2571]: W0715 14:02:26.318696    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1857a7b7_b478_47fe_b45b_32b42a6e582b.slice/crio-e59ce1c486d1f9c6ed047a749d8b807da1dacaf4ea3f246e2b00acbdc2bdfa9b WatchSource:0}: Error finding container e59ce1c486d1f9c6ed047a749d8b807da1dacaf4ea3f246e2b00acbdc2bdfa9b: Status 404 returned error can't find the container with id e59ce1c486d1f9c6ed047a749d8b807da1dacaf4ea3f246e2b00acbdc2bdfa9b
Jul 15 14:02:26.813015 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:26.812978    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/must-gather-9dlnc" event={"ID":"1857a7b7-b478-47fe-b45b-32b42a6e582b","Type":"ContainerStarted","Data":"e59ce1c486d1f9c6ed047a749d8b807da1dacaf4ea3f246e2b00acbdc2bdfa9b"}
Jul 15 14:02:27.823729 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:27.823624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/must-gather-9dlnc" event={"ID":"1857a7b7-b478-47fe-b45b-32b42a6e582b","Type":"ContainerStarted","Data":"c69f6ca97640fc324f7e8d8704fd400faf4f19fbfd4ca5444cb9ff551eb726ea"}
Jul 15 14:02:27.823729 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:27.823677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/must-gather-9dlnc" event={"ID":"1857a7b7-b478-47fe-b45b-32b42a6e582b","Type":"ContainerStarted","Data":"d159876bdef2e5aaa0f563b33e460cd851332b6028947b4c4673e3098f355b79"}
Jul 15 14:02:27.842479 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:27.842410    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvswn/must-gather-9dlnc" podStartSLOduration=1.693345786 podStartE2EDuration="2.842384217s" totalImagesPullingTime="1.149038431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:27.841828982 +0000 UTC m=+3057.758636442" watchObservedRunningTime="2026-07-15 14:02:27.842384217 +0000 UTC m=+3057.759191666"
Jul 15 14:02:29.181918 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:29.181889    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8z6nt_e5a9d4b8-a4b7-44ac-9d8c-81ac8b50b6bc/global-pull-secret-syncer/0.log"
Jul 15 14:02:29.439313 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:29.439211    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zmc85_8660d488-98d3-4993-a39b-56b9743da74c/konnectivity-agent/0.log"
Jul 15 14:02:29.590366 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:29.590323    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-182.ec2.internal_30cc42da2b8d91e22106a50ef6e004ce/haproxy/0.log"
Jul 15 14:02:34.905952 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:34.905913    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-77464bdd47-44mnz_a38ee069-ba33-4f8d-b233-77203524f57a/authorino/0.log"
Jul 15 14:02:34.950335 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:34.950300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-d4j7r_1f907139-5a6e-46e2-bcca-121984df75bc/manager/0.log"
Jul 15 14:02:34.984718 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:34.984678    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8mjrn_4ccfcd03-529c-4c1e-89f4-141d4ca243d7/manager/0.log"
Jul 15 14:02:35.018590 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:35.018564    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6wqcg_4c3dadb7-846f-4842-87f2-c1038ecfd552/kuadrant-console-plugin/0.log"
Jul 15 14:02:35.072939 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:35.072907    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4mzh9_cc8bf98d-cac7-4303-87ae-24c77367d73a/registry-server/0.log"
Jul 15 14:02:35.276366 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:35.276241    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-slprx_f921c98b-8270-4f7b-a662-f973568145d2/manager/0.log"
Jul 15 14:02:35.306226 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:35.306159    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-z2bb4_4382dd63-5409-4cab-84da-fedcb972a3e2/limitador/0.log"
Jul 15 14:02:37.371940 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.371905    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ccjs9_a8e016a6-2738-4e0f-8de0-52d223e050d8/kube-state-metrics/0.log"
Jul 15 14:02:37.398741 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.398709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ccjs9_a8e016a6-2738-4e0f-8de0-52d223e050d8/kube-rbac-proxy-main/0.log"
Jul 15 14:02:37.426696 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.426634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ccjs9_a8e016a6-2738-4e0f-8de0-52d223e050d8/kube-rbac-proxy-self/0.log"
Jul 15 14:02:37.731086 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.730992    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q97xr_106f4e77-5ee8-4836-8b3b-572de9a3d400/node-exporter/0.log"
Jul 15 14:02:37.753148 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.753116    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q97xr_106f4e77-5ee8-4836-8b3b-572de9a3d400/kube-rbac-proxy/0.log"
Jul 15 14:02:37.780244 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:37.780208    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q97xr_106f4e77-5ee8-4836-8b3b-572de9a3d400/init-textfile/0.log"
Jul 15 14:02:38.251967 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.251937    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749ff455f4-9hblf_3ec35c80-5bb9-465d-8363-9d330e8364f9/telemeter-client/0.log"
Jul 15 14:02:38.285211 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.285182    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749ff455f4-9hblf_3ec35c80-5bb9-465d-8363-9d330e8364f9/reload/0.log"
Jul 15 14:02:38.315937 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.315911    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-749ff455f4-9hblf_3ec35c80-5bb9-465d-8363-9d330e8364f9/kube-rbac-proxy/0.log"
Jul 15 14:02:38.353372 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.353319    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/thanos-query/0.log"
Jul 15 14:02:38.385840 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.385808    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/kube-rbac-proxy-web/0.log"
Jul 15 14:02:38.416677 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.416646    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/kube-rbac-proxy/0.log"
Jul 15 14:02:38.447264 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.447226    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/prom-label-proxy/0.log"
Jul 15 14:02:38.475791 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.475756    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/kube-rbac-proxy-rules/0.log"
Jul 15 14:02:38.504655 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:38.504577    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7dd8486fb9-5ql9f_c8d26dd5-d052-4bfa-9fe2-c1e620a3ca69/kube-rbac-proxy-metrics/0.log"
Jul 15 14:02:39.558713 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.558667    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"]
Jul 15 14:02:39.566779 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.566753    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.576398 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.576363    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"]
Jul 15 14:02:39.583883 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.583845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-podres\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.584053 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.583993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-sys\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.584165 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.584137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-lib-modules\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.584223 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.584203    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-proc\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.584296 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.584241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58nt9\" (UniqueName: \"kubernetes.io/projected/2bb2f375-410e-458b-8895-2cdc4b195156-kube-api-access-58nt9\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686198 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-proc\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686198 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686179    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58nt9\" (UniqueName: \"kubernetes.io/projected/2bb2f375-410e-458b-8895-2cdc4b195156-kube-api-access-58nt9\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686491 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-podres\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686491 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686289    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-proc\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686491 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686328    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-sys\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686491 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-lib-modules\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686713 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-lib-modules\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686713 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-podres\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.686713 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.686676    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bb2f375-410e-458b-8895-2cdc4b195156-sys\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.696320 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.696244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58nt9\" (UniqueName: \"kubernetes.io/projected/2bb2f375-410e-458b-8895-2cdc4b195156-kube-api-access-58nt9\") pod \"perf-node-gather-daemonset-9nlx7\" (UID: \"2bb2f375-410e-458b-8895-2cdc4b195156\") " pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:39.883797 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:39.883759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:40.066258 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.065809    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"]
Jul 15 14:02:40.940580 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.940546    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7" event={"ID":"2bb2f375-410e-458b-8895-2cdc4b195156","Type":"ContainerStarted","Data":"368eaddf3d23691b536dec00b5ce88541862f114c80efa450fbe09d816c14c02"}
Jul 15 14:02:40.941080 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.940600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7" event={"ID":"2bb2f375-410e-458b-8895-2cdc4b195156","Type":"ContainerStarted","Data":"5a2e55d694116bae01a9fedbbe3eb11b8780e69c3c0325130ad5e4fe1ae54cf8"}
Jul 15 14:02:40.941080 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.940672    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:40.943827 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.943805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8499599bcd-jmrcc_b71a55d1-1130-4b06-8b0f-90387a317ca6/console/0.log"
Jul 15 14:02:40.967370 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:40.967318    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7" podStartSLOduration=1.967299357 podStartE2EDuration="1.967299357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:02:40.96618126 +0000 UTC m=+3070.882988706" watchObservedRunningTime="2026-07-15 14:02:40.967299357 +0000 UTC m=+3070.884106802"
Jul 15 14:02:42.983457 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:42.983426    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6rpmd_dbdd5d91-be5d-42f3-94c6-81d754b3046c/dns/0.log"
Jul 15 14:02:43.020484 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:43.020451    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6rpmd_dbdd5d91-be5d-42f3-94c6-81d754b3046c/kube-rbac-proxy/0.log"
Jul 15 14:02:43.181988 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:43.181952    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2rvnq_d75a082e-0e66-4c34-8e7f-73b4bc26c8f5/dns-node-resolver/0.log"
Jul 15 14:02:43.827405 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:43.827372    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9bf7bcbff-sm9jk_31d98e7c-3cbc-43c7-9d9b-215d010efd0b/registry/0.log"
Jul 15 14:02:43.912883 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:43.912855    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfm4n_f0981239-8d27-4987-852c-6987662e382f/node-ca/0.log"
Jul 15 14:02:45.179998 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:45.179970    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-4vzjq_fbd428e7-903a-43c6-b120-255103223ade/kube-auth-proxy/0.log"
Jul 15 14:02:45.396905 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:45.396878    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-nphqg_78780206-1817-4cc1-8754-51af229537ac/payload-processing/0.log"
Jul 15 14:02:46.228320 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:46.228268    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-khjzw_71dec017-c5ab-4890-a581-3ada193a3432/serve-healthcheck-canary/0.log"
Jul 15 14:02:46.959689 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:46.959661    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mvswn/perf-node-gather-daemonset-9nlx7"
Jul 15 14:02:47.136137 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:47.136109    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8822v_f00aee38-2c4a-4990-91ea-bd68a9cb9b57/kube-rbac-proxy/0.log"
Jul 15 14:02:47.174591 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:47.174561    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8822v_f00aee38-2c4a-4990-91ea-bd68a9cb9b57/exporter/0.log"
Jul 15 14:02:47.208800 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:47.208771    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8822v_f00aee38-2c4a-4990-91ea-bd68a9cb9b57/extractor/0.log"
Jul 15 14:02:50.105535 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.105484    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j5xbb_3c1c6322-285f-4826-8d78-59d64400fc50/manager/0.log"
Jul 15 14:02:50.276484 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.276389    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h9q97_9886d400-c966-41ff-8ad6-9835607a9f1d/manager/0.log"
Jul 15 14:02:50.398457 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.398417    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dcb58757c-9k69x_920036f6-c17e-48c1-b395-fa652049d1e6/manager/0.log"
Jul 15 14:02:50.429297 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.429259    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lng46_a2d7dd74-36d9-472f-b062-f4042ee99041/server/0.log"
Jul 15 14:02:50.512852 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.512820    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vjz5l_036ac88f-a94f-4874-b7d7-264148de2943/manager/0.log"
Jul 15 14:02:50.637377 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.637346    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-jv9xf_e73d4a8d-d21d-405b-9a21-8c5e80da690a/manager/0.log"
Jul 15 14:02:50.713858 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.713835    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-4vzjq_fbd428e7-903a-43c6-b120-255103223ade/kube-auth-proxy/0.log"
Jul 15 14:02:50.715432 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.715411    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f7f774c7f-jv9xf_e73d4a8d-d21d-405b-9a21-8c5e80da690a/copy-manifests/0.log"
Jul 15 14:02:50.880591 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:50.880558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-nphqg_78780206-1817-4cc1-8754-51af229537ac/payload-processing/0.log"
Jul 15 14:02:52.553974 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:52.553944    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78dd6b4fb5-4vzjq_fbd428e7-903a-43c6-b120-255103223ade/kube-auth-proxy/0.log"
Jul 15 14:02:52.702712 ip-10-0-136-182 kubenswrapper[2571]: I0715 14:02:52.702677    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-nphqg_78780206-1817-4cc1-8754-51af229537ac/payload-processing/0.log"